title: A citizen science toolkit to collect human perceptions of urban environments using open street view images

abstract: Street View Imagery (SVI) is a valuable data source for studies (e.g., environmental assessments, green space identification or land cover classification). While commercial SVI is available, such providers commonly restrict copying or reuse in ways necessary for research. Open SVI datasets are readily available from less restrictive sources, such as Mapillary, but due to the heterogeneity of the images, these require substantial preprocessing, filtering, and careful quality checks. We present an efficient method for automated downloading, processing, cropping, and filtering open SVI, to be used in a survey of human perceptions of the streets portrayed in these images. We demonstrate our open-source reusable SVI preparation and smartphone-friendly perception-survey software with Amsterdam (Netherlands) as the case study. Using a citizen science approach, we collected from 331 people 22,637 ratings about their perceptions for various criteria. We have published our software in a public repository for future re-use and reproducibility.


title: FusionVision: A comprehensive approach of 3D object reconstruction and segmentation from RGB-D cameras using YOLO and fast segment anything

abstract: In the realm of computer vision, the integration of advanced techniques into the processing of RGB-D camera inputs poses a significant challenge, given the inherent complexities arising from diverse environmental conditions and varying object appearances. Therefore, this paper introduces FusionVision, an exhaustive pipeline adapted for the robust 3D segmentation of objects in RGB-D imagery. Traditional computer vision systems face limitations in simultaneously capturing precise object boundaries and achieving high-precision object detection on depth map as they are mainly proposed for RGB cameras. To address this challenge, FusionVision adopts an integrated approach by merging state-of-the-art object detection techniques, with advanced instance segmentation methods. The integration of these components enables a holistic (unified analysis of information obtained from both color \textit{RGB} and depth \textit{D} channels) interpretation of RGB-D data, facilitating the extraction of comprehensive and accurate object information. The proposed FusionVision pipeline employs YOLO for identifying objects within the RGB image domain. Subsequently, FastSAM, an innovative semantic segmentation model, is applied to delineate object boundaries, yielding refined segmentation masks. The synergy between these components and their integration into 3D scene understanding ensures a cohesive fusion of object detection and segmentation, enhancing overall precision in 3D object segmentation. The code and pre-trained models are publicly available at https://github.com/safouaneelg/FusionVision/.


title: SoD$^2$: Statically Optimizing Dynamic Deep Neural Network

abstract: Though many compilation and runtime systems have been developed for DNNs in recent years, the focus has largely been on static DNNs. Dynamic DNNs, where tensor shapes and sizes and even the set of operators used are dependent upon the input and/or execution, are becoming common. This paper presents SoD$^2$, a comprehensive framework for optimizing Dynamic DNNs. The basis of our approach is a classification of common operators that form DNNs, and the use of this classification towards a Rank and Dimension Propagation (RDP) method. This framework statically determines the shapes of operators as known constants, symbolic constants, or operations on these. Next, using RDP we enable a series of optimizations, like fused code generation, execution (order) planning, and even runtime memory allocation plan generation. By evaluating the framework on 10 emerging Dynamic DNNs and comparing it against several existing systems, we demonstrate both reductions in execution latency and memory requirements, with RDP-enabled key optimizations responsible for much of the gains. Our evaluation results show that SoD$^2$ runs up to $3.9\times$ faster than these systems while saving up to $88\%$ peak memory consumption.


title: Med-Real2Sim: Non-Invasive Medical Digital Twins using Physics-Informed Self-Supervised Learning

abstract: A digital twin is a virtual replica of a real-world physical phenomena that uses mathematical modeling to characterize and simulate its defining features. By constructing digital twins for disease processes, we can perform in-silico simulations that mimic patients' health conditions and counterfactual outcomes under hypothetical interventions in a virtual setting. This eliminates the need for invasive procedures or uncertain treatment decisions. In this paper, we propose a method to identify digital twin model parameters using only noninvasive patient health data. We approach the digital twin modeling as a composite inverse problem, and observe that its structure resembles pretraining and finetuning in self-supervised learning (SSL). Leveraging this, we introduce a physics-informed SSL algorithm that initially pretrains a neural network on the pretext task of learning a differentiable simulator of a physiological process. Subsequently, the model is trained to reconstruct physiological measurements from noninvasive modalities while being constrained by the physical equations learned in pretraining. We apply our method to identify digital twins of cardiac hemodynamics using noninvasive echocardiogram videos, and demonstrate its utility in unsupervised disease detection and in-silico clinical trials.


title: Causal Graph ODE: Continuous Treatment Effect Modeling in Multi-agent Dynamical Systems

abstract: Real-world multi-agent systems are often dynamic and continuous, where the agents co-evolve and undergo changes in their trajectories and interactions over time. For example, the COVID-19 transmission in the U.S. can be viewed as a multi-agent system, where states act as agents and daily population movements between them are interactions. Estimating the counterfactual outcomes in such systems enables accurate future predictions and effective decision-making, such as formulating COVID-19 policies. However, existing methods fail to model the continuous dynamic effects of treatments on the outcome, especially when multiple treatments (e.g., "stay-at-home" and "get-vaccine" policies) are applied simultaneously. To tackle this challenge, we propose Causal Graph Ordinary Differential Equations (CAG-ODE), a novel model that captures the continuous interaction among agents using a Graph Neural Network (GNN) as the ODE function. The key innovation of our model is to learn time-dependent representations of treatments and incorporate them into the ODE function, enabling precise predictions of potential outcomes. To mitigate confounding bias, we further propose two domain adversarial learning-based objectives, which enable our model to learn balanced continuous representations that are not affected by treatments or interference. Experiments on two datasets (i.e., COVID-19 and tumor growth) demonstrate the superior performance of our proposed model.


title: Counterspeakers' Perspectives: Unveiling Barriers and AI Needs in the Fight against Online Hate

abstract: Counterspeech, i.e., direct responses against hate speech, has become an important tool to address the increasing amount of hate online while avoiding censorship. Although AI has been proposed to help scale up counterspeech efforts, this raises questions of how exactly AI could assist in this process, since counterspeech is a deeply empathetic and agentic process for those involved. In this work, we aim to answer this question, by conducting in-depth interviews with 10 extensively experienced counterspeakers and a large scale public survey with 342 everyday social media users. In participant responses, we identified four main types of barriers and AI needs related to resources, training, impact, and personal harms. However, our results also revealed overarching concerns of authenticity, agency, and functionality in using AI tools for counterspeech. To conclude, we discuss considerations for designing AI assistants that lower counterspeaking barriers without jeopardizing its meaning and purpose.


title: "Flex Tape Can't Fix That": Bias and Misinformation in Edited Language Models

abstract: Model editing has emerged as a cost-effective strategy to update knowledge stored in language models. However, model editing can have unintended consequences after edits are applied: information unrelated to the edits can also be changed, and other general behaviors of the model can be wrongly altered. In this work, we investigate how model editing methods unexpectedly amplify model biases post-edit. We introduce a novel benchmark dataset, Seesaw-CF, for measuring bias-related harms of model editing and conduct the first in-depth investigation of how different weight-editing methods impact model bias. Specifically, we focus on biases with respect to demographic attributes such as race, geographic origin, and gender, as well as qualitative flaws in long-form texts generated by edited language models. We find that edited models exhibit, to various degrees, more biased behavior as they become less confident in attributes for Asian, African, and South American subjects. Furthermore, edited models amplify sexism and xenophobia in text generations while remaining seemingly coherent and logical. Finally, editing facts about place of birth, country of citizenship, or gender have particularly negative effects on the model's knowledge about unrelated features like field of work.


title: Gas-dynamical Mass Measurements of the Supermassive Black Holes in the Early-Type Galaxies NGC 4786 and NGC 5193 from ALMA and HST Observations

abstract: We present molecular gas-dynamical mass measurements of the central black holes in the giant elliptical galaxies NGC 4786 and NGC 5193, based on CO(2$-$1) observations from the Atacama Large Millimeter/submillimeter Array (ALMA) and Hubble Space Telescope near-infrared imaging. The central region in each galaxy contains a circumnuclear disk that exhibits orderly rotation with projected line-of-sight velocities of ${\sim} 270\, \mathrm{km}\,\mathrm{s^{-1}}$. We build gas-dynamical models for the rotating disk in each galaxy and fit them directly to the ALMA data cubes. At $0.31^{\prime \prime}$resolution, the ALMA observations do not fully resolve the black hole sphere of influence (SOI), and neither galaxy exhibits a central rise in rotation speed, indicating that emission from deep within the SOI is not detected. As a result, our models do not tightly constrain the central black hole mass in either galaxy, but they prefer the presence of a central massive object in both galaxies. We measure the black hole mass to be $(M_{\mathrm{BH}}/10^8\, M_{\odot}) = 5.0 \pm 0.2 \,[\mathrm{1\sigma \,statistical}] \,^{+1.4}_{-1.3} \,[\mathrm{systematic}]$ in NGC 4786 and $(M_{\mathrm{BH}}/10^8\, M_{\odot}) = 1.4 \pm 0.03 \, [\mathrm{1\sigma\,statistical}] ^{+1.5}_{-0.1} \,[\mathrm{systematic}]$ in NGC 5193. The largest component of each measurement's error budget is from the systematic uncertainty associated with the extinction correction in the host galaxy models. This underscores the importance of assessing the impact of dust attenuation on the inferred $M_{\mathrm{BH}}$.


title: SAT, Gadgets, Max2XOR, and Quantum Annealers

abstract: Quantum Annealers are basically quantum computers that with high probability can optimize certain quadratic functions on Boolean variables in constant time. These functions are basically the Hamiltonian of Ising models that reach the ground energy state, with a high probability, after an annealing process. They have been proposed as a way to solve SAT. These Hamiltonians can be seen as Max2XOR problems, i.e. as the problem of finding an assignment that maximizes the number of XOR clauses of at most 2 variables that are satisfied. In this paper, we present several gadgets to reduce SAT to Max2XOR. We show how they can be used to translate SAT instances to initial configurations of a quantum annealer.


title: Trade-off between reconstruction accuracy and physical validity in modeling turbomachinery PIV data by Physics-Informed CNN

abstract: Particle Image Velocimetry (PIV) data is a valuable asset in fluid mechanics. It is capable of visualizing flow structures even in complex physics scenarios, such as the flow at the exit of the rotor of a centrifugal fan. Machine learning is also a successful companion to PIV in order to increase data resolution or impute experimental gaps. While classical algorithms focus solely on replicating data using statistical metrics, the application of Physics Informed Neural Networks (PINN) contributes to both data reconstruction and adherence to governing equations. The present study utilizes a convolutional physics-informed auto-encoder to reproduce planar PIV fields in the gappy regions while also satisfying the mass conservation equation. It proposes a novel approach, which compromises experimental data reconstruction for compliance with physical restrictions. Simultaneously, it is aimed to ensure that the reconstruction error does not considerably deviate from the uncertainty band of the test data. Turbulence scale approximation is employed to set the relative weighting of the physical and non-physical terms in the loss function to ensure that both objectives are achieved. All steps are initially evaluated on a set of DNS data to demonstrate the general capability of the network. Finally, examination of the PIV data indicates that the proposed PINN auto-encoder can enhance reconstruction accuracy by about 28% and 29% in terms of mass conservation residual and velocity statistics, respectively, in expense of up to 5% increase in the number of vectors with reconstruction error higher than the uncertainty band of the PIV test data.


title: Entry-Specific Bounds for Low-Rank Matrix Completion under Highly Non-Uniform Sampling

abstract: Low-rank matrix completion concerns the problem of estimating unobserved entries in a matrix using a sparse set of observed entries. We consider the non-uniform setting where the observed entries are sampled with highly varying probabilities, potentially with different asymptotic scalings. We show that under structured sampling probabilities, it is often better and sometimes optimal to run estimation algorithms on a smaller submatrix rather than the entire matrix. In particular, we prove error upper bounds customized to each entry, which match the minimax lower bounds under certain conditions. Our bounds characterize the hardness of estimating each entry as a function of the localized sampling probabilities. We provide numerical experiments that confirm our theoretical findings.


title: Broadening of the Divertor Heat Flux Profile in High Confinement Tokamak Fusion Plasmas with Edge Pedestals Limited by Turbulence in DIII-D

abstract: Multi-machine empirical scaling predicts an extremely narrow heat exhaust layer in future high magnetic field tokamaks, producing high power densities that require mitigation. In the experiments presented, the width of this exhaust layer is nearly doubled using actuators to increase turbulent transport in the plasma edge. This is achieved in low collisionality, high confinement edge pedestals with their gradients limited by turbulent transport instead of large-scale, coherent instabilities. The exhaust heat flux profile width and divertor leg diffusive spreading both double as a high frequency band of turbulent fluctuations propagating in the electron diamagnetic direction doubles in amplitude. The results are quantitatively reproduced in electromagnetic XGC particle-in-cell simulations which show the heat flux carried by electrons emerges to broaden the heat flux profile, directly supported by Langmuir probe measurements.


title: Warped Kernel Estimator for I.I.D. Paths of Diffusion Processes

abstract: This paper deals with a nonparametric warped kernel estimator $\widehat b$ of the drift function computed from independent continuous observations of a diffusion process. A risk bound on $\widehat b$ is established. The paper also deals with an extension of the PCO bandwidth selection method for $\widehat b$. Finally, some numerical experiments are provided.


title: Learning to walk in confined spaces using 3D representation

abstract: Legged robots have the potential to traverse complex terrain and access confined spaces beyond the reach of traditional platforms thanks to their ability to carefully select footholds and flexibly adapt their body posture while walking. However, robust deployment in real-world applications is still an open challenge. In this paper, we present a method for legged locomotion control using reinforcement learning and 3D volumetric representations to enable robust and versatile locomotion in confined and unstructured environments. By employing a two-layer hierarchical policy structure, we exploit the capabilities of a highly robust low-level policy to follow 6D commands and a high-level policy to enable three-dimensional spatial awareness for navigating under overhanging obstacles. Our study includes the development of a procedural terrain generator to create diverse training environments. We present a series of experimental evaluations in both simulation and real-world settings, demonstrating the effectiveness of our approach in controlling a quadruped robot in confined, rough terrain. By achieving this, our work extends the applicability of legged robots to a broader range of scenarios.


title: Impact of Decentralized Learning on Player Utilities in Stackelberg Games

abstract: When deployed in the world, a learning agent such as a recommender system or a chatbot often repeatedly interacts with another learning agent (such as a user) over time. In many such two-agent systems, each agent learns separately and the rewards of the two agents are not perfectly aligned. To better understand such cases, we examine the learning dynamics of the two-agent system and the implications for each agent's objective. We model these systems as Stackelberg games with decentralized learning and show that standard regret benchmarks (such as Stackelberg equilibrium payoffs) result in worst-case linear regret for at least one player. To better capture these systems, we construct a relaxed regret benchmark that is tolerant to small learning errors by agents. We show that standard learning algorithms fail to provide sublinear regret, and we develop algorithms to achieve near-optimal $O(T^{2/3})$ regret for both players with respect to these benchmarks. We further design relaxed environments under which faster learning ($O(\sqrt{T})$) is possible. Altogether, our results take a step towards assessing how two-agent interactions in sequential and decentralized learning environments affect the utility of both agents.


title: The Road to Next-Generation Multiple Access: A 50-Year Tutorial Review

abstract: The evolution of wireless communications has been significantly influenced by remarkable advancements in multiple access (MA) technologies over the past five decades, shaping the landscape of modern connectivity. Within this context, a comprehensive tutorial review is presented, focusing on representative MA techniques developed over the past 50 years. The following areas are explored: i) The foundational principles and information-theoretic capacity limits of power-domain non-orthogonal multiple access (NOMA) are characterized, along with its extension to multiple-input multiple-output (MIMO)-NOMA. ii) Several MA transmission schemes exploiting the spatial domain are investigated, encompassing both conventional space-division multiple access (SDMA)/MIMO-NOMA systems and near-field MA systems utilizing spherical-wave propagation models. iii) The application of NOMA to integrated sensing and communications (ISAC) systems is studied. This includes an introduction to typical NOMA-based downlink/uplink ISAC frameworks, followed by an evaluation of their performance limits using a mutual information (MI)-based analytical framework. iv) Major issues and research opportunities associated with the integration of MA with other emerging technologies are identified to facilitate MA in next-generation networks, i.e., next-generation multiple access (NGMA). Throughout the paper, promising directions are highlighted to inspire future research endeavors in the realm of MA and NGMA.


title: Identification of important nodes in the information propagation network based on the artificial intelligence method

abstract: This study presents an integrated approach for identifying key nodes in information propagation networks using advanced artificial intelligence methods. We introduce a novel technique that combines the Decision-making Trial and Evaluation Laboratory (DEMATEL) method with the Global Structure Model (GSM), creating a synergistic model that effectively captures both local and global influences within a network. This method is applied across various complex networks, such as social, transportation, and communication systems, utilizing the Global Network Influence Dataset (GNID). Our analysis highlights the structural dynamics and resilience of these networks, revealing insights into node connectivity and community formation. The findings demonstrate the effectiveness of our AI-based approach in offering a comprehensive understanding of network behavior, contributing significantly to strategic network analysis and optimization.


title: Ab initio modelling of quantum dot qubits: Coupling, gate dynamics and robustness versus charge noise

abstract: Electron spins in semiconductor devices are highly promising building blocks for quantum processors (QPs). Commercial semiconductor foundries can create QPs using the same processes employed for conventional chips, once the QP design is suitably specified. There is a vast accessible design space; to identify the most promising options for fabrication, one requires predictive modeling of interacting electrons in real geometries and complex non-ideal environments. In this work we explore a modelling method based on real-space grids, an ab initio approach without assumptions relating to device topology and therefore with wide applicability. Given an electrode geometry, we determine the exchange coupling between quantum dot qubits, and model the full evolution of a $\sqrt{\text{SWAP}}$ gate to predict qubit loss and infidelity rates for various voltage profiles. Moreover we explore the impact of unwanted charge defects (static and dynamic) in the environment, and test robust pulse sequences. As an example we exhibit a sequence correcting both systematic errors and (unknown) charge defects, observing an order of magnitude boost in fidelity. The technique can thus identify the most promising device designs for fabrication, as well as bespoke control sequences for each such device.


title: Block-MDS QC-LDPC Codes for Information Reconciliation in Key Distribution

abstract: Quantum key distribution (QKD) is a popular protocol that provides information theoretically secure keys to multiple parties. Two important post-processing steps of QKD are 1) the information reconciliation (IR) step, where parties reconcile mismatches in generated keys through classical communication, and 2) the privacy amplification (PA) step, where parties distill their common key into a new secure key that the adversary has little to no information about. In general, these two steps have been abstracted as two distinct problems. In this work, we consider a new technique of performing the IR and PA steps jointly through sampling that relaxes the requirement on the IR step, allowing for more success in key creation. We provide a novel LDPC code construction known as Block-MDS QC-LDPC codes that can utilize the relaxed requirement by creating LDPC codes with pre-defined sub-matrices of full-rank. We demonstrate through simulations that our technique of sampling can provide notable gains in successfully creating secret keys.


title: Structural Resilience and Connectivity of the IPv6 Internet: An AS-level Topology Examination

abstract: The study utilizes a comprehensive dataset informed by IPv6 routing information to provide statistics, degree distribution, joint degree distribution, and clustering analysis of the IPv6 Internet's structure and resilience.The dataset includes 17,232 unique ASes and 10,000 unique IPv6 prefixes. Analysis reveals an interconnected network with an average path length of approximately 3 hops, suggesting a robust and efficient network with potential redundancy and resilience, despite some isolated components. The paper outlines the degree distribution, indicating many peripheral nodes in a sparse network, and a clustering analysis showing a tendency for ASes to form clusters, which is indicative of redundancy and robustness against failures. The connectivity analysis, including path redundancy and reachability, supports the network's resilience.The findings are crucial for network design and strategic planning, particularly as IPv6 adoption increases. The paper emphasizes the importance of continuous monitoring and improvement of network connectivity in the evolving Internet landscape, highlighting the IPv6 Internet's resilience and structured connectivity.


title: Ask Your Distribution Shift if Pre-Training is Right for You

abstract: Pre-training is a widely used approach to develop models that are robust to distribution shifts. However, in practice, its effectiveness varies: fine-tuning a pre-trained model improves robustness significantly in some cases but not at all in others (compared to training from scratch). In this work, we seek to characterize the failure modes that pre-training can and cannot address. In particular, we focus on two possible failure modes of models under distribution shift: poor extrapolation (e.g., they cannot generalize to a different domain) and biases in the training data (e.g., they rely on spurious features). Our study suggests that, as a rule of thumb, pre-training can help mitigate poor extrapolation but not dataset biases. After providing theoretical motivation and empirical evidence for this finding, we explore two of its implications for developing robust models: (1) pre-training and interventions designed to prevent exploiting biases have complementary robustness benefits, and (2) fine-tuning on a (very) small, non-diverse but de-biased dataset can result in significantly more robust models than fine-tuning on a large and diverse but biased dataset. Code is available at https://github.com/MadryLab/pretraining-distribution-shift-robustness.


title: The evolution of pluralistic ignorance

abstract: Pluralistic ignorance is a social-psychological phenomenon characterized by individuals privately maintaining beliefs or opinions that diverge from what they perceive to be the prevailing norm within a group or society. Typical models are based on opinion dynamics involving both private and public states, where agents' binary states undergo changes influenced by social pressure. However, these models overlook a crucial aspect of pluralistic ignorance: if the absence of behavioral expression matches the normative status of the behavior, social pressure exerted by the initial group configuration is enough to induce pluralistic ignorance. Here, we show that pluralistic ignorance is maintained if imitation of others is not too frequent and the social influence of the initial minority is high. Interestingly, the individuals are able to overcome the pluralistic ignorance by the end of interactions, yet it resurfaces at the outset of each subsequent group interaction. However, if the likelihood of individuals imitating others becomes excessively high, pluralistic ignorance completely dissipates in an undesirable manner: individuals internalize the dysfunctional behavior. We also show that, if memory is added to the internalization process, pluralistic ignorance reaches high levels only for intermediate imitation rates.


title: Learning to Find Missing Video Frames with Synthetic Data Augmentation: A General Framework and Application in Generating Thermal Images Using RGB Cameras

abstract: Advanced Driver Assistance Systems (ADAS) in intelligent vehicles rely on accurate driver perception within the vehicle cabin, often leveraging a combination of sensing modalities. However, these modalities operate at varying rates, posing challenges for real-time, comprehensive driver state monitoring. This paper addresses the issue of missing data due to sensor frame rate mismatches, introducing a generative model approach to create synthetic yet realistic thermal imagery. We propose using conditional generative adversarial networks (cGANs), specifically comparing the pix2pix and CycleGAN architectures. Experimental results demonstrate that pix2pix outperforms CycleGAN, and utilizing multi-view input styles, especially stacked views, enhances the accuracy of thermal image generation. Moreover, the study evaluates the model's generalizability across different subjects, revealing the importance of individualized training for optimal performance. The findings suggest the potential of generative models in addressing missing frames, advancing driver state monitoring for intelligent vehicles, and underscoring the need for continued research in model generalization and customization.


title: Unifying Collisional Models and the Monte Carlo Metropolis Method: Algorithms for Dynamics of Open Quantum Systems

abstract: Classical systems placed in contact with a thermal bath will inevitably equilibrate to a thermal state at the bath temperature. The same is not generally true for open quantum systems, which place additional conditions on the structure of the bath and system-bath interaction if thermalization is to occur. Collisional models, or repeated interaction schemes, are a category of microscopic open quantum system models that have seen growing use in studying quantum thermalization, in which the bath is modeled as a large ensemble of identical ancilla systems that sequentially interact with the system. We demonstrate that, when each bath ancilla is prepared in a thermal state with a discrete spectrum that matches the energy eigenstate transitions of the system, the system dynamics generated by the collisional model framework are identical to those generated under the Metropolis algorithm. This equivalence holds not just in the steady state regime, but also in the transient regime. As the Metropolis scheme does not require explicitly modeling the system-bath interaction, this allows it to be used as a computationally efficient alternative for simulating collisional model dynamics.


title: AXOLOTL: Fairness through Assisted Self-Debiasing of Large Language Model Outputs

abstract: Pre-trained Large Language Models (LLMs) have significantly advanced natural language processing capabilities but are susceptible to biases present in their training data, leading to unfair outcomes in various applications. While numerous strategies have been proposed to mitigate bias, they often require extensive computational resources and may compromise model performance. In this work, we introduce AXOLOTL, a novel post-processing framework, which operates agnostically across tasks and models, leveraging public APIs to interact with LLMs without direct access to internal parameters. Through a three-step process resembling zero-shot learning, AXOLOTL identifies biases, proposes resolutions, and guides the model to self-debias its outputs. This approach minimizes computational costs and preserves model performance, making AXOLOTL a promising tool for debiasing LLM outputs with broad applicability and ease of use.


title: Improving Socratic Question Generation using Data Augmentation and Preference Optimization

abstract: The Socratic method is a way of guiding students toward solving a problem independently without directly revealing the solution to the problem. Although this method has been shown to significantly improve student learning outcomes, it remains a complex labor-intensive task for instructors. Large language models (LLMs) can be used to augment human effort by automatically generating Socratic questions for students. However, existing methods that involve prompting these LLMs sometimes produce invalid outputs, e.g., those that directly reveal the solution to the problem or provide irrelevant or premature questions. To alleviate this problem, inspired by reinforcement learning with AI feedback (RLAIF), we first propose a data augmentation method to enrich existing Socratic questioning datasets with questions that are invalid in specific ways. Next, we propose a method to optimize open-source LLMs such as LLama 2 to prefer ground-truth questions over generated invalid ones, using direct preference optimization (DPO). Our experiments on a Socratic questions dataset for student code debugging show that a DPO-optimized 7B LLama 2 model can effectively avoid generating invalid questions, and as a result, outperforms existing state-of-the-art prompting methods.


title: Skew-Gaussian model of small-photon-number coherent Ising machines

abstract: A Gaussian quantum theory of bosonic modes has been widely used to describe quantum optical systems, including coherent Ising machines (CIMs) that consist of $\chi^{(2)}$ degenerate optical parametric oscillators (DOPOs) as nonlinear elements. However, Gaussian models have been thought to be invalid in the extremely strong-gain-saturation limit. Here, we develop an extended Gaussian model including two third-order fluctuation products, $\langle \delta \hat{X}^3\rangle$ and $\langle \delta \hat{X}\delta \hat{P}^2\rangle$, which we call self-skewness and cross-skewness, respectively. This new model which we call skew-Gaussian model more precisely replicates the success probability predicted by the quantum master equation (QME), relative to Gaussian models. We also discuss the impact of skew variables on the performance of CIMs.


title: Constructive S4 modal logics with the finite birelational frame property

abstract: The logics $\mathsf{CS4}$ and $\mathsf{IS4}$ are the two leading intuitionistic variants of the modal logic $\mathsf{S4}$. Whether the finite model property holds for each of these logics have been long-standing open problems. It was recently shown that $\mathsf{IS4}$ has the finite frame property and thus the finite model property. In this paper, we prove that $\mathsf{CS4}$ also enjoys the finite frame property. Additionally, we investigate the following three logics closely related to $\mathsf{IS4}$. The logic $\mathsf{GS4}$ is obtained by adding the G\"odel--Dummett axiom to $\mathsf{IS4}$; it is both a superintuitionistic and a fuzzy logic and has previously been given a real-valued semantics. We provide an alternative birelational semantics and prove strong completeness with respect to this semantics. The extension $\mathsf{GS4^c}$ of $\mathsf{GS4}$ corresponds to requiring a crisp accessibility relation on the real-valued semantics. We give a birelational semantics corresponding to an extra confluence condition on the $\mathsf{GS4}$ birelational semantics and prove strong completeness. Neither of these two logics have the finite model property with respect to their real-valued semantics, but we prove that they have the finite frame property for their birelational semantics. Establishing the finite birelational frame property immediately establishes decidability, which was previously open for these two logics. Our proofs yield NEXPTIME upper bounds. The logic $\mathsf{S4I}$ is obtained from $\mathsf{IS4}$ by reversing the roles of the modal and intuitionistic relations in the birelational semantics. We also prove the finite frame property, and thereby decidability, for $\mathsf{S4I}$


title: Substitute adjustment via recovery of latent variables

abstract: The deconfounder was proposed as a method for estimating causal parameters in a context with multiple causes and unobserved confounding. It is based on recovery of a latent variable from the observed causes. We disentangle the causal interpretation from the statistical estimation problem and show that the deconfounder in general estimates adjusted regression target parameters. It does so by outcome regression adjusted for the recovered latent variable termed the substitute. We refer to the general algorithm, stripped of causal assumptions, as substitute adjustment. We give theoretical results to support that substitute adjustment estimates adjusted regression parameters when the regressors are conditionally independent given the latent variable. We also introduce a variant of our substitute adjustment algorithm that estimates an assumption-lean target parameter with minimal model assumptions. We then give finite sample bounds and asymptotic results supporting substitute adjustment estimation in the case where the latent variable takes values in a finite set. A simulation study illustrates finite sample properties of substitute adjustment. Our results support that when the latent variable model of the regressors hold, substitute adjustment is a viable method for adjusted regression.


title: New invariants of involutions from Seiberg-Witten Floer theory

abstract: We study equivariant Seiberg-Witten Floer theory of rational homology $3$-spheres in the special case where the group action is given by an involution. The case of involutions deserves special attention because we can couple the involution to the charge conjugation symmetry of Seiberg-Witten theory. This leads to new Floer-theoretic invariants which we study and apply in a variety of applications. In particular, we construct a series of delta-invariants $\delta^E_*, \delta^R_*, \delta^S_*$ which are the equivariant equivalents of the Ozsv\'ath-Szab\'o $d$-invariant. The delta-invariants come in three types: equivariant, Real and spin depending on the type of the spin$^c$-structure involved. The delta-invariants satisfy many useful properties, including a Froyshov-type inequality for equivariant cobordisms. We compute the delta-invariants in a wide range of examples including: equivariant plumbings, branched double covers of knots and equivariant Dehn surgery. We also consider various applications including obstructions to extending involutions over bounding $4$-manifolds, non-smoothable involutions on $4$-manifolds with boundary, equivariant embeddings of $3$-manifolds in $4$-manifolds and non-orientable surfaces bounding knots.


title: La$_4$Co$_4$X (X = Pb, Bi, Sb): a demonstration of antagonistic pairs as a route to quasi-low dimensional ternary compounds

abstract: We outline how pairs of strongly immiscible elements, referred to here as antagonistic pairs, can be used to synthesize ternary compounds with quasi-reduced dimensional motifs. By identifying third elements that are compatible with a given antagonistic pair, ternary compounds can be formed in which the third element segregates the immiscible atoms into spatially separated substructures. Quasi-low dimensional structural units are a natural consequence of the immiscible atoms seeking to avoid contact in the solid-state. As proof of principle, we present the discovery and physical properties of La$_4$Co$_4$X (X = Pb, Bi, Sb), a new family of intermetallics based on the antagonistic pairs Co-Pb and Co-Bi. La$_4$Co$_4$X adopts a new orthorhombic crystal structure (space group Pbam) containing quasi-2D Co slabs and La-X layers that stack along the a-axis. Consistent with our proposal, the La atoms separate the Co and X substructures, ensuring there are no direct contacts between immiscible atoms. Within the Co slabs, the atoms occupy the vertices of corner sharing tetrahedra and triangles, and this motif produces flat electronic bands near the Fermi level that favor magnetism. The Co is moment bearing in La$_4$Co$_4$X, and we show that whereas La$_4$Co$_4$Pb behaves as a three dimensional antiferromagnet with T$_N$ = 220 K, La$_4$Co$_4$Bi and La$_4$Co$_4$Sb have behavior consistent with low dimensional magnetic coupling and ordering, with T$_N$ = 153 K and 143 K respectively. In addition to the Pb, Bi, and Sb based La$_4$Co$_4$X compounds, we were likely able to produce an analogous La$_4$Co$_4$Sn in polycrystalline form, although we were unable to isolate single crystals. We anticipate that using mutually compatible third elements with an antagonistic pair represents a generalizable design principle for discovering new materials and structure types containing low-dimensional substructures.


title: A Wallace semigroup whose every finite power is countably compact

abstract: We show that, assuming the existence of $\mathfrak{c}$ incomparable selective ultrafilters, there exists a Wallace semigroup whose infinite countable power is the least power which fails to be countably compact. This answers positively Question 9.4 of \cite{Tomita15}.


title: MaskLRF: Self-supervised Pretraining via Masked Autoencoding of Local Reference Frames for Rotation-invariant 3D Point Set Analysis

abstract: Following the successes in the fields of vision and language, self-supervised pretraining via masked autoencoding of 3D point set data, or Masked Point Modeling (MPM), has achieved state-of-the-art accuracy in various downstream tasks. However, current MPM methods lack a property essential for 3D point set analysis, namely, invariance against rotation of 3D objects/scenes. Existing MPM methods are thus not necessarily suitable for real-world applications where 3D point sets may have inconsistent orientations. This paper develops, for the first time, a rotation-invariant self-supervised pretraining framework for practical 3D point set analysis. The proposed algorithm, called MaskLRF, learns rotation-invariant and highly generalizable latent features via masked autoencoding of 3D points within Local Reference Frames (LRFs), which are not affected by rotation of 3D point sets. MaskLRF enhances the quality of latent features by integrating feature refinement using relative pose encoding and feature reconstruction using low-level but rich 3D geometry. The efficacy of MaskLRF is validated via extensive experiments on diverse downstream tasks including classification, segmentation, registration, and domain adaptation. I confirm that MaskLRF achieves new state-of-the-art accuracies in analyzing 3D point sets having inconsistent orientations. Code will be available at: https://github.com/takahikof/MaskLRF


title: Yodel: A Layer 3.5 Name-Based Multicast Network Architecture For The Future Internet

abstract: Multicasting refers to the ability of transmitting data to multiple recipients without data sources needing to provide more than one copy of the data to the network. The network takes responsibility to route and deliver a copy of each data to every intended recipient. Multicasting has the potential to improve the network efficiency and performance (e.g., throughput and latency) through transferring fewer bits in communicating the same data to multiple recipients compared with unicast transmissions, reduce the amount of networking resources needed for communication, lower the network energy footprint, and alleviate the occurrence of congestion in the network. Over the past few decades, providing multicast services has been a real challenge for ISPs, especially to support home users and multi-domain network applications, leading to the emergence of complex application-level solutions. These solutions like Content Delivery and Peer-to-Peer networks take advantage of complex caching, routing, transport, and topology management systems which put heavy strains on the underlying Internet infrastructures to offer multicasting services. In reality, the main motivation behind the design of these systems is rather sharing content than offering efficient multicast services. In this paper, we propound Yodel, a name-based multicast network architecture that can provide multi-domain multicast services for current and future Internet applications. Compared to the wider array of other name-based network architectures with clean-slate infrastructure requirements, Yodel is designed to provide multicast services over the current Internet infrastructure. Hence, Yodel puts forward several design goals that distinguish it from other name-based network architectures with inherent multicast capabilities. This paper is prepared to discuss the Yodel architecture, its design goals, and architectural functions.


title: Multi-junction surface ion trap for quantum computing

abstract: Surface ion traps with two-dimensional layouts of trapping regions are natural architectures for storing large numbers of ions and supporting the connectivity needed to implement quantum algorithms. Many of the components and operations needed to fully exploit this architecture have already been demonstrated, including operation at cryogenic temperatures with low heating, low excitation transport, and ion control and detection with integrated photonics. Here we demonstrate a trap that addresses the scaling challenge of increasing power dissipation as the RF electrode increases in size. By raising the RF electrode and removing most of the insulating dielectric layer below it we reduce both ohmic and dielectric power dissipation. We also measure heating rates across a range of motional frequencies and for different voltage sources in a trap with a raised RF electrode but solid dielectric.


title: ChartReformer: Natural Language-Driven Chart Image Editing

abstract: Chart visualizations are essential for data interpretation and communication; however, most charts are only accessible in image format and lack the corresponding data tables and supplementary information, making it difficult to alter their appearance for different application scenarios. To eliminate the need for original underlying data and information to perform chart editing, we propose ChartReformer, a natural language-driven chart image editing solution that directly edits the charts from the input images with the given instruction prompts. The key in this method is that we allow the model to comprehend the chart and reason over the prompt to generate the corresponding underlying data table and visual attributes for new charts, enabling precise edits. Additionally, to generalize ChartReformer, we define and standardize various types of chart editing, covering style, layout, format, and data-centric edits. The experiments show promising results for the natural language-driven chart image editing.


title: Dissipative stabilization of high-dimensional GHZ states for neutral atoms

abstract: High-dimensional quantum entanglement characterizes the entanglement of quantum systems within a larger Hilbert space, introducing more intricate and complex correlations among the entangled particles' states. The high-dimensional Greenberger-Horne-Zeilinger (GHZ) state, symbolic of this type of entanglement, is of significant importance in various quantum information processing applications. This study proposes integrating a neutral atom platform with quantum reservoir engineering to generate a high-dimensional GHZ state deterministically. Leveraging the advantages of neutral atoms in a modified unconventional Rydberg pumping mechanism, combined with controlled dissipation, we achieve a three-dimensional GHZ state with a fidelity surpassing 99\% through multiple pump and dissipation cycles. This innovative approach paves the way for experimentally feasible, deterministic preparation of high-dimensional GHZ states in Rydberg atom systems, thereby advancing the capabilities of quantum information processing.


title: Trustworthy Self-Attention: Enabling the Network to Focus Only on the Most Relevant References

abstract: The prediction of optical flow for occluded points is still a difficult problem that has not yet been solved. Recent methods use self-attention to find relevant non-occluded points as references for estimating the optical flow of occluded points based on the assumption of self-similarity. However, they rely on visual features of a single image and weak constraints, which are not sufficient to constrain the trained network to focus on erroneous and weakly relevant reference points. We make full use of online occlusion recognition information to construct occlusion extended visual features and two strong constraints, allowing the network to learn to focus only on the most relevant references without requiring occlusion ground truth to participate in the training of the network. Our method adds very few network parameters to the original framework, making it very lightweight. Extensive experiments show that our model has the greatest cross-dataset generalization. Our method achieves much greater error reduction, 18.6%, 16.2%, and 20.1% for all points, non-occluded points, and occluded points respectively from the state-of-the-art GMA-base method, MATCHFlow(GMA), on Sintel Albedo pass. Furthermore, our model achieves state-of-the-art performance on the Sintel bench-marks, ranking \#1 among all published methods on Sintel clean pass. The code will be open-source.


title: Transcription and translation of videos using fine-tuned XLSR Wav2Vec2 on custom dataset and mBART

abstract: This research addresses the challenge of training an ASR model for personalized voices with minimal data. Utilizing just 14 minutes of custom audio from a YouTube video, we employ Retrieval-Based Voice Conversion (RVC) to create a custom Common Voice 16.0 corpus. Subsequently, a Cross-lingual Self-supervised Representations (XLSR) Wav2Vec2 model is fine-tuned on this dataset. The developed web-based GUI efficiently transcribes and translates input Hindi videos. By integrating XLSR Wav2Vec2 and mBART, the system aligns the translated text with the video timeline, delivering an accessible solution for multilingual video content transcription and translation for personalized voice.


title: Design principles for fast and efficient self-assembly processes

abstract: Self-assembly is a fundamental concept in biology and of significant interest to nanotechnology. Significant progress has been made in characterizing and controlling the properties of the resulting structures, both experimentally and theoretically. However, much less is known about kinetic constraints and determinants of dynamical properties like time efficiency, although these constraints can become severe limiting factors of self-assembly processes. Here we investigate how the time efficiency and other dynamical properties of reversible self-assembly depend on the morphology (shape) of the building blocks for systems in which the binding energy between the constituents is large. As paradigmatic examples, we stochastically simulate the self-assembly of constituents with triangular, square, and hexagonal morphology into two-dimensional structures of a specified size. We find that the constituents' morphology critically determines the assembly time and how it scales with the size of the target structure. Our analysis reveals three key structural parameters defined by the morphology: The nucleation size and attachment order, which describe the effective order of the chemical reactions by which clusters nucleate and grow, respectively, and the growth exponent, which determines how the growth rate of an emerging structure scales with its size. Using this characterization, we formulate an effective theory of the self-assembly kinetics, which we show exhibits an inherent scale invariance. This allows us to identify general scaling laws that describe the minimal assembly time as a function of the size of the target structure. We show how these insights on the kinetics of self-assembly processes can be used to design assembly schemes that could significantly increase the time efficiency and robustness of artificial self-assembly processes.


title: Five-dimensional collective Hamiltonian with improved inertial functions

abstract: Background: To describe shape fluctuations associated with large-amplitude collective motion in the quadrupole degrees of freedom, the five-dimensional collective Hamiltonian (5DCH) has been widely used. The inertial functions in the 5DCH are microscopically calculated with the energy density functional (EDF) theory employing the cranking formula. However, since the cranking formula ignores dynamical residual effects, it is known to fail to reproduce the correct inertial functions, for instance, the total mass for the translational motion. Purpose: We aim to resolve problems of the insufficient description of the inertial functions in the 5DCH. We provide a practical method to include the dynamical residual effects in the inertial functions that depend on the quadrupole deformation parameters $\beta$ and $\gamma$. Methods: We use the local quasiparticle random-phase approximation (LQRPA) based on the constrained Hartree-Fock-Bogoliubov states in the $\beta$--$\gamma$ plane with the Skyrme EDF. The finite-amplitude method is used for efficient computations of the LQRPA. Results: The inertial functions evaluated with the LQRPA significantly increase from the ones with the cranking formula due to the dynamical residual effects. This increase also shows a strong $\beta$--$\gamma$ dependence. We show an application of the present method to a transitional nucleus $^{110}$Pd. The low-lying positive-parity spectra are well reproduced with the LQRPA inertial functions. Conclusions: We clarify the importance of the dynamical residual effects in the inertial functions of the 5DCH for the description of the low-lying spectra. The 5DCH with the improved inertial functions provides a reliable and efficient description of low-lying spectra in nuclei associated with the quadrupole shape fluctuation.


title: Convective Mixing: The Formation Channel of Li-rich Giants

abstract: Increasing observed data indicate that part of giants has abnormally high lithium (Li) inside their surface, and their proportion is around 1%. Instead of pursuing the feasible mechanisms for extra Li enrichment, we focus on how to inhibit Li depletion from the main sequence (MS) phase of giants. With this in mind, we find that convective mixing is capable of achieving this goal and forming Li-rich giants, which is mainly attributed to the convection model with the convective boundary defined by the Ledoux criterion. Another factor in the formation of Li-rich giants in our convection models is related to the Li abundances of their progenitors. If the Li abundances of the progenitors exceed the meteoritic value (3.3 dex), then the majority of giants will be rich in Li. This is the general pattern of stellar Li abundance evolution without factoring in extra Li depletion. We propose that other Li depletion processes should also be adopted in the future, as they may be the key to the 1% puzzle.


title: A Mathematical Model for Two Solutes Transport in a Poroelastic Material and Its Applications

abstract: Using well-known mathematical foundations of the elasticity theory, a mathematical model for two solutes transport in a poroelastic material (soft tissue is a typical example) is suggested. It is assumed that molecules of essentially different sizes dissolved in fluid and are transported through pores of different sizes. The stress tensor, the main force leading to the material deformation, is taken not only in the standard linear form but also with an additional nonlinear part. The model is constructed in 1D space and consists of six nonlinear equations. It is shown that the governing equations are integrable in stationary case, therefore all steady-state solutions are constructed. The obtained solutions are used in an example for healthy and tumour tissue, in particular, tissue displacements are calculated and compared for parameters taken from experimental data in cases of the linear and nonlinear stress tensors. Since the governing equations are non-integrable in non-stationary case, the Lie symmetry analysis is used in order to construct time-dependent exact solutions. Depending on parameters arising in the governing equations, several special cases with non-trivial Lie symmetries are identified. As a result, multi-parameter families of exact solutions are constructed including those in terms of special functions(hypergeometric and Bessel functions). A possible application of the solutions obtained is demonstrated.


title: Homomorphism Preservation Theorems for Many-Valued Structures

abstract: A canonical result in model theory is the homomorphism preservation theorem which states that a first-order formula is preserved under homomorphisms on all structures if and only if it is equivalent to an existential-positive formula, standardly proved compactness. Rossman (2008) established that the h.p.t. remains valid when restricted to finite structures. This is a significant result in the field of finite model theory, standing in contrast to other preservation theorems and as an theorem which remains true in the finite but whose proof uses entirely different methods. It also has importance to the field of constraint satisfaction due to the equivalence of existential-positive formulas and unions of conjunctive queries. Adjacently, Dellunde and Vidal (2019) established that a version of the h.p.t. holds for a collection of first-order many-valued logics, those whose (possibly infinite) structures are defined over a fixed finite MTL-chain. In this paper we unite these two strands, showing how one can extend Rossman's proof of a finite h.p.t. to a very wide collection of many-valued predicate logics and simultaneously establishing a finite variant to Dellunde and Vidal's result, one which not only applies to structures defined over algebras more general than MTL-chains but also where we allow for those algebra to vary between models. This investigation provides a starting point in a wider development of finite model theory for many-valued logics and, just as the classical finite h.p.t. has implications for constraint satisfaction, the many-valued finite h.p.t. has implications for valued constraint satisfaction problems.


title: Worldline approach for spinor fields in manifolds with boundaries

abstract: The worldline formalism is a useful scheme in Quantum Field Theory which has also become a powerful tool for numerical computations. It is based on the first quantisation of a point-particle whose transition amplitudes correspond to the heat-kernel of the operator of quantum fluctuations of the field theory. However, to study a quantum field theory in a bounded manifold one needs to restrict the path integration domain of the point-particle to a specific subset of worldlines enclosed by those boundaries. In the present article it is shown how to implement this restriction for the case of a spinor field in a two-dimensional curved half-plane under MIT bag boundary conditions, and compute the first few heat-kernel coefficients as a verification of the proposed construction. This construction admits several generalisations.


title: Multi-modal Attribute Prompting for Vision-Language Models

abstract: Large pre-trained Vision-Language Models (VLMs), like CLIP, exhibit strong generalization ability to downstream tasks but struggle in few-shot scenarios. Existing prompting techniques primarily focus on global text and image representations, yet overlooking multi-modal attribute characteristics. This limitation hinders the model's ability to perceive fine-grained visual details and restricts its generalization ability to a broader range of unseen classes. To address this issue, we propose a Multi-modal Attribute Prompting method (MAP) by jointly exploring textual attribute prompting, visual attribute prompting, and attribute-level alignment. The proposed MAP enjoys several merits. First, we introduce learnable visual attribute prompts enhanced by textual attribute semantics to adaptively capture visual attributes for images from unknown categories, boosting fine-grained visual perception capabilities for CLIP. Second, the proposed attribute-level alignment complements the global alignment to enhance the robustness of cross-modal alignment for open-vocabulary objects. To our knowledge, this is the first work to establish cross-modal attribute-level alignment for CLIP-based few-shot adaptation. Extensive experimental results on 11 datasets demonstrate that our method performs favorably against state-of-the-art approaches.


title: Deep-learning-based Magnetic Resonance Simultaneous Multislice Imaging Using Holographic Image Decoding

abstract: Simultaneous multislice (SMS) imaging is a one of the acceleration technique of magnetic resonance imaging. SMS requires accurate sensitivity distributions in the slice plane for each receiving coil. This requirement is difficult to satisfy in practice, limiting the applications of this imaging technique. Here, images are reconstructed by applying deep learning and amplitude modulation to each slice image. Simulation experiments show that image reconstruction can be achieved for both real- and complex-valued images. Image quality tends to decrease with increasing number of simultaneously acquired images. It is also shown that a larger difference in the phase modulation coefficients between slices tends to increase the quality of the reconstructed images. Simulation experiments and initial MR imaging experiments show promising results for this method.


title: Mode Consensus Algorithms With Finite Convergence Time

abstract: This paper studies the distributed mode consensus problem in a multi-agent system, in which the agents each possess a certain attribute and they aim to agree upon the mode (the most frequent attribute owned by the agents) via distributed computation. Three algorithms are proposed. The first one directly calculates the frequency of all attributes at every agent, with protocols based on blended dynamics, and then returns the most frequent attribute as the mode. Assuming knowledge at each agent of a lower bound of the mode frequency as a priori information, the second algorithm is able to reduce the number of frequencies to be computed at every agent if the lower bound is large. The third algorithm further eliminates the need for this information by introducing an adaptive updating mechanism. The algorithms find the mode in finite time, and estimates of convergence time are provided. The proposed first and second algorithms enjoy the plug-and-play property with a dwell time.


title: Efficient Reinforcement Learning for Global Decision Making in the Presence of Local Agents at Scale

abstract: We study reinforcement learning for global decision-making in the presence of many local agents, where the global decision-maker makes decisions affecting all local agents, and the objective is to learn a policy that maximizes the rewards of both the global and the local agents. Such problems find many applications, e.g. demand response, EV charging, queueing, etc. In this setting, scalability has been a long-standing challenge due to the size of the state/action space which can be exponential in the number of agents. This work proposes the $\texttt{SUB-SAMPLE-Q}$ algorithm where the global agent subsamples $k\leq n$ local agents to compute an optimal policy in time that is only exponential in $k$, providing an exponential speedup from standard methods that are exponential in $n$. We show that the learned policy converges to the optimal policy in the order of $\tilde{O}(1/\sqrt{k}+\epsilon_{k,m})$ as the number of sub-sampled agents $k$ increases, where $\epsilon_{k,m}$ is the Bellman noise, by proving a novel generalization of the Dvoretzky-Kiefer-Wolfowitz inequality to the regime of sampling without replacement. We also conduct numerical simulations in a demand-response setting and a queueing setting.


title: Wave and turbulence separation using dynamic mode decomposition

abstract: Separating the effects of waves and turbulence in oceanographic time series is an ongoing challenge because surface wave motion and turbulence fluctuations can occur at overlapping frequencies. As a result, simple bandpass filters cannot effectively separate their dynamics. While more advanced decomposition techniques have been developed, they often entail restrictive assumptions about the wave and turbulence interactions, require synchronized measurements, and/or only decompose the signal spectrally without a time-series reconstruction. To overcome these restrictions, we aim to apply modern data-driven methods to this classical problem by using dynamic mode decomposition (DMD). In this study, we present our new wave-turbulence decomposition technique which uses DMD. The technique is designed to be signal-agnostic such that it can be applied to any generic time series. Our approach requires minimal tuning, where the main user input is the wave frequency range of interest. To demonstrate the method, we apply it to synthetic, field, and laboratory data, and compare the results to other published methods in the literature. We conduct a sensitivity analysis on the synthetic data and find that the most sensitive parameter to the accuracy is the rank truncation in the DMD. Additionally, because of the accuracy of our decomposition technique, we demonstrate how we are able to analyze the velocity autocorrelation of the separated turbulence time series with minimal contamination by the waves. Overall, we find that our decomposition method outperforms the other time-series decomposition methods and provides for robust separation of the waves and turbulence, demonstrating that it is a promising technique with wide application to ocean signal processing.


title: Tobit models for count time series

abstract: Several models for count time series have been developed during the last decades, often inspired by traditional autoregressive moving average (ARMA) models for real-valued time series, including integer-valued ARMA (INARMA) and integer-valued generalized autoregressive conditional heteroscedasticity (INGARCH) models. Both INARMA and INGARCH models exhibit an ARMA-like autocorrelation function (ACF). To achieve negative ACF values within the class of INGARCH models, log and softplus link functions are suggested in the literature, where the softplus approach leads to conditional linearity in good approximation. However, the softplus approach is limited to the INGARCH family for unbounded counts, i.e. it can neither be used for bounded counts, nor for count processes from the INARMA family. In this paper, we present an alternative solution, named the Tobit approach, for achieving approximate linearity together with negative ACF values, which is more generally applicable than the softplus approach. A Skellam--Tobit INGARCH model for unbounded counts is studied in detail, including stationarity, approximate computation of moments, maximum likelihood and censored least absolute deviations estimation for unknown parameters and corresponding simulations. Extensions of the Tobit approach to other situations are also discussed, including underlying discrete distributions, INAR models, and bounded counts. Three real-data examples are considered to illustrate the usefulness of the new approach.


title: Robust Policy Learning via Offline Skill Diffusion

abstract: Skill-based reinforcement learning (RL) approaches have shown considerable promise, especially in solving long-horizon tasks via hierarchical structures. These skills, learned task-agnostically from offline datasets, can accelerate the policy learning process for new tasks. Yet, the application of these skills in different domains remains restricted due to their inherent dependency on the datasets, which poses a challenge when attempting to learn a skill-based policy via RL for a target domain different from the datasets' domains. In this paper, we present a novel offline skill learning framework DuSkill which employs a guided Diffusion model to generate versatile skills extended from the limited skills in datasets, thereby enhancing the robustness of policy learning for tasks in different domains. Specifically, we devise a guided diffusion-based skill decoder in conjunction with the hierarchical encoding to disentangle the skill embedding space into two distinct representations, one for encapsulating domain-invariant behaviors and the other for delineating the factors that induce domain variations in the behaviors. Our DuSkill framework enhances the diversity of skills learned offline, thus enabling to accelerate the learning procedure of high-level policies for different domains. Through experiments, we show that DuSkill outperforms other skill-based imitation learning and RL algorithms for several long-horizon tasks, demonstrating its benefits in few-shot imitation and online RL.


title: A Semantic Distance Metric Learning approach for Lexical Semantic Change Detection

abstract: Detecting temporal semantic changes of words is an important task for various NLP applications that must make time-sensitive predictions. Lexical Semantic Change Detection (SCD) task involves predicting whether a given target word, $w$, changes its meaning between two different text corpora, $C_1$ and $C_2$. For this purpose, we propose a supervised two-staged SCD method that uses existing Word-in-Context (WiC) datasets. In the first stage, for a target word $w$, we learn two sense-aware encoders that represent the meaning of $w$ in a given sentence selected from a corpus. Next, in the second stage, we learn a sense-aware distance metric that compares the semantic representations of a target word across all of its occurrences in $C_1$ and $C_2$. Experimental results on multiple benchmark datasets for SCD show that our proposed method achieves strong performance in multiple languages. Additionally, our method achieves significant improvements on WiC benchmarks compared to a sense-aware encoder with conventional distance functions. Source code is available at https://github.com/LivNLP/svp-sdml .


title: Closed-loop Equilibria for Mean-Field Games in Randomly Switching Environments with General Discounting Costs

abstract: This work is devoted to finding the closed-loop equilibria for a class of mean-field games (MFGs) with infinitely many symmetric players in a common switching environment when the cost functional is under general discount in time. There are two key challenges in the application of the well-known Hamilton-Jacobi-Bellman and Fokker-Planck (HJB-FP) approach to our problems: the path-dependence due to the conditional mean-field interaction and the time-inconsistency due to the general discounting cost. To overcome the difficulties, a theory for a class of systems of path-dependent equilibrium Hamilton-Jacobi-Bellman equations (HJBs) is developed. Then closed-loop equilibrium strategies can be identified through a two-step verification procedure. It should be noted that the closed-loop equilibrium strategies obtained satisfy a new form of local optimality in the Nash sense. The theory obtained extends the HJB-FP approach for classical MFGs to more general conditional MFGs with general discounting costs.


title: DISORF: A Distributed Online NeRF Training and Rendering Framework for Mobile Robots

abstract: We present a framework, DISORF, to enable online 3D reconstruction and visualization of scenes captured by resource-constrained mobile robots and edge devices. To address the limited compute capabilities of edge devices and potentially limited network availability, we design a framework that efficiently distributes computation between the edge device and remote server. We leverage on-device SLAM systems to generate posed keyframes and transmit them to remote servers that can perform high quality 3D reconstruction and visualization at runtime by leveraging NeRF models. We identify a key challenge with online NeRF training where naive image sampling strategies can lead to significant degradation in rendering quality. We propose a novel shifted exponential frame sampling method that addresses this challenge for online NeRF training. We demonstrate the effectiveness of our framework in enabling high-quality real-time reconstruction and visualization of unknown scenes as they are captured and streamed from cameras in mobile robots and edge devices.


title: Diffraction and Scattering Aware Radio Map and Environment Reconstruction using Geometry Model-Assisted Deep Learning

abstract: Machine learning (ML) facilitates rapid channel modeling for 5G and beyond wireless communication systems. Many existing ML techniques utilize a city map to construct the radio map; however, an updated city map may not always be available. This paper proposes to employ the received signal strength (RSS) data to jointly construct the radio map and the virtual environment by exploiting the geometry structure of the environment. In contrast to many existing ML approaches that lack of an environment model, we develop a virtual obstacle model and characterize the geometry relation between the propagation paths and the virtual obstacles. A multi-screen knife-edge model is adopted to extract the key diffraction features, and these features are fed into a neural network (NN) for diffraction representation. To describe the scattering, as oppose to most existing methods that directly input an entire city map, our model focuses on the geometry structure from the local area surrounding the TX-RX pair and the spatial invariance of such local geometry structure is exploited. Numerical experiments demonstrate that, in addition to reconstructing a 3D virtual environment, the proposed model outperforms the state-of-the-art methods in radio map construction with 10%-18% accuracy improvements. It can also reduce 20% data and 50% training epochs when transferred to a new environment.


title: On Cyclical MCMC Sampling

abstract: Cyclical MCMC is a novel MCMC framework recently proposed by Zhang et al. (2019) to address the challenge posed by high-dimensional multimodal posterior distributions like those arising in deep learning. The algorithm works by generating a nonhomogeneous Markov chain that tracks -- cyclically in time -- tempered versions of the target distribution. We show in this work that cyclical MCMC converges to the desired probability distribution in settings where the Markov kernels used are fast mixing, and sufficiently long cycles are employed. However in the far more common settings of slow mixing kernels, the algorithm may fail to produce samples from the desired distribution. In particular, in a simple mixture example with unequal variance, we show by simulation that cyclical MCMC fails to converge to the desired limit. Finally, we show that cyclical MCMC typically estimates well the local shape of the target distribution around each mode, even when we do not have convergence to the target.


title: Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Models

abstract: Large vision-language models (LVLMs) excel across diverse tasks involving concrete images from natural scenes. However, their ability to interpret abstract figures, such as geometry shapes and scientific plots, remains limited due to a scarcity of training datasets in scientific domains. To fill this gap, we introduce Multimodal ArXiv, consisting of ArXivCap and ArXivQA, for enhancing LVLMs scientific comprehension. ArXivCap is a figure-caption dataset comprising 6.4M images and 3.9M captions, sourced from 572K ArXiv papers spanning various scientific domains. Drawing from ArXivCap, we introduce ArXivQA, a question-answering dataset generated by prompting GPT-4V based on scientific figures. ArXivQA greatly enhances open-sourced LVLMs' mathematical reasoning capabilities, achieving a 10.4\% absolute accuracy gain on a multimodal mathematical reasoning benchmark. Furthermore, employing ArXivCap, we devise four vision-to-text tasks for benchmarking LVLMs. Evaluation results with state-of-the-art LVLMs underscore their struggle with the nuanced semantics of academic figures, while domain-specific training yields substantial performance gains. Our error analysis uncovers misinterpretations of visual context, recognition errors, and the production of overly simplified captions by current LVLMs, shedding light on future improvements.


title: FTTN: Feature-Targeted Testing for Numerical Properties of NVIDIA & AMD Matrix Accelerators

abstract: NVIDIA Tensor Cores and AMD Matrix Cores (together called Matrix Accelerators) are of growing interest in high-performance computing and machine learning owing to their high performance. Unfortunately, their numerical behaviors are not publicly documented, including the number of extra precision bits maintained, the accumulation order of addition, and predictable subnormal number handling during computations. This makes it impossible to reliably port codes across these differing accelerators. This paper contributes a collection of {\em Feature Targeted Tests for Numerical Properties} that that help determine these features across five floating-point formats, four rounding modes and additional that highlight the rounding behaviors and preservation of extra precision bits. To show the practical relevance of FTTN, we design a simple matrix-multiplication test designed with insights gathered from our feature-tests. We executed this very simple test on five platforms, producing different answers: V100, A100, and MI250X produced 0, MI100 produced 255.875, and Hopper H100 produced 191.875. Our matrix multiplication tests employ patterns found in iterative refinement-based algorithms, highlighting the need to check for significant result variability when porting code across GPUs.


title: Causal Bandits with General Causal Models and Interventions

abstract: This paper considers causal bandits (CBs) for the sequential design of interventions in a causal system. The objective is to optimize a reward function via minimizing a measure of cumulative regret with respect to the best sequence of interventions in hindsight. The paper advances the results on CBs in three directions. First, the structural causal models (SCMs) are assumed to be unknown and drawn arbitrarily from a general class $\mathcal{F}$ of Lipschitz-continuous functions. Existing results are often focused on (generalized) linear SCMs. Second, the interventions are assumed to be generalized soft with any desired level of granularity, resulting in an infinite number of possible interventions. The existing literature, in contrast, generally adopts atomic and hard interventions. Third, we provide general upper and lower bounds on regret. The upper bounds subsume (and improve) known bounds for special cases. The lower bounds are generally hitherto unknown. These bounds are characterized as functions of the (i) graph parameters, (ii) eluder dimension of the space of SCMs, denoted by $\operatorname{dim}(\mathcal{F})$, and (iii) the covering number of the function space, denoted by ${\rm cn}(\mathcal{F})$. Specifically, the cumulative achievable regret over horizon $T$ is $\mathcal{O}(K d^{L-1}\sqrt{T\operatorname{dim}(\mathcal{F}) \log({\rm cn}(\mathcal{F}))})$, where $K$ is related to the Lipschitz constants, $d$ is the graph's maximum in-degree, and $L$ is the length of the longest causal path. The upper bound is further refined for special classes of SCMs (neural network, polynomial, and linear), and their corresponding lower bounds are provided.


title: General Construction of Bra-Ket Formalism for Identical Particle Systems in Rigged Hilbert Space Approach

abstract: This study discussed Dirac's bra-ket formalism for the identical particles system to extend the rigged Hilbert space reformulated by R. Madrid [J. Phys. A:Math. Gen. 37, 8129 (2004)]. The bra and ket vectors for a composite system that form the basis of an identical particle system were reconstructed using the tensor product of rigged Hilbert space.They were found to be characterized in the dual spaces of the tensor product of nuclear spaces. The proofs utilized in this paper adopt a format similar to that used in physics, yet they will be mathematically rigorous. This formulation lays the foundation for modern quantum theories based on perturbation theory, such as quantum statistical mechanics and quantum field theory.


title: Geometry-free renormalization of directed networks: scale-invariance and reciprocity

abstract: Recent research has tried to extend the concept of renormalization, which is naturally defined for geometric objects, to more general networks with arbitrary topology. The current attempts do not naturally apply to directed networks, for instance because they are based on the identification of (necessarily symmetric) inter-node distances arising from geometric embeddings or on the definition of Hermitian Laplacian operators requiring symmetric adjacency matrices in spectral approaches. Here we show that the Scale-Invariant Model, recently proposed as an approach to consistently model undirected networks at arbitrary (and possibly multi-scale) resolution levels, can be extended coherently to directed networks without the requirement of an embedding geometry or Laplacian structure. Moreover, it can account for nontrivial reciprocity, i.e. the empirically well-documented tendency of links to occur in mutual pairs more or less often than predicted by chance. After deriving the renormalization rules for networks with arbitrary reciprocity, we consider various examples. In particular we propose the first multiscale model of the international trade network with nontrivial reciprocity and an annealed model where positive reciprocity emerges spontaneously from coarse-graining. In the latter case, the renormalization process defines a group, not only a semigroup, and therefore allows to fine-grain networks to arbitrarily small scales. These results strengthen the notion that network renormalization can be defined in a much more general way than required by geometric or spectral approaches, because it needs only node-specific (metric-free) features and can coexist with the asymmetry of directed networks.


title: Benchmarking zero-shot stance detection with FlanT5-XXL: Insights from training data, prompting, and decoding strategies into its near-SoTA performance

abstract: We investigate the performance of LLM-based zero-shot stance detection on tweets. Using FlanT5-XXL, an instruction-tuned open-source LLM, with the SemEval 2016 Tasks 6A, 6B, and P-Stance datasets, we study the performance and its variations under different prompts and decoding strategies, as well as the potential biases of the model. We show that the zero-shot approach can match or outperform state-of-the-art benchmarks, including fine-tuned models. We provide various insights into its performance including the sensitivity to instructions and prompts, the decoding strategies, the perplexity of the prompts, and to negations and oppositions present in prompts. Finally, we ensure that the LLM has not been trained on test datasets, and identify a positivity bias which may partially explain the performance differences across decoding strategie


title: Stable Reduced-Rank VAR Identification

abstract: The vector autoregression (VAR) has been widely used in system identification, econometrics, natural science, and many other areas. However, when the state dimension becomes large the parameter dimension explodes. So rank reduced modelling is attractive and is well developed. But a fundamental requirement in almost all applications is stability of the fitted model. And this has not been addressed in the rank reduced case. Here, we develop, for the first time, a closed-form formula for an estimator of a rank reduced transition matrix which is guaranteed to be stable. We show that our estimator is consistent and asymptotically statistically efficient and illustrate it in comparative simulations.


title: Angular bispectrum and trispectrum of scalar-induced gravitational waves: all contributions from primordial non-Gaussianity $f_\mathrm{NL}$ and $g_\mathrm{NL}$

abstract: Studying the primordial non-Gaussianity of inflationary perturbations is crucial for testing the inflation paradigm of the early universe. In this work, we conduct a comprehensive analysis of the angular bispectrum and trispectrum of scalar-induced gravitational waves (SIGWs) in the presence of local-type primordial non-Gaussianity parameterized by $f_\mathrm{NL}$ and $g_\mathrm{NL}$, deriving their semi-analytical formulae for the first time. Our findings indicate that it is the presence of primordial non-Gaussianity that leads to a non-Gaussian SIGW background, suggesting that the angular bispectrum and trispectrum of SIGWs could serve as probes of the primordial non-Gaussianity. Our numerical results further illustrate that $f_\mathrm{NL}$ and $g_\mathrm{NL}$ exert significant impacts on the spectral amplitudes, potentially reaching up to $10^{-5}$ for the former and $10^{-8}$ for the latter. In particular, we demonstrate that the angular bispectrum and trispectrum exhibit characteristic dependence on the angular multipoles and frequency bands. They hold potentials to be measured by gravitational-wave detectors that may advance our understanding of the origin of the universe.


title: OPAF: Optimized Secure Two-Party Computation Protocols for Nonlinear Activation Functions in Recurrent Neural Network

abstract: Deep neural network (DNN) typically involves convolutions, pooling, and activation function. Due to the growing concern about privacy, privacy-preserving DNN becomes a hot research topic. Generally, the convolution and pooling operations can be supported by additive homomorphic and secure comparison, but the secure implementation of activation functions is not so straightforward for the requirements of accuracy and efficiency, especially for the non-linear ones such as exponential, sigmoid, and tanh functions. This paper pays a special attention to the implementation of such non-linear functions in semi-honest model with two-party settings, for which SIRNN is the current state-of-the-art. Different from previous works, we proposed improved implementations for these functions by using their intrinsic features as well as worthy tiny tricks. At first, we propose a novel and efficient protocol for exponential function by using a divide-and-conquer strategy with most of the computations executed locally. Exponential protocol is widely used in machine learning tasks such as Poisson regression, and is also a key component of sigmoid and tanh functions. Next, we take advantage of the symmetry of sigmoid and Tanh, and fine-tune the inputs to reduce the 2PC building blocks, which helps to save overhead and improve performance. As a result, we implement these functions with fewer fundamental building blocks. The comprehensive evaluations show that our protocols achieve state-of-the-art precision while reducing run-time by approximately 57%, 44%, and 42% for exponential (with only negative inputs), sigmoid, and Tanh functions, respectively.


title: Nonexistence of generalized quadrangles admitting a point-primitive and line-primitive automorphism group with socle ${\rm PSU}(3,q)$, $q\geq 3$

abstract: A central problem in the study of generalized quadrangles is to classify finite generalized quadrangles satisfying certain symmetry conditions. It is known that an automorphism group of a finite thick generalized quadrangle $\mathcal{S}$ acting primitively on both the points and lines of $\mathcal{S}$ must be almost simple. In this paper, we initiate the study of finite generalized quadrangles admitting a point-primitive and line-primitive automorphism group with socle being a unitary group. We develop a group-theoretic tool to prove that the socle of such a group cannot be ${\rm PSU}(3,q)$ with $q\geq 3$.


title: CASIMIR: A Corpus of Scientific Articles enhanced with Multiple Author-Integrated Revisions

abstract: Writing a scientific article is a challenging task as it is a highly codified and specific genre, consequently proficiency in written communication is essential for effectively conveying research findings and ideas. In this article, we propose an original textual resource on the revision step of the writing process of scientific articles. This new dataset, called CASIMIR, contains the multiple revised versions of 15,646 scientific articles from OpenReview, along with their peer reviews. Pairs of consecutive versions of an article are aligned at sentence-level while keeping paragraph location information as metadata for supporting future revision studies at the discourse level. Each pair of revised sentences is enriched with automatically extracted edits and associated revision intention. To assess the initial quality on the dataset, we conducted a qualitative study of several state-of-the-art text revision approaches and compared various evaluation metrics. Our experiments led us to question the relevance of the current evaluation methods for the text revision task.


title: Energy deposition in air by moderately focused femtosecond laser filaments

abstract: Filamentation of high-power femtosecond laser pulses in air is accompanied by a fairly strong release of optical energy into the propagation medium due to laser-induced ionization of air molecules and production of an underdense plasma of charged species. We present the results of our laboratory experiments and numerical simulations aimed to the estimation of energy deposition amount by laser filament upon propagation in air depending on the conditions of spatial focusing, pulse energy, and radiation wavelength. For the first time to our knowledge, our study reveals a more than 50% decrease in the filament energy deposited in air in the range of moderate numerical aperture values, approximately from 0.003 to 0.007, at the carrier wavelengths of 740 nm and 470 nm. We attribute such a considerable reduction in the laser pulse energy release for femtosecond plasma to the competing effects of Kerr self-focusing and geometric divergence of focused laser pulse.


title: Closed geodesics on hyperbolic surfaces with few intersections

abstract: We prove that, if a closed geodesic $\Gamma$ on a complete finite type hyperbolic surface has at least 2 self-intersections, then the length of $\Gamma$ has an lower bound $2\log(5+2\sqrt6)$, and the lower bound is sharp, attained on a corkscrew geodesic on a thrice punctured sphere.


title: On Wasserstein Distributionally Robust Mean Semi-Absolute Deviation Portfolio Model: Robust Selection and Efficient Computation

abstract: This paper focuses on the Wasserstein distributionally robust mean-lower semi-absolute deviation (DR-MLSAD) model, where the ambiguity set is a Wasserstein ball centered on the empirical distribution of the training sample. This model can be equivalently transformed into a convex problem. We develop a robust Wasserstein profile inference (RWPI) approach to determine the size of the Wasserstein radius for DR-MLSAD model. We also design an efficient proximal point dual semismooth Newton (PpdSsn) algorithm for the reformulated equivalent model. In numerical experiments, we compare the DR-MLSAD model with the radius selected by the RWPI approach to the DR-MLSAD model with the radius selected by cross-validation, the sample average approximation (SAA) of the MLSAD model, and the 1/N strategy on the real market datasets. Numerical results show that our model has better out-of-sample performance in most cases. Furthermore, we compare PpdSsn algorithm with first-order algorithms and Gurobi solver on random data. Numerical results verify the effectiveness of PpdSsn in solving large-scale DR-MLSAD problems.


title: YOLO-MED : Multi-Task Interaction Network for Biomedical Images

abstract: Object detection and semantic segmentation are pivotal components in biomedical image analysis. Current single-task networks exhibit promising outcomes in both detection and segmentation tasks. Multi-task networks have gained prominence due to their capability to simultaneously tackle segmentation and detection tasks, while also accelerating the segmentation inference. Nevertheless, recent multi-task networks confront distinct limitations such as the difficulty in striking a balance between accuracy and inference speed. Additionally, they often overlook the integration of cross-scale features, which is especially important for biomedical image analysis. In this study, we propose an efficient end-to-end multi-task network capable of concurrently performing object detection and semantic segmentation called YOLO-Med. Our model employs a backbone and a neck for multi-scale feature extraction, complemented by the inclusion of two task-specific decoders. A cross-scale task-interaction module is employed in order to facilitate information fusion between various tasks. Our model exhibits promising results in balancing accuracy and speed when evaluated on the Kvasir-seg dataset and a private biomedical image dataset.


title: Analysis of Phylogeny Tracking Algorithms for Serial and Multiprocess Applications

abstract: Since the advent of modern bioinformatics, the challenging, multifaceted problem of reconstructing phylogenetic history from biological sequences has hatched perennial statistical and algorithmic innovation. Studies of the phylogenetic dynamics of digital, agent-based evolutionary models motivate a peculiar converse question: how to best engineer tracking to facilitate fast, accurate, and memory-efficient lineage reconstructions? Here, we formally describe procedures for phylogenetic analysis in both serial and distributed computing scenarios. With respect to the former, we demonstrate reference-counting-based pruning of extinct lineages. For the latter, we introduce a trie-based phylogenetic reconstruction approach for "hereditary stratigraphy" genome annotations. This process allows phylogenetic relationships between genomes to be inferred by comparing their similarities, akin to reconstruction of natural history from biological DNA sequences. Phylogenetic analysis capabilities significantly advance distributed agent-based simulations as a tool for evolutionary research, and also benefit application-oriented evolutionary computing. Such tracing could extend also to other digital artifacts that proliferate through replication, like digital media and computer viruses.


title: Unveiling two expanding stellar groups formed through violent relaxation in The Lagoon Nebula Cluster

abstract: The current kinematic state of young stellar clusters can give clues on their actual dynamical state and origin. In this contribution, we use Gaia DR3 data of the Lagoon Nebula Cluster (LNC) to show that the cluster is composed of two expanding groups, likely formed from different molecular cloud clumps. We find no evidence of massive stars having larger velocity dispersion than low-mass stars or being spatially segregated across the LNC, as a whole, or within the Primary group. However, the Secondary group, with 1/5th of the stars, exhibits intriguing features. On the one hand, it shows a bipolar nature, with an aspect ratio of $\sim$3:1. In addition, the massive stars in this group exhibit larger velocity dispersion than the low-mass stars, although they are not concentrated towards the center of the group. This suggests that this group may have undergone dynamical relaxation, first, and some explosive event afterward. However, further observations and numerical work have to be performed to confirm this hypothesis. The results of this work suggest that, although stellar clusters may form by the global and hierarchical collapse of their parent clump, still some dynamical relaxation may take place.


title: Families of Schmidt-number witnesses for high dimensional quantum states

abstract: Higher dimensional entangled states demonstrate significant advantages in quantum information processing tasks. Schmidt number is a quantity on the entanglement dimension of a bipartite state. Here we build families of k-positive maps from the symmetric information complete positive operator-valued measurements and mutually unbiased bases, and we also present the Schmidt number witnesses, correspondingly. At last, based on the witnesses obtained from mutually unbiased bases, we show the distance between a bipartite state and the set of states with Schmidt number less than k.


title: Semantics-enhanced Cross-modal Masked Image Modeling for Vision-Language Pre-training

abstract: In vision-language pre-training (VLP), masked image modeling (MIM) has recently been introduced for fine-grained cross-modal alignment. However, in most existing methods, the reconstruction targets for MIM lack high-level semantics, and text is not sufficiently involved in masked modeling. These two drawbacks limit the effect of MIM in facilitating cross-modal semantic alignment. In this work, we propose a semantics-enhanced cross-modal MIM framework (SemMIM) for vision-language representation learning. Specifically, to provide more semantically meaningful supervision for MIM, we propose a local semantics enhancing approach, which harvest high-level semantics from global image features via self-supervised agreement learning and transfer them to local patch encodings by sharing the encoding space. Moreover, to achieve deep involvement of text during the entire MIM process, we propose a text-guided masking strategy and devise an efficient way of injecting textual information in both masked modeling and reconstruction target acquisition. Experimental results validate that our method improves the effectiveness of the MIM task in facilitating cross-modal semantic alignment. Compared to previous VLP models with similar model size and data scale, our SemMIM model achieves state-of-the-art or competitive performance on multiple downstream vision-language tasks.