title: YYDS: Visible-Infrared Person Re-Identification with Coarse Descriptions

abstract: Visible-infrared person re-identification (VI-ReID) is challenging due to considerable cross-modality discrepancies. Existing works mainly focus on learning modality-invariant features while suppressing modality-specific ones. However, retrieving visible images only depends on infrared samples is an extreme problem because of the absence of color information. To this end, we present the Refer-VI-ReID settings, which aims to match target visible images from both infrared images and coarse language descriptions (e.g., "a man with red top and black pants") to complement the missing color information. To address this task, we design a Y-Y-shape decomposition structure, dubbed YYDS, to decompose and aggregate texture and color features of targets. Specifically, the text-IoU regularization strategy is firstly presented to facilitate the decomposition training, and a joint relation module is then proposed to infer the aggregation. Furthermore, the cross-modal version of k-reciprocal re-ranking algorithm is investigated, named CMKR, in which three neighbor search strategies and one local query expansion method are explored to alleviate the modality bias problem of the near neighbors. We conduct experiments on SYSU-MM01, RegDB and LLCM datasets with our manually annotated descriptions. Both YYDS and CMKR achieve remarkable improvements over SOTA methods on all three datasets. Codes are available at https://github.com/dyhBUPT/YYDS.


title: Exploring the Impact of Opinion Polarization on Short Video Consumption

abstract: Investigating the increasingly popular domain of short video consumption, this study focuses on the impact of Opinion Polarization (OP), a significant factor in the digital landscape influencing public opinions and social interactions. We analyze OP's effect on viewers' perceptions and behaviors, finding that traditional feedback metrics like likes and watch time fail to fully capture and measure OP. Addressing this gap, our research utilizes Electroencephalogram (EEG) signals to introduce a novel, non-invasive approach for evaluating neural responses to OP, affecting perception and cognition. Empirical analysis reveals OP's considerable impact on viewers' emotions, evidenced by changes in brain activity. Our findings also highlight the potential of EEG data in predicting exposure to polarized short video content, offering a new perspective on the dynamics of short video consumption and a unique method for quantifying OP's effects.


title: The stochastic relativistic advection diffusion equation from the Metropolis algorithm

abstract: We study an approach to simulating the stochastic relativistic advection-diffusion equation based on the Metropolis algorithm. We show that the dissipative dynamics of the boosted fluctuating fluid can be simulated by making random transfers of charge between fluid cells, interspersed with ideal hydrodynamic time steps. The random charge transfers are accepted or rejected in a Metropolis step using the entropy as a statistical weight. This procedure reproduces the expected strains of dissipative relativistic hydrodynamics in a specific (and non-covariant) hydrodynamic frame known as the density frame. Numerical results, both with and without noise, are presented and compared to relativistic kinetics and analytical expectations. An all order resummation of the density frame gradient expansion reproduces the covariant dynamics in a specific model. In contrast to all other numerical approaches to relativistic dissipative fluids, the dissipative fluid formalism presented here is strictly first order in gradients and has no non-hydrodynamic modes. The physical naturalness and simplicity of the Metropolis algorithm, together with its convergence properties, make it a promising tool for simulating stochastic relativistic fluids in heavy ion collisions and for critical phenomena in the relativistic domain.


title: On a family of relations of rooted tree maps

abstract: This paper is devoted to proving an infinite sequence of relations for rooted tree maps. On the way, we also give a basis for the space of rooted tree maps.


title: Preference optimization of protein language models as a multi-objective binder design paradigm

abstract: We present a multi-objective binder design paradigm based on instruction fine-tuning and direct preference optimization (DPO) of autoregressive protein language models (pLMs). Multiple design objectives are encoded in the language model through direct optimization on expert curated preference sequence datasets comprising preferred and dispreferred distributions. We show the proposed alignment strategy enables ProtGPT2 to effectively design binders conditioned on specified receptors and a drug developability criterion. Generated binder samples demonstrate median isoelectric point (pI) improvements by $17\%-60\%$.


title: OH$^-$ ions can reduce the iodide migration in MAPI

abstract: One of the main degradation mechanisms of methylammonium lead iodine (MAPI), which is an important material for perovskite based solar cells, is the migration of iodide ions. It is believed that this phenomenon is in fact dominated by the diffusion of iodide vacancies. In this paper, we suggest that the addition of a small amount of OH$^-$ ions can help suppress the migration of iodide and increase the overall stability of the material. Through the use of molecular dynamics simulations, we show that the OH$^-$ ions can bind to the positively charged iodide vacancies and can block the access of the negative iodide ions into those vacancies.


title: Silicon Photonic 2.5D Interposer Networks for Overcoming Communication Bottlenecks in Scale-out Machine Learning Hardware Accelerators

abstract: Modern machine learning (ML) applications are becoming increasingly complex and monolithic (single chip) accelerator architectures cannot keep up with their energy efficiency and throughput demands. Even though modern digital electronic accelerators are gradually adopting 2.5D architectures with multiple smaller chiplets to improve scalability, they face fundamental limitations due to a reliance on slow metallic interconnects. This paper outlines how optical communication and computation can be leveraged in 2.5D platforms to realize energy-efficient and high throughput 2.5D ML accelerator architectures.


title: Generative AI for Synthetic Data Generation: Methods, Challenges and the Future

abstract: The recent surge in research focused on generating synthetic data from large language models (LLMs), especially for scenarios with limited data availability, marks a notable shift in Generative Artificial Intelligence (AI). Their ability to perform comparably to real-world data positions this approach as a compelling solution to low-resource challenges. This paper delves into advanced technologies that leverage these gigantic LLMs for the generation of task-specific training data. We outline methodologies, evaluation techniques, and practical applications, discuss the current limitations, and suggest potential pathways for future research.


title: Probing the mixing between sterile and tau neutrinos in the SHiP experiment

abstract: We study the expected sensitivity to the mixing between sterile and tau neutrinos directly from the tau neutrino disappearance in the high-energy fixed target experiment. Here, the beam energy is large enough to produce tau neutrinos at the target with large luminosity. During their propagation to the detector, tau neutrinos may oscillate into sterile neutrinos. By examining the energy spectrum of the observed tau neutrino events, we can probe the mixing between sterile and tau neutrinos directly. In this paper, we consider Scattering and Neutrino Detector (SND) at SHiP experiment as a showcase, which uses 400 GeV protons from SPS at CERN, and expect to observe 7,300 tau and anti-tau neutrinos from the $2\times 10^{20}$ POT for 5 years operation. Assuming the uncertainty of 10\%, we find the sensitivity $|U_{\tau 4}|^2 \sim 0.08$\, (90\% CL) for $\Delta m_{41}^2 \sim 500\ \mathrm{eV}^2$ with 10\% background to the signal. We also consider a far SND at the end of the SHiP Hidden Sector Decay Spectrometer (HSDS), in which case the sensitivity would be enhanced to $|U_{\tau 4}|^2 \sim 0.02$. Away from this mass, the sensitivity becomes lower than $|U_{\tau 4}|^2 \sim 0.15$ for $\Delta m_{41}^2 \lesssim 100\ \mathrm{eV}^2$ or $\Delta m_{41}^2\gtrsim 10^4 \mathrm{eV}^2$.


title: Orbital Magneto-Nonlinear Anomalous Hall Effect in Kagome Magnet Fe$_3$Sn$_2$

abstract: It has been theoretically predicted that perturbation of the Berry curvature by electromagnetic fields gives rise to intrinsic nonlinear anomalous Hall effects that are independent of scattering. Two types of nonlinear anomalous Hall effects are expected. The electric nonlinear Hall effect has recently begun to receive attention, while very few studies are concerned with the magneto-nonlinear Hall effect. Here, we combine experiment and first-principles calculations to show that the kagome ferromagnet Fe$_3$Sn$_2$ displays such a magneto-nonlinear Hall effect. By systematic field angular and temperature-dependent transport measurements, we unambiguously identify a large anomalous Hall current that is linear in both applied in-plane electric and magnetic fields, utilizing a unique in-plane configuration. We clarify its dominant orbital origin and connect it to the magneto-nonlinear Hall effect. The effect is governed by the intrinsic quantum geometric properties of Bloch electrons. Our results demonstrate the significance of the quantum geometry of electron wave functions from the orbital degree of freedom and open up a new direction in Hall transport effects.


title: VAEMax: Open-Set Intrusion Detection based on OpenMax and Variational Autoencoder

abstract: Promptly discovering unknown network attacks is critical for reducing the risk of major loss imposed on system or equipment. This paper aims to develop an open-set intrusion detection model to classify known attacks as well as inferring unknown ones. To achieve this, we employ OpenMax and variational autoencoder to propose a dual detection model, VAEMax. First, we extract flow payload feature based on one-dimensional convolutional neural network. Then, the OpenMax is used to classify flows, during which some unknown attacks can be detected, while the rest are misclassified into a certain class of known flows. Finally, use VAE to perform secondary detection on each class of flows, and determine whether the flow is an unknown attack based on the reconstruction loss. Experiments performed on dataset CIC-IDS2017 and CSE-CIC-IDS2018 show our approach is better than baseline models and can be effectively applied to realistic network environments.


title: SAM-PD: How Far Can SAM Take Us in Tracking and Segmenting Anything in Videos by Prompt Denoising

abstract: Recently, promptable segmentation models, such as the Segment Anything Model (SAM), have demonstrated robust zero-shot generalization capabilities on static images. These promptable models exhibit denoising abilities for imprecise prompt inputs, such as imprecise bounding boxes. In this paper, we explore the potential of applying SAM to track and segment objects in videos where we recognize the tracking task as a prompt denoising task. Specifically, we iteratively propagate the bounding box of each object's mask in the preceding frame as the prompt for the next frame. Furthermore, to enhance SAM's denoising capability against position and size variations, we propose a multi-prompt strategy where we provide multiple jittered and scaled box prompts for each object and preserve the mask prediction with the highest semantic similarity to the template mask. We also introduce a point-based refinement stage to handle occlusions and reduce cumulative errors. Without involving tracking modules, our approach demonstrates comparable performance in video object/instance segmentation tasks on three datasets: DAVIS2017, YouTubeVOS2018, and UVO, serving as a concise baseline and endowing SAM-based downstream applications with tracking capabilities.


title: Fill-and-Spill: Deep Reinforcement Learning Policy Gradient Methods for Reservoir Operation Decision and Control

abstract: Changes in demand, various hydrological inputs, and environmental stressors are among the issues that water managers and policymakers face on a regular basis. These concerns have sparked interest in applying different techniques to determine reservoir operation policy decisions. As the resolution of the analysis increases, it becomes more difficult to effectively represent a real-world system using traditional methods such as Dynamic Programming (DP) and Stochastic Dynamic Programming (SDP) for determining the best reservoir operation policy. One of the challenges is the "curse of dimensionality," which means the number of samples needed to estimate an arbitrary function with a given level of accuracy grows exponentially with respect to the number of input variables (i.e., dimensionality) of the function. Deep Reinforcement Learning (DRL) is an intelligent approach to overcome the curses of stochastic optimization problems for reservoir operation policy decisions. To our knowledge, this study is the first attempt that examine various novel DRL continuous-action policy gradient methods (PGMs), including Deep Deterministic Policy Gradients (DDPG), Twin Delayed DDPG (TD3), and two different versions of Soft Actor-Critic (SAC18 and SAC19) for optimizing reservoir operation policy. In this study, multiple DRL techniques were implemented in order to find the optimal operation policy of Folsom Reservoir in California, USA. The reservoir system supplies agricultural, municipal, hydropower, and environmental flow demands and flood control operations to the City of Sacramento. Analysis suggests that the TD3 and SAC are robust to meet the Folsom Reservoir's demands and optimize reservoir operation policies.


title: Parent Berry curvature and the ideal anomalous Hall crystal

abstract: We study a model of electrons moving in a parent band of uniform Berry curvature. At sufficiently high parent Berry curvature, we show that strong repulsive interactions generically leads to the formation of an anomalous Hall crystal: a topological state with spontaneously broken continuous translation symmetry. Our results are established via a mapping to a problem of Wigner crystallization in a regular 2D electron gas. We further show that the resulting quasiparticle bands are "ideal" for realizing fractionalized topological states. Our theory provides a unified perspective for understanding several aspects of the recently observed integer and fractional quantum anomalous Hall effects in rhombohedral pentalayer graphene.


title: Large Language Models are In-Context Molecule Learners

abstract: Large Language Models (LLMs) have demonstrated exceptional performance in biochemical tasks, especially the molecule caption translation task, which aims to bridge the gap between molecules and natural language texts. However, previous methods in adapting LLMs to the molecule-caption translation task required extra domain-specific pre-training stages, suffered weak alignment between molecular and textual spaces, or imposed stringent demands on the scale of LLMs. To resolve the challenges, we propose In-Context Molecule Adaptation (ICMA), as a new paradigm allowing LLMs to learn the molecule-text alignment from context examples via In-Context Molecule Tuning. Specifically, ICMA incorporates the following three stages: Hybrid Context Retrieval, Post-retrieval Re-ranking, and In-context Molecule Tuning. Initially, Hybrid Context Retrieval utilizes BM25 Caption Retrieval and Molecule Graph Retrieval to retrieve informative context examples. Additionally, we also propose Post-retrieval Re-ranking with Sequence Reversal and Random Walk to further improve the quality of retrieval results. Finally, In-Context Molecule Tuning unlocks the in-context molecule learning capability of LLMs with retrieved examples and adapts the parameters of LLMs for the molecule-caption translation task. Experimental results demonstrate that ICMT can empower LLMs to achieve state-of-the-art or comparable performance without extra training corpora and intricate structures, showing that LLMs are inherently in-context molecule learners.


title: CN-RMA: Combined Network with Ray Marching Aggregation for 3D Indoors Object Detection from Multi-view Images

abstract: This paper introduces CN-RMA, a novel approach for 3D indoor object detection from multi-view images. We observe the key challenge as the ambiguity of image and 3D correspondence without explicit geometry to provide occlusion information. To address this issue, CN-RMA leverages the synergy of 3D reconstruction networks and 3D object detection networks, where the reconstruction network provides a rough Truncated Signed Distance Function (TSDF) and guides image features to vote to 3D space correctly in an end-to-end manner. Specifically, we associate weights to sampled points of each ray through ray marching, representing the contribution of a pixel in an image to corresponding 3D locations. Such weights are determined by the predicted signed distances so that image features vote only to regions near the reconstructed surface. Our method achieves state-of-the-art performance in 3D object detection from multi-view images, as measured by mAP@0.25 and mAP@0.5 on the ScanNet and ARKitScenes datasets. The code and models are released at https://github.com/SerCharles/CN-RMA.


title: B\"ottcher-Wenzel inequality for weighted Frobenius norms and its application to quantum physics

abstract: By employing a weighted Frobenius norm with a positive matrix $\omega$, we introduce natural generalizations of the famous B\"ottcher-Wenzel (BW) inequality. Based on the combination of the weighted Frobenius norm $\|A\|_\omega := \sqrt{{\rm tr}(A^\ast A \omega)}$ and the standard Frobenius norm $\|A\| := \sqrt{{\rm tr}(A^\ast A)}$, there are exactly five possible generalizations, labeled (i) through (v), for the bounds on the norms of the commutator $[A,B]:= AB - BA$. In this paper, we establish the tight bounds for cases (iii) and (v), and propose conjectures regarding the tight bounds for cases (i) and (ii). Additionally, the tight bound for case (iv) is derived as a corollary of case (i). All these bounds (i)-(v) serve as generalizations of the BW inequality. The conjectured bounds for cases (i) and (ii) (and thus also (iv)) are numerically supported for matrices up to size $n=15$. Proofs are provided for $n=2$ and certain special cases. Interestingly, we find applications of these bounds in quantum physics, particularly in the contexts of the uncertainty relation and open quantum dynamics.


title: ACC-ViT : Atrous Convolution's Comeback in Vision Transformers

abstract: Transformers have elevated to the state-of-the-art vision architectures through innovations in attention mechanism inspired from visual perception. At present two classes of attentions prevail in vision transformers, regional and sparse attention. The former bounds the pixel interactions within a region; the latter spreads them across sparse grids. The opposing natures of them have resulted in a dilemma between either preserving hierarchical relation or attaining a global context. In this work, taking inspiration from atrous convolution, we introduce Atrous Attention, a fusion of regional and sparse attention, which can adaptively consolidate both local and global information, while maintaining hierarchical relations. As a further tribute to atrous convolution, we redesign the ubiquitous inverted residual convolution blocks with atrous convolution. Finally, we propose a generalized, hybrid vision transformer backbone, named ACC-ViT, following conventional practices for standard vision tasks. Our tiny version model achieves $\sim 84 \%$ accuracy on ImageNet-1K, with less than $28.5$ million parameters, which is $0.42\%$ improvement over state-of-the-art MaxViT while having $8.4\%$ less parameters. In addition, we have investigated the efficacy of ACC-ViT backbone under different evaluation settings, such as finetuning, linear probing, and zero-shot learning on tasks involving medical image analysis, object detection, and language-image contrastive learning. ACC-ViT is therefore a strong vision backbone, which is also competitive in mobile-scale versions, ideal for niche applications with small datasets.


title: Bi-Static Sensing in OFDM Wireless Systems for Indoor Scenarios

abstract: The sixth generation (6G) systems will likely employ orthogonal frequency division multiplexing (OFDM) waveform for performing the joint task of sensing and communication. In this paper, we design an OFDM system for integrated sensing and communication (ISAC) and propose a novel approach for passive target detection in an indoor deployment using a data driven AI approach. The delay-Doppler profile (DDP) and power delay profile (PDP) is used to train the proposed AI-based detector. We analyze the detection performance of the proposed methods under line of sight (LOS) and non-line of sight (NLOS) conditions for various training strategies. We show that the proposed method provides 10 dB performance improvement over the baseline for 80% target detection under LOS conditions and the performance drops by 10-20 dB for NLOS depending on the usecase scenarios.


title: Dynamics of Moral Behavior in Heterogeneous Populations of Learning Agents

abstract: Growing concerns about safety and alignment of AI systems highlight the importance of embedding moral capabilities in artificial agents. A promising solution is the use of learning from experience, i.e., Reinforcement Learning. In multi-agent (social) environments, complex population-level phenomena may emerge from interactions between individual learning agents. Many of the existing studies rely on simulated social dilemma environments to study the interactions of independent learning agents. However, they tend to ignore the moral heterogeneity that is likely to be present in societies of agents in practice. For example, at different points in time a single learning agent may face opponents who are consequentialist (i.e., caring about maximizing some outcome over time) or norm-based (i.e., focusing on conforming to a specific norm here and now). The extent to which agents' co-development may be impacted by such moral heterogeneity in populations is not well understood. In this paper, we present a study of the learning dynamics of morally heterogeneous populations interacting in a social dilemma setting. Using a Prisoner's Dilemma environment with a partner selection mechanism, we investigate the extent to which the prevalence of diverse moral agents in populations affects individual agents' learning behaviors and emergent population-level outcomes. We observe several types of non-trivial interactions between pro-social and anti-social agents, and find that certain classes of moral agents are able to steer selfish agents towards more cooperative behavior.


title: Noise Reduction of Stochastic Density Functional Theory for Metals

abstract: Density Functional Theory (DFT) has become a cornerstone in the modeling of metals. However, accurately simulating metals, particularly under extreme conditions, presents two significant challenges. First, simulating complex metallic systems at low electron temperatures is difficult due to their highly delocalized density matrix. Second, modeling metallic warm-dense materials at very high electron temperatures is challenging because it requires the computation of a large number of partially occupied orbitals. This study demonstrates that both challenges can be effectively addressed using the latest advances in linear-scaling stochastic DFT methodologies. Despite the inherent introduction of noise into all computed properties by stochastic DFT, this research evaluates the efficacy of various noise reduction techniques under different thermal conditions. Our observations indicate that the effectiveness of noise reduction strategies varies significantly with the electron temperature. Furthermore, we provide evidence that the computational cost of stochastic DFT methods scales linearly with system size for metal systems, regardless of the electron temperature regime.


title: On the Essence and Prospect: An Investigation of Alignment Approaches for Big Models

abstract: Big models have achieved revolutionary breakthroughs in the field of AI, but they might also pose potential concerns. Addressing such concerns, alignment technologies were introduced to make these models conform to human preferences and values. Despite considerable advancements in the past year, various challenges lie in establishing the optimal alignment strategy, such as data cost and scalable oversight, and how to align remains an open question. In this survey paper, we comprehensively investigate value alignment approaches. We first unpack the historical context of alignment tracing back to the 1920s (where it comes from), then delve into the mathematical essence of alignment (what it is), shedding light on the inherent challenges. Following this foundation, we provide a detailed examination of existing alignment methods, which fall into three categories: Reinforcement Learning, Supervised Fine-Tuning, and In-context Learning, and demonstrate their intrinsic connections, strengths, and limitations, helping readers better understand this research area. In addition, two emerging topics, personal alignment, and multimodal alignment, are also discussed as novel frontiers in this field. Looking forward, we discuss potential alignment paradigms and how they could handle remaining challenges, prospecting where future alignment will go.


title: OGMP: Oracle Guided Multimodal Policies for Agile and Versatile Robot Control

abstract: The efficacy of model-free learning for robot control relies on the tailored integration of task-specific priors and heuristics, hence calling for a unified approach. In this paper, we define a general class for priors called oracles and propose bounding the permissible state around the oracle's ansatz, resulting in task-agnostic oracle-guided policy optimization. Additionally, to enhance modularity, we introduce the notion of task-vital modes. A policy mastering a compact set of modes and intermediate transitions can then solve perpetual tasks. The proposed approach is validated in challenging biped control tasks: parkour and diving on a 16-DoF dynamic bipedal robot, Hector. OGMP results in a single policy per task, solving indefinite parkour over diverse tracks and omnidirectional diving from varied heights, exhibiting versatile agility. Finally, we introduce a novel latent mode space reachability analysis to study our policy's mode generalization by computing a feasible mode set function through which we certify a set of failure-free modes for our policy to perform at any given state.


title: GRAWA: Gradient-based Weighted Averaging for Distributed Training of Deep Learning Models

abstract: We study distributed training of deep learning models in time-constrained environments. We propose a new algorithm that periodically pulls workers towards the center variable computed as a weighted average of workers, where the weights are inversely proportional to the gradient norms of the workers such that recovering the flat regions in the optimization landscape is prioritized. We develop two asynchronous variants of the proposed algorithm that we call Model-level and Layer-level Gradient-based Weighted Averaging (resp. MGRAWA and LGRAWA), which differ in terms of the weighting scheme that is either done with respect to the entire model or is applied layer-wise. On the theoretical front, we prove the convergence guarantee for the proposed approach in both convex and non-convex settings. We then experimentally demonstrate that our algorithms outperform the competitor methods by achieving faster convergence and recovering better quality and flatter local optima. We also carry out an ablation study to analyze the scalability of the proposed algorithms in more crowded distributed training environments. Finally, we report that our approach requires less frequent communication and fewer distributed updates compared to the state-of-the-art baselines.


title: HeteroSwitch: Characterizing and Taming System-Induced Data Heterogeneity in Federated Learning

abstract: Federated Learning (FL) is a practical approach to train deep learning models collaboratively across user-end devices, protecting user privacy by retaining raw data on-device. In FL, participating user-end devices are highly fragmented in terms of hardware and software configurations. Such fragmentation introduces a new type of data heterogeneity in FL, namely \textit{system-induced data heterogeneity}, as each device generates distinct data depending on its hardware and software configurations. In this paper, we first characterize the impact of system-induced data heterogeneity on FL model performance. We collect a dataset using heterogeneous devices with variations across vendors and performance tiers. By using this dataset, we demonstrate that \textit{system-induced data heterogeneity} negatively impacts accuracy, and deteriorates fairness and domain generalization problems in FL. To address these challenges, we propose HeteroSwitch, which adaptively adopts generalization techniques (i.e., ISP transformation and SWAD) depending on the level of bias caused by varying HW and SW configurations. In our evaluation with a realistic FL dataset (FLAIR), HeteroSwitch reduces the variance of averaged precision by 6.3\% across device types.


title: Controllable Skyrmion Islands in a Moir\'e Magnet

abstract: Antiferromagnetic(AFM) skyrmions have been in the spotlight as ideal topological magnetic bits. Although they are topologically protected, they do not exhibit the skyrmion Hall effect unlike the ferromagnetic ones. Thus, AFM skyrmions are considered to provide a better control of the skyrmion's motion due to the absence of the skyrmion Magnus effect. In this work, we propose a possible realization of controllable AFM skyrmions in a twisted Moir\'e magnet. The tunability of Moir\'e materials is not only a good platform for the provision of rich phases, but also for the stabilization of skyrmion phase. We investigate the ground state of twisted bilayer AFM system by solving the Landau-Lifshitz-Gilbert equation in a continuum model. We show that the AFM skyrmions are stabilized even in the absence of the external/dipolar magnetic field, as a consequence of the interplay of interlayer coupling, Dzyaloshinskii-Moriya (DM) interaction and Ising anisotropy. More interestingly, due to the magnetoelectric effect, the application of an external electric field locally stabilizes the skyrmions in the twisted bilayer AFM systems, even in the absence of DM interaction. It also allows the skyrmion helicity to change continuously when both the DM interaction and an electric field are present. We show the phase diagram with respect to the strength of interlayer coupling, the DM interaction and an electric field. Our results suggest the possibility of using AFM skyrmions as stable, controllable topological magnetic bits.


title: Phonon state tomography of electron correlation dynamics in optically excited solids

abstract: We introduce phonon state tomography (PST) as a diagnostic probe of electron dynamics in solids whose phonons are optically excited by a laser pulse at an initial time. Using a projected-purified matrix-product states (PP-MPS) algorithm, PST decomposes the exact correlated electron-phonon wavefunction into contributions from purely electronic states corresponding to statistically typical configurations of the optically accessible phononic response, enabling a 'tomographic' reconstruction of the electronic dynamics generated by the phonons. Thus, PST may be used to diagnose electronic behavior in experiments that access only the phonon response, such as thermal diffuse x-ray and electron scattering. To demonstrate the usefulness of PST, we study the dynamics of a metal whose infrared phonons are excited by an optical pulse at initial time and use it to simulate the sample-averaged momentum-resolved phonon occupancy as would be measured experimentally and accurately reconstruct the electronic double occupancy and staggered magnetization. We also use PST to analyze the influence of different pulse shapes on the light-induced enhancement and suppression of electronic correlations.


title: High-dimensional quantum key distribution using a multi-plane light converter

abstract: High-dimensional quantum key distribution (QKD) offers higher information capacity and stronger resilience to noise compared to its binary counterpart. However, these advantages are often hindered by the difficulty of realizing the required high-dimensional measurements and transformations. Here, we implement a large-scale multi-plane light converter (MPLC) and program it as a high-dimensional mode sorter of spatial modes for QKD. Using the MPLC, we demonstrate five-dimensional QKD with six mutually unbiased bases and 25-dimensional QKD with two mutually unbiased bases in the same experimental setup. Furthermore, we propose a construction of pairs of mutually unbiased bases that are robust to experimental errors, with measurement complexity scaling only with the square root of the encoded dimension. This approach paves the way for QKD implementations in higher dimensions.


title: Partial tidal disruption events: The elixir of life

abstract: In our Galactic Center, about 10,000 to 100,000 stars are estimated to have survived tidal disruption events, resulting in partially disrupted remnants. These events occur when a supermassive black hole (SMBH) tidally interacts with a star, but not enough to completely disrupt the star. We use the 1D stellar evolution code Kepler and the 3D smoothed particle hydrodynamics code Phantom to model the tidal disruption of 1, 3, and 10 solar mass stars at zero-age (ZAMS), middle-age (MAMS), and terminal-age main-sequence (TAMS). We map the disruption remnants into Kepler in order to understand their post-distribution evolution. We find distinct characteristics in the remnants, including increased radius, rapid core rotation, and differential rotation in the envelope. The remnants undergo composition mixing that affects their stellar evolution. Whereas the remnants formed by disruption of ZAMS models evolve similarly to unperturbed models of the same mass, for MAMS and TAMS stars, the remnants have higher luminosity and effective temperature. Potential observational signatures include peculiarities in nitrogen and carbon abundances, higher luminosity, rapid rotation, faster evolution, and unique tracks in the Hertzsprung-Russell diagram


title: Persona Extraction Through Semantic Similarity for Emotional Support Conversation Generation

abstract: Providing emotional support through dialogue systems is becoming increasingly important in today's world, as it can support both mental health and social interactions in many conversation scenarios. Previous works have shown that using persona is effective for generating empathetic and supportive responses. They have often relied on pre-provided persona rather than inferring them during conversations. However, it is not always possible to obtain a user persona before the conversation begins. To address this challenge, we propose PESS (Persona Extraction through Semantic Similarity), a novel framework that can automatically infer informative and consistent persona from dialogues. We devise completeness loss and consistency loss based on semantic similarity scores. The completeness loss encourages the model to generate missing persona information, and the consistency loss guides the model to distinguish between consistent and inconsistent persona. Our experimental results demonstrate that high-quality persona information inferred by PESS is effective in generating emotionally supportive responses.


title: Representations of non-finitely graded Lie algebras related to Virasoro algebra

abstract: In this paper, we study representations of non-finitely graded Lie algebras $\mathcal{W}(\epsilon)$ related to Virasoro algebra, where $\epsilon = \pm 1$. Precisely speaking, we completely classify the free $\mathcal{U}(\mathfrak h)$-modules of rank one over $\mathcal{W}(\epsilon)$,and find that these module structures are rather different from those of other graded Lie algebras. We also determine the simplicity and isomorphism classes of these modules.


title: Exponential decay property for eigenfunctions of quantum walks

abstract: Under an abstract setting, we show that eigenvectors belong to discrete spectra of unitary operators have exponential decay properties. We apply the main theorem to multi-dimensional quantum walks and show that eigenfunctions belong to a discrete spectrum decay exponentially at infinity.


title: Multifrequency Very Long Baseline Interferometry Imaging of the Subparsec-scale Jet in the Sombrero Galaxy (M104)

abstract: We report multi-frequency and multi-epoch VLBI studies of the sub-parsec jet in Sombrero galaxy (M 104, NGC 4594). Using Very Long Baseline Array data at 12, 22, 44, and 88 GHz, we study the kinematics of the jet and the properties of the compact core. The sub-parsec jet is clearly detected at 12 and 22 GHz, and the inner jet base is resolved down to $\sim70$ Schwarzschild radii ($R_{\rm s}$) at 44 GHz. The proper motions of the jet are measured with apparent sub-relativistic speeds of $0.20\pm0.08 c$ and $0.05\pm0.02 c$ for the approaching and the receding jet, respectively. Based on the apparent speed and jet-to-counter-jet brightness ratio, we estimate the jet viewing angle to be larger than $\sim37^{\circ}$, and the intrinsic speed to be between $\sim0.10 c$ and $0.40 c$. Their joint probability distribution suggests the most probable values of the viewing angle and intrinsic speed to be ${66^{\circ}}^{+4^\circ}_{-6^\circ}$ and $0.19\pm0.04 c$, respectively. We also find that the measured brightness temperatures of the core at 12, 22 and 44 GHz are close to the equipartition brightness temperature, indicating that the energy density of the radiating particles is comparable to the energy density of the magnetic field in the sub-parsec jet region. Interestingly, the measured core size at 88 GHz ($\sim25\pm5 R_{s}$) deviates from the expected frequency dependence seen at lower frequencies. This may indicate a different origin for the millimeter emission, which can explained by an Advection Dominated Accretion Flow (ADAF) model. This model further predicts that at 230 and 340 GHz, the ADAF may dominate the radio emission over the jet.


title: Scalable and Versatile Linear Computation with Minimalistic Photonic Matrix Processor

abstract: The advancement of artificial intelligence demands flexible multimodal data processing with high throughput and energy efficiency. Photonic integrated circuits (PIC) has demonstrated promising potentials in terms of low latency and low power consumption per operation for linear operations such as matrix-vector multiplication. However, the existing schemes face challenges in their scalability due to the use of photonic circuits that expand with the scale of the operants, despite efforts of exploiting the multiple optical parameter dimensions such as time, wavelength and spatial parallelism. They also lacked flexibility and efficiency in switching between different types of operations or tasks and adapting to multimodal data. In this article, we introduce an optical matrix processor (MP) with a minimalistic recursive structure for both multiplications and accumulations. The MP consists of an eletro-optic ring-modulator implemented as a thin-film lithium niobate PIC that allows flexible configurability and time-division multiplexed scheduling. The MP supports not only versatile linear operations including vector/matrix-vector multiplication and single/multi-kernel convolution but also ultrafast task switching and adaptability to data of different sizes, by simply adjusting the data baud rate relative to the ring delay without structural modifications. We demonstrate its capabilities in a optic-electronic convolutional neural network with a computing throughput up to 73.4 billion operations per second. The MP further supports high scalability through appropriate allocation of wavelength and space resources,extending computing parallelism to handle higher data volumes with higher energy efficiency. This novel scheme paves the way for a new class of photonic processorscapable of managing escalating data workloads with unprecedented flexibility, efficiency and scalability.


title: Performance Assessment of Universal Machine Learning Interatomic Potentials: Challenges and Directions for Materials' Surfaces

abstract: Machine learning interatomic potentials (MLIPs) are one of the main techniques in the materials science toolbox, able to bridge ab initio accuracy with the computational efficiency of classical force fields. This allows simulations ranging from atoms, molecules, and biosystems, to solid and bulk materials, surfaces, nanomaterials, and their interfaces and complex interactions. A recent class of advanced MLIPs, which use equivariant representations and deep graph neural networks, is known as universal models. These models are proposed as foundational models suitable for any system, covering most elements from the periodic table. Current universal MLIPs (UIPs) have been trained with the largest consistent dataset available nowadays. However, these are composed mostly of bulk materials' DFT calculations. In this article, we assess the universality of all openly available UIPs, namely MACE, CHGNet, and M3GNet, in a representative task of generalization: calculation of surface energies. We find that the out-of-the-box foundational models have significant shortcomings in this task, with errors correlated to the total energy of surface simulations, having an out-of-domain distance from the training dataset. Our results show that while UIPs are an efficient starting point for fine-tuning specialized models, we envision the potential of increasing the coverage of the materials space towards universal training datasets for MLIPs.


title: Possible $\Sigma_c^* \bar{\Sigma}$ molecular states

abstract: We investigate the possibility of deuteron-like $\Sigma_c^*\bar{\Sigma}$ bound states within the one-boson-exchange model and systematically analyze the effects of the contact-range $\delta^{3}(\vec{r}\,)$ potential, the tensor term from the vector-meson exchange, and nonlocal potentials due to the dependence on the sum of the initial and final state center-of-mass momenta. We find that the pion-exchange potential including the $\delta^{3}(\vec{r}\,)$ term and the tensor term of the $\rho$-exchange potential exhibit comparable magnitudes but opposite signs for any $S$-wave baryon-antibaryon systems. For the $\Sigma_c^*\bar{\Sigma}$ system, it is most likely to form bound states with mass around 3.7 GeV in the $I(J^P)=0(2^-)$ and $1(2^-)$ channels.


title: Eulerian uniqueness of the $\alpha$-SQG patch problem

abstract: We consider the patch problem of the $\alpha$-SQG equation with $\alpha=0$ being the 2D Euler and $\alpha= \frac{1}{2}$ the SQG equations respectively. In the Eulerian setting, we prove the uniqueness of patch solutions of regularity $W^{2, \frac{1}{1-2\alpha} +} $ when $0<\alpha< \frac{1}{2}$ and $C^{1, 4\alpha+ }$ when $0<\alpha< \frac{1}{4} $. The proof is intrinsic to the modified Biot-Savart law and independent of the local existence of patch solutions.


title: Recollements and $n$-cotorsion pairs

abstract: In the present paper, we study the relationships of $n$-cotorsion pairs among three abelian categories in a recollement. Under certain conditions, we present an explicit construction of gluing of $n$-cotorsion pairs in an abelian category $\mathcal{D}$ with respect to $n$-cotorsion pairs in abelian categories $\mathcal{D}^{'}$, $\mathcal{D}^{''}$ respectively. On the other hand, we study the construction of $n$-cotorsion pairs in abelian categories $\mathcal{D}^{'}$, $\mathcal{D}^{''}$ obtained from $n$-cotorsion pairs in an abelian category $\mathcal{D}$.


title: Why Online Reinforcement Learning is Causal

abstract: Reinforcement learning (RL) and causal modelling naturally complement each other. The goal of causal modelling is to predict the effects of interventions in an environment, while the goal of reinforcement learning is to select interventions that maximize the rewards the agent receives from the environment. Reinforcement learning includes the two most powerful sources of information for estimating causal relationships: temporal ordering and the ability to act on an environment. This paper examines which reinforcement learning settings we can expect to benefit from causal modelling, and how. In online learning, the agent has the ability to interact directly with their environment, and learn from exploring it. Our main argument is that in online learning, conditional probabilities are causal, and therefore offline RL is the setting where causal learning has the most potential to make a difference. Essentially, the reason is that when an agent learns from their {\em own} experience, there are no unobserved confounders that influence both the agent's own exploratory actions and the rewards they receive. Our paper formalizes this argument. For offline RL, where an agent may and typically does learn from the experience of {\em others}, we describe previous and new methods for leveraging a causal model, including support for counterfactual queries.


title: Self-Evaluation of Large Language Model based on Glass-box Features

abstract: The proliferation of open-source Large Language Models (LLMs) underscores the pressing need for evaluation methods. Existing works primarily rely on external evaluators, focusing on training and prompting strategies. However, a crucial aspect - model-aware glass-box features - is overlooked. In this study, we explore the utility of glass-box features under the scenario of self-evaluation, namely applying an LLM to evaluate its own output. We investigate various glass-box feature groups and discovered that the softmax distribution serves as a reliable indicator for quality evaluation. Furthermore, we propose two strategies to enhance the evaluation by incorporating features derived from references. Experimental results on public benchmarks validate the feasibility of self-evaluation of LLMs using glass-box features.


title: Spectrum of the Laplacian and the Jacobi operator on Generalized rotational minimal hypersurfaces of spheres

abstract: Let $M\subset S^{n+1}$ be the hypersurface generated by rotating a hypersurface $M_0$ contained in the interior of the unit ball of $\mathbb{R}^{n-k+1}$. More precisely, $M=\{(\sqrt{1-|m|^2}\, y\, , m):y\in S^k,\, m\in M_0\}$. We deduce the equation for the mean curvature of $M$ in terms of the principal curvatures of $M_0$ and in the particular case when $M_0$ is a surface of revolution in $\mathbb{R}^3$, we provide a way to find the eigenvalues of the Laplace and the Stability operators. Numerical examples of embedded minimal hypersurface in $S^{n+1}$ will be provided for several values of $n$. To illustrate the method for finding the eigenvalues, we will compute all the eigenvalues of the Laplace operator smaller than 12 and we compute all non positive eigenvalues of the Stability operators for a particular minimal embedded hypersurface in $S^6$. We show that the stability index (the number of negative eigenvalues of the stability operator counted with multiplicity) for this example is 77 and the nullity (the multiplicity of the eigenvalue $\lambda=0$ of the Stability operator) is 14. Similar results are found in the case where $M_0$ is a hypersurface in $\mathbb{R}^{l+2}$ of the form $(f_2(u) z, f_1(u))$ with $z$ in the $l$-dimensional unit sphere $S^l$


title: Aligners: Decoupling LLMs and Alignment

abstract: Large Language Models (LLMs) need to be aligned with human expectations to ensure their safety and utility in most applications. Alignment is challenging, costly, and needs to be repeated for every LLM and alignment criterion. We propose to decouple LLMs and alignment by training aligner models that can be used to align any LLM for a given criteria on an as-needed basis, thus also reducing the potential negative impacts of alignment on performance. Our recipe for training the aligner models solely relies on synthetic data generated with a (prompted) LLM and can be easily adjusted for a variety of alignment criteria. We use the same synthetic data to train inspectors, binary miss-alignment classification models to guide a "squad" of multiple aligners. Our empirical results demonstrate consistent improvements when applying aligner squad to various LLMs, including chat-aligned models, across several instruction-following and red-teaming datasets.


title: 3DTextureTransformer: Geometry Aware Texture Generation for Arbitrary Mesh Topology

abstract: Learning to generate textures for a novel 3D mesh given a collection of 3D meshes and real-world 2D images is an important problem with applications in various domains such as 3D simulation, augmented and virtual reality, gaming, architecture, and design. Existing solutions either do not produce high-quality textures or deform the original high-resolution input mesh topology into a regular grid to make this generation easier but also lose the original mesh topology. In this paper, we present a novel framework called the 3DTextureTransformer that enables us to generate high-quality textures without deforming the original, high-resolution input mesh. Our solution, a hybrid of geometric deep learning and StyleGAN-like architecture, is flexible enough to work on arbitrary mesh topologies and also easily extensible to texture generation for point cloud representations. Our solution employs a message-passing framework in 3D in conjunction with a StyleGAN-like architecture for 3D texture generation. The architecture achieves state-of-the-art performance among a class of solutions that can learn from a collection of 3D geometry and real-world 2D images while working with any arbitrary mesh topology.


title: Disciplining deliberation: a sociotechnical perspective on machine learning trade-offs

abstract: This paper focuses on two highly publicized formal trade-offs in the field of responsible artificial intelligence (AI) -- between predictive accuracy and fairness and between predictive accuracy and interpretability. These formal trade-offs are often taken by researchers, practitioners, and policy-makers to directly imply corresponding tensions between underlying values. Thus interpreted, the trade-offs have formed a core focus of normative engagement in AI governance, accompanied by a particular division of labor along disciplinary lines. This paper argues against this prevalent interpretation by drawing attention to three sets of considerations that are critical for bridging the gap between these formal trade-offs and their practical impacts on relevant values. I show how neglecting these considerations can distort our normative deliberations, and result in costly and misaligned interventions and justifications. Taken together, these considerations form a sociotechnical framework that could guide those involved in AI governance to assess how, in many cases, we can and should have higher aspirations than the prevalent interpretation of the trade-offs would suggest. I end by drawing out the normative opportunities and challenges that emerge out of these considerations, and highlighting the imperative of interdisciplinary collaboration in fostering responsible AI.


title: Accreting Primordial Black Holes: Dark Matter Constituents

abstract: This paper shows that accretion of positronium plasma between 0.01 to 14s after the Big Bang could have created small black holes contributing at least 1 percent of the dark matter present today, with uncertainties ranging from 10 percent or more. General relativistic magnetohydrodynamic (GRMHD) simulations newly adapted to the early Universe confirm that accretion is due to magneto-rotational instability (MRI) in a rotating plasma. By contrast with Bondi accretion producing primordial masses bigger than the Sun, MRI could produce masses 10^{15-18} g observable by their Hawking radiation contributing to background gamma rays.


title: Single-Image HDR Reconstruction Assisted Ghost Suppression and Detail Preservation Network for Multi-Exposure HDR Imaging

abstract: The reconstruction of high dynamic range (HDR) images from multi-exposure low dynamic range (LDR) images in dynamic scenes presents significant challenges, especially in preserving and restoring information in oversaturated regions and avoiding ghosting artifacts. While current methods often struggle to address these challenges, our work aims to bridge this gap by developing a multi-exposure HDR image reconstruction network for dynamic scenes, complemented by single-frame HDR image reconstruction. This network, comprising single-frame HDR reconstruction with enhanced stop image (SHDR-ESI) and SHDR-ESI-assisted multi-exposure HDR reconstruction (SHDRA-MHDR), effectively leverages the ghost-free characteristic of single-frame HDR reconstruction and the detail-enhancing capability of ESI in oversaturated areas. Specifically, SHDR-ESI innovatively integrates single-frame HDR reconstruction with the utilization of ESI. This integration not only optimizes the single image HDR reconstruction process but also effectively guides the synthesis of multi-exposure HDR images in SHDR-AMHDR. In this method, the single-frame HDR reconstruction is specifically applied to reduce potential ghosting effects in multiexposure HDR synthesis, while the use of ESI images assists in enhancing the detail information in the HDR synthesis process. Technically, SHDR-ESI incorporates a detail enhancement mechanism, which includes a self-representation module and a mutual-representation module, designed to aggregate crucial information from both reference image and ESI. To fully leverage the complementary information from non-reference images, a feature interaction fusion module is integrated within SHDRA-MHDR. Additionally, a ghost suppression module, guided by the ghost-free results of SHDR-ESI, is employed to suppress the ghosting artifacts.


title: Photon Absorption Remote Sensing (PARS): A Comprehensive Approach to Label-free Absorption Microscopy Across Biological Scales

abstract: Label-free optical absorption microscopy techniques have evolved as effective tools for non-invasive chemical specific structural, and functional imaging. Yet most modern label-free microscopy modalities target only a fraction of the contrast afforded by an optical absorption interaction. We introduce a comprehensive optical absorption microscopy technique, Photon Absorption Remote Sensing (PARS), which simultaneously captures the dominant light matter interactions which occur as a pulse of light is absorbed by a molecule. In PARS, the optical scattering, attenuation, and the transient radiative and non-radiative relaxation processes are collected at each optical absorption event. This provides a complete representation of the absorption event, providing unique contrast presented here as the total absorption (TA) and quantum efficiency ratio (QER) measurements. By capturing a complete view of each absorption interaction, PARS bridges many of the specificity challenges associated with label-free imaging, facilitating recovery of a wider range of biomolecules than independent radiative or non-radiative modalities. To show the versatility of PARS, we explore imaging across a wide range of biological specimens, from single cells to in-vivo imaging of living subjects. These examples of label-free histopathological imaging, and vascular imaging illustrate some of the numerous fields where PARS may have profound impacts. Overall PARS may provide comprehensive label-free contrast in a wide variety of biological specimens, providing otherwise inaccessible visualizations, and representing a new a source of rich data to develop new AI and machine learning methods for diagnostics and visualization.


title: Equivalence Testing: The Power of Bounded Adaptivity

abstract: Equivalence testing, a fundamental problem in the field of distribution testing, seeks to infer if two unknown distributions on $[n]$ are the same or far apart in the total variation distance. Conditional sampling has emerged as a powerful query model and has been investigated by theoreticians and practitioners alike, leading to the design of optimal algorithms albeit in a sequential setting (also referred to as adaptive tester). Given the profound impact of parallel computing over the past decades, there has been a strong desire to design algorithms that enable high parallelization. Despite significant algorithmic advancements over the last decade, parallelizable techniques (also termed non-adaptive testers) have $\tilde{O}(\log^{12}n)$ query complexity, a prohibitively large complexity to be of practical usage. Therefore, the primary challenge is whether it is possible to design algorithms that enable high parallelization while achieving efficient query complexity. Our work provides an affirmative answer to the aforementioned challenge: we present a highly parallelizable tester with a query complexity of $\tilde{O}(\log n)$, achieved through a single round of adaptivity, marking a significant stride towards harmonizing parallelizability and efficiency in equivalence testing.


title: Identification of socioeconomic factors influencing global food price security using machine learning

abstract: Global concern over food prices and security has been exacerbated by the impacts of armed conflicts such as the Russia Ukraine War, pandemic diseases, and climate change. Traditionally, analyzing global food prices and their associations with socioeconomic factors has relied on static linear regression models. However, the complexity of socioeconomic factors and their implications extend beyond simple linear relationships. By incorporating determinants, critical characteristics identification, and comparative model analysis, this study aimed to identify the critical socioeconomic characteristics and multidimensional relationships associated with the underlying factors of food prices and security. Machine learning tools were used to uncover the socioeconomic factors influencing global food prices from 2000 to 2022. A total of 105 key variables from the World Development Indicators and the Food and Agriculture Organization of the United Nations were selected. Machine learning identified four key dimensions of food price security: economic and population metrics, military spending, health spending, and environmental factors. The top 30 determinants were selected for feature extraction using data mining. The efficiency of the support vector regression model allowed for precise prediction making and correlation analysis. Keywords: environment and growth, global economics, price fluctuation, support vector regression


title: Generalizing Cooperative Eco-driving via Multi-residual Task Learning

abstract: Conventional control, such as model-based control, is commonly utilized in autonomous driving due to its efficiency and reliability. However, real-world autonomous driving contends with a multitude of diverse traffic scenarios that are challenging for these planning algorithms. Model-free Deep Reinforcement Learning (DRL) presents a promising avenue in this direction, but learning DRL control policies that generalize to multiple traffic scenarios is still a challenge. To address this, we introduce Multi-residual Task Learning (MRTL), a generic learning framework based on multi-task learning that, for a set of task scenarios, decomposes the control into nominal components that are effectively solved by conventional control methods and residual terms which are solved using learning. We employ MRTL for fleet-level emission reduction in mixed traffic using autonomous vehicles as a means of system control. By analyzing the performance of MRTL across nearly 600 signalized intersections and 1200 traffic scenarios, we demonstrate that it emerges as a promising approach to synergize the strengths of DRL and conventional methods in generalizable control.


title: DEEP-ICL: Definition-Enriched Experts for Language Model In-Context Learning

abstract: It has long been assumed that the sheer number of parameters in large language models (LLMs) drives in-context learning (ICL) capabilities, enabling remarkable performance improvements by leveraging task-specific demonstrations. Challenging this hypothesis, we introduce DEEP-ICL, a novel task Definition Enriched ExPert Ensembling methodology for ICL. DEEP-ICL explicitly extracts task definitions from given demonstrations and generates responses through learning task-specific examples. We argue that improvement from ICL does not directly rely on model size, but essentially stems from understanding task definitions and task-guided learning. Inspired by this, DEEP-ICL combines two 3B models with distinct roles (one for concluding task definitions and the other for learning task demonstrations) and achieves comparable performance to LLaMA2-13B. Furthermore, our framework outperforms conventional ICL by overcoming pretraining sequence length limitations, by supporting unlimited demonstrations. We contend that DEEP-ICL presents a novel alternative for achieving efficient few-shot learning, extending beyond the conventional ICL.


title: Fundamental limits of Non-Linear Low-Rank Matrix Estimation

abstract: We consider the task of estimating a low-rank matrix from non-linear and noisy observations. We prove a strong universality result showing that Bayes-optimal performances are characterized by an equivalent Gaussian model with an effective prior, whose parameters are entirely determined by an expansion of the non-linear function. In particular, we show that to reconstruct the signal accurately, one requires a signal-to-noise ratio growing as $N^{\frac 12 (1-1/k_F)}$, where $k_F$ is the first non-zero Fisher information coefficient of the function. We provide asymptotic characterization for the minimal achievable mean squared error (MMSE) and an approximate message-passing algorithm that reaches the MMSE under conditions analogous to the linear version of the problem. We also provide asymptotic errors achieved by methods such as principal component analysis combined with Bayesian denoising, and compare them with Bayes-optimal MMSE.


title: $C^{1,\alpha}$ regularity of variational problems with a convexity constraint

abstract: In this paper, we establish the interior $C^{1,\alpha}$ regularity of minimizers of a class of functionals with a convexity constraint, which includes the principal-agent problems studied by Figalli-Kim-McCann (\textit{J. Econom. Theory} \textbf{146} (2011), no. 2, 454-478). The $C^{1,1}$ regularity was previously proved by Caffarelli-Lions in an unpublished note when the cost is quadratic, and recently extended to the case where the cost is uniformly convex with respect to a general preference function by McCann-Rankin-Zhang(\textit{arXiv:2303.04937v3}). Our main result does not require the uniform convexity assumption on the cost function. In particular, we show that the solutions to the principal-agent problems with $q$-power cost are $C^{1,\frac{1}{q-1}}$ when $q > 2$ and $C^{1,1}$ when $1<q\leq 2$. Examples can show that this regularity is optimal when $q\geq 2$.


title: Regularized DeepIV with Model Selection

abstract: In this paper, we study nonparametric estimation of instrumental variable (IV) regressions. While recent advancements in machine learning have introduced flexible methods for IV estimation, they often encounter one or more of the following limitations: (1) restricting the IV regression to be uniquely identified; (2) requiring minimax computation oracle, which is highly unstable in practice; (3) absence of model selection procedure. In this paper, we present the first method and analysis that can avoid all three limitations, while still enabling general function approximation. Specifically, we propose a minimax-oracle-free method called Regularized DeepIV (RDIV) regression that can converge to the least-norm IV solution. Our method consists of two stages: first, we learn the conditional distribution of covariates, and by utilizing the learned distribution, we learn the estimator by minimizing a Tikhonov-regularized loss function. We further show that our method allows model selection procedures that can achieve the oracle rates in the misspecified regime. When extended to an iterative estimator, our method matches the current state-of-the-art convergence rate. Our method is a Tikhonov regularized variant of the popular DeepIV method with a non-parametric MLE first-stage estimator, and our results provide the first rigorous guarantees for this empirically used method, showcasing the importance of regularization which was absent from the original work.


title: The Smoluchowski-Kramers approximation with distribution-dependent potential and highly oscillating force

abstract: An approximation is derived for a Langevin equation with distribution-dependent potential and state-dependent, randomly fast oscillation. By some estimates and a diffusion approximation the limiting equation is shown to be distribution-dependent stochastic differential equation (SDEs) driven by white noise.


title: Modeling beam propagation in a moving nonlinear medium

abstract: Fully describing light propagation in a rotating, anisotropic medium with thermal nonlinearity requires modeling the interplay between nonlinear refraction, birefringence, and the nonlinear group index. Incorporating these factors into a generalized nonlinear Schr\"odinger equation and fitting them to recent experimental results reveals two key relationships: the photon drag effect can have a nonlinear component that is dependent on the motion of the medium, and the temporal dynamics of the moving birefringent nonlinear medium create distorted figure-eight-like transverse trajectories at the output. The beam trajectory can be accurately modelled with a full understanding of the propagation effects. Efficiently modeling these effects and accurately predicting the beam's output position has implications for optimizing applications in velocimetry and beam-steering. Understanding the roles of competitive nonlinearities gives insight into the creation or suppression of nonlinear phenomena like self-action effects.


title: Signal Response Model in PandaX-4T

abstract: PandaX-4T experiment is a deep-underground dark matter direct search experiment that employs a dual-phase time projection chamber with a sensitive volume containing 3.7 tonne of liquid xenon. The detector of PandaX-4T is capable of simultaneously collecting the primary scintillation and ionization signals, utilizing their ratio to discriminate dark matter signals from background sources such as gamma rays and beta particles. The signal response model plays a crucial role in interpreting the data obtained by PandaX-4T. It describes the conversion from the deposited energy by dark matter interactions to the detectable signals within the detector. The signal response model is utilized in various PandaX-4T results. This work provides a comprehensive description of the procedures involved in constructing and parameter-fitting the signal response model for the energy range of approximately 1 keV to 25 keV for electronic recoils and 6 keV to 90 keV for nuclear recoils. It also covers the signal reconstruction, selection, and correction methods, which are crucial components integrated into the signal response model.


title: Image enhancement algorithm for absorption imaging

abstract: The noise in absorption imaging of cold atoms significantly impacts measurement accuracy across a range of applications with ultracold atoms. It is crucial to adopt an approach that offers effective denoising capabilities without compromising the unique structure of the atoms. Here we introduce a novel image enhancement algorithm for cold atomic absorption imaging. The algorithm successfully suppresses background noise, enhancing image contrast significantly. Experimental results showcase that this approach can enhance the accuracy of cold atom particle number measurements by approximately tenfold, all while preserving essential information. Moreover, the method exhibits exceptional performance and robustness when confronted with fringe noise and multi-component imaging scenarios, offering high stability. Importantly, the optimization process is entirely automated, eliminating the need for manual parameter selection. The method is both compatible and practical, making it applicable across various absorption imaging fields.


title: Pressure tuning of hydrogen bond ordering in the metal-organic framework [(CH3)2NH2]Mn(HCOO)3

abstract: The influence of pressure on the hydrogen bond ordering in the perovskite metal-organic framework [(CH3)2NH2]Mn(HCOO)3 has been investigated by dielectric, pyroelectric adn magnetic measurements in a piston-cylinder cell. Under ambient pressure the ordering of hydrogen bonds takes place at TC = 188 K and induces a first-order ferroelectric phase transition. With increasing pressure to p = 3.92 kbar, the order-disorder transition shifts to a lower temperature and retains the first-order ferroelectric nature. However, under higher pressures, the ordering process of hydrogen bonds is split into two transitions: a broad antiferroelectric transition at high temperature and a first-order ferroelectric transition at low temperature. With increasing pressure, the antiferroelectric phase is enhanced whereas the ferroelectric phase is greatly suppressed, which implies that compression of the perovskite framework favors antiparallel arrangement of the hydrogen bonds. The canted anti-ferromagnetic transition was almost unchanged when pressure up to 10.85 kbar. Our study demonstrated that the perovskite metal-organic frameworks are more sensitive to external pressure than conventional perovskite oxides so that their electric properties can be easily tuned by pressure.


title: A Gaussian integral that counts regular graphs

abstract: In a recent article J. Phys. Compl. 4 (2023) 035005, Kawamoto evoked statistical physics methods for the problem of counting graphs with a prescribed degree sequence. This treatment involved truncating a particular Taylor expansion at the first two terms, which resulted in the Bender-Canfield estimate for the graph counts. This is surprisingly successful since the Bender-Canfield formula is asymptotically accurate for large graphs, while the series truncation does not a priori suggest a similar level of accuracy. We upgrade the above treatment in three directions. First, we derive an exact formula for counting d-regular graphs in terms of a d-dimensional Gaussian integral. Second, we show how to convert this formula into an integral representation for the generating function of d-regular graph counts. Third, we perform explicit saddle point analysis for large graph sizes and identify the saddle point configurations responsible for graph count estimates. In these saddle point configurations, only two of the integration variables condense to significant values, while the remaining ones approach zero for large graphs. This provides an underlying picture that justifies Kawamoto's earlier findings.

categories: cond-mat.stat-mech cond-mat.dis-nn hep-th math-ph math.CO math.MP


title: Control Barrier Functions for Linear Continuous-Time Input-Delay Systems with Limited-Horizon Previewable Disturbances

abstract: Cyber-physical and autonomous systems are often equipped with mechanisms that provide predictions/projections of future disturbances, e.g., road curvatures, commonly referred to as preview or lookahead, but this preview information is typically not leveraged in the context of deriving control barrier functions (CBFs) for safety. This paper proposes a novel limited preview control barrier function (LPrev-CBF) that avoids both ends of the spectrum, where on one end, the standard CBF approach treats the (previewable) disturbances simply as worst-case adversarial signals and on the other end, a recent Prev-CBF approach assumes that the disturbances are previewable and known for the entire future. Moreover, our approach applies to input-delay systems and has recursive feasibility guarantees since we explicitly take input constraints/bounds into consideration. Thus, our approach provides strong safety guarantees in a less conservative manner than standard CBF approaches while considering a more realistic setting with limited preview and input delays.


title: Resonant Quantum Magnetodielectric Effect in Multiferroic Metal-Organic Framework [CH3NH3]Co(HCOO)3

abstract: We report the observation of both resonant quantum tunneling of magnetization (RQTM) and resonant quantum magnetodielectric (RQMD) effect in the perovskite multiferroic metal-organic framework [CH3NH3]Co(HCOO)3. An intrinsic magnetic phase separation emerges at low temperatures due to hydrogen-bond-modified long range super-exchange interaction, leading to the coexistence of canted antiferromagnetic order and single-ion magnet. Subsequently, a stair-shaped magnetic hysteresis loop along the [101] direction characterizing the RQTM appears below the magnetic blocking temperature. More interestingly, the magnetic field dependence of dielectric permittivity exhibits pronounced negative peaks at the critical fields corresponding to the RQTM, a phenomenon termed the RQMD effect which enables electrical detection of the RQTM. These intriguing properties make the multiferroic metal-organic framework a promising candidate for solid-state quantum computing.


title: A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech Recognition

abstract: Advanced Audio-Visual Speech Recognition (AVSR) systems have been observed to be sensitive to missing video frames, performing even worse than single-modality models. While applying the dropout technique to the video modality enhances robustness to missing frames, it simultaneously results in a performance loss when dealing with complete data input. In this paper, we investigate this contrasting phenomenon from the perspective of modality bias and reveal that an excessive modality bias on the audio caused by dropout is the underlying reason. Moreover, we present the Modality Bias Hypothesis (MBH) to systematically describe the relationship between modality bias and robustness against missing modality in multimodal systems. Building on these findings, we propose a novel Multimodal Distribution Approximation with Knowledge Distillation (MDA-KD) framework to reduce over-reliance on the audio modality and to maintain performance and robustness simultaneously. Finally, to address an entirely missing modality, we adopt adapters to dynamically switch decision strategies. The effectiveness of our proposed approach is evaluated and validated through a series of comprehensive experiments using the MISP2021 and MISP2022 datasets. Our code is available at https://github.com/dalision/ModalBiasAVSR


title: Efficient CNN-LSTM based Parameter Estimation of Levy Driven Stochastic Differential Equations

abstract: This study addresses the challenges in parameter estimation of stochastic differential equations driven by non-Gaussian noises, which are critical in understanding dynamic phenomena such as price fluctuations and the spread of infectious diseases. Previous research highlighted the potential of LSTM networks in estimating parameters of alpha stable Levy driven SDEs but faced limitations including high time complexity and constraints of the LSTM chaining property. To mitigate these issues, we introduce the PEnet, a novel CNN-LSTM-based three-stage model that offers an end to end approach with superior accuracy and adaptability to varying data structures, enhanced inference speed for long sequence observations through initial data feature condensation by CNN, and high generalization capability, allowing its application to various complex SDE scenarios. Experiments on synthetic datasets confirm PEnet significant advantage in estimating SDE parameters associated with noise characteristics, establishing it as a competitive method for SDE parameter estimation in the presence of Levy noise.


title: UltraWiki: Ultra-fine-grained Entity Set Expansion with Negative Seed Entities

abstract: Entity Set Expansion (ESE) aims to identify new entities belonging to the same semantic class as a given set of seed entities. Traditional methods primarily relied on positive seed entities to represent a target semantic class, which poses challenge for the representation of ultra-fine-grained semantic classes. Ultra-fine-grained semantic classes are defined based on fine-grained semantic classes with more specific attribute constraints. Describing it with positive seed entities alone cause two issues: (i) Ambiguity among ultra-fine-grained semantic classes. (ii) Inability to define "unwanted" semantic. Due to these inherent shortcomings, previous methods struggle to address the ultra-fine-grained ESE (Ultra-ESE). To solve this issue, we first introduce negative seed entities in the inputs, which belong to the same fine-grained semantic class as the positive seed entities but differ in certain attributes. Negative seed entities eliminate the semantic ambiguity by contrast between positive and negative attributes. Meanwhile, it provide a straightforward way to express "unwanted". To assess model performance in Ultra-ESE, we constructed UltraWiki, the first large-scale dataset tailored for Ultra-ESE. UltraWiki encompasses 236 ultra-fine-grained semantic classes, where each query of them is represented with 3-5 positive and negative seed entities. A retrieval-based framework RetExpan and a generation-based framework GenExpan are proposed to comprehensively assess the efficacy of large language models from two different paradigms in Ultra-ESE. Moreover, we devised three strategies to enhance models' comprehension of ultra-fine-grained entities semantics: contrastive learning, retrieval augmentation, and chain-of-thought reasoning. Extensive experiments confirm the effectiveness of our proposed strategies and also reveal that there remains a large space for improvement in Ultra-ESE.


title: Asymptotic Theory for Linear Functionals of Kernel Ridge Regression

abstract: An asymptotic theory is established for linear functionals of the predictive function given by kernel ridge regression, when the reproducing kernel Hilbert space is equivalent to a Sobolev space. The theory covers a wide variety of linear functionals, including point evaluations, evaluation of derivatives, $L_2$ inner products, etc. We establish the upper and lower bounds of the estimates and their asymptotic normality. It is shown that $\lambda\sim n^{-1}$ is the universal optimal order of magnitude for the smoothing parameter to balance the variance and the worst-case bias. The theory also implies that the optimal $L_\infty$ error of kernel ridge regression can be attained under the optimal smoothing parameter $\lambda\sim n^{-1}\log n$. These optimal rates for the smoothing parameter differ from the known optimal rate $\lambda\sim n^{-\frac{2m}{2m+d}}$ that minimizes the $L_2$ error of the kernel ridge regression.


title: Analytic formula for the proton radioactivity spectroscopic factor

abstract: In the present work, we systematically study the spectroscopic factor of proton radioactivity ($S_p$) with $A>100$ using the deformed two-potential approach (D-TPA). It is found that there is a link between the quadrupole deformation parameter of proton emitter and $S_p$. Based on this result, we propose a simple analytic formula for estimating the spectroscopic factor of proton radioactivity. With the help of this formula, the calculated half-lives of proton radioactivity can reproduce the experimental data successfully within a factor of 2.77. Furthermore, we extend the D-TPA with this formula for evaluating the spectroscopic factor to predict the proton radioactivity half-lives of 12 proton radioactivity candidates whose radioactivity is energetically allowed or observed but not yet quantified in NUBASE2020. For comparison, the universal decay law for proton radioactivity (UDLP) and the new Geiger-Nuttall law (NG-N) are also used. It turns out that all of the predicted results are basically consistent with each other.


title: Low Complexity Radio Frequency Interference Mitigation for Radio Astronomy Using Large Antenna Array

abstract: With the ongoing growth in radio communications, there is an increased contamination of radio astronomical source data, which hinders the study of celestial radio sources. In many cases, fast mitigation of strong radio frequency interference (RFI) is valuable for studying short lived radio transients so that the astronomers can perform detailed observations of celestial radio sources. The standard method to manually excise contaminated blocks in time and frequency makes the removed data useless for radio astronomy analyses. This motivates the need for better radio frequency interference (RFI) mitigation techniques for array of size M antennas. Although many solutions for mitigating strong RFI improves the quality of the final celestial source signal, many standard approaches require all the eigenvalues of the spatial covariance matrix ($\textbf{R} \in \mathbb{C}^{M \times M}$) of the received signal, which has $O(M^3)$ computation complexity for removing RFI of size $d$ where $\textit{d} \ll M$. In this work, we investigate two approaches for RFI mitigation, 1) the computationally efficient Lanczos method based on the Quadratic Mean to Arithmetic Mean (QMAM) approach using information from previously-collected data under similar radio-sky-conditions, and 2) an approach using a celestial source as a reference for RFI mitigation. QMAM uses the Lanczos method for finding the Rayleigh-Ritz values of the covariance matrix $\textbf{R}$, thus, reducing the computational complexity of the overall approach to $O(\textit{d}M^2)$. Our numerical results, using data from the radio observatory Long Wavelength Array (LWA-1), demonstrate the effectiveness of both proposed approaches to remove strong RFI, with the QMAM-based approach still being computationally efficient.


title: Theoretical calculations of proton emission half-lives based on a deformed Gamow-like model

abstract: In the present study, proton emission half-lives have been investigated for the deformed proton emitters with $53\leq Z \leq 83$ in the deformed Gamow-like model, where the deformation effect has been included in the Coulomb potential. The experimental half-lives of proton emitters can be reproduced within a factor of 3.45. For comparison, other results from the universal decay law and the new Geiger-Nuttall law are presented as well. Furthermore, the relevance of the half-lives to the angular momentum $l$ for $^{117}$La, $^{121}$Pr, $^{135}$Tb and $^{141}$Ho has been analyzed, and corresponding possible values of $l$ has been put forward: $l=$3, 3, 4, 4.


title: Portable GPU implementation of the WP-CCC ion-atom collisions code

abstract: We present our experience of porting the code used in the wave-packet convergent-close-coupling (WP-CCC) approach to run on NVIDIA V100 and AMD MI250X GPUs. The WP-CCC approach is a method used in the field of ion-atom collision physics to describe various processes such as elastic scattering, target excitation and electron-capture by the projectile. It has demonstrated its effectiveness in modelling collisions involving proton or bare ion projectiles with various atomic and molecular targets, especially those which can be considered as one or two-electron systems. Such calculations find their application in computational atomic physics as well as in the modelling of fusion plasmas and in hadron therapy for cancer treatment. The main computational cost of the method lies in the solution of an emerging set of coupled first-order differential equations. This involves implementing the standard Runge-Kutta method while varying the projectile position along multiple straight-line paths. At each projectile position several millions of matrix elements need to be calculated which is accomplished using the OpenACC programming model. Once these matrix elements are computed, the subsequent steps involve matrix inversion and multiplication with another matrix. To expedite these operations, a GPU-accelerated LAPACK routine, specialised for solving systems of linear equations, is employed. For AMD GPUs, this routine is accessible through the hipSOLVER library, while for NVIDIA GPUs, it can be obtained from the cuSOLVER library. The portability, performance and energy efficiency of the CPU-only code have been compared with the GPU-accelerated version running on AMD and NVIDIA GPUs. The implementation of GPU-accelerated WP-CCC code opens up avenues for exploring more sophisticated collision processes involving complex projectile and target structures, which were previously considered infeasible.


title: Mastering Memory Tasks with World Models

abstract: Current model-based reinforcement learning (MBRL) agents struggle with long-term dependencies. This limits their ability to effectively solve tasks involving extended time gaps between actions and outcomes, or tasks demanding the recalling of distant observations to inform current actions. To improve temporal coherence, we integrate a new family of state space models (SSMs) in world models of MBRL agents to present a new method, Recall to Imagine (R2I). This integration aims to enhance both long-term memory and long-horizon credit assignment. Through a diverse set of illustrative tasks, we systematically demonstrate that R2I not only establishes a new state-of-the-art for challenging memory and credit assignment RL tasks, such as BSuite and POPGym, but also showcases superhuman performance in the complex memory domain of Memory Maze. At the same time, it upholds comparable performance in classic RL tasks, such as Atari and DMC, suggesting the generality of our method. We also show that R2I is faster than the state-of-the-art MBRL method, DreamerV3, resulting in faster wall-time convergence.


title: Finite final segments of the d.c.e. Turing degrees

abstract: We prove that every finite distributive lattice is isomorphic to a final segment of the d.c.e. Turing degrees (i.e., the degrees of differences of computably enumerable sets). As a corollary, we are able to infer the undecidability of the EAE-theory of the d.c.e. degrees in the language of partial ordering.


title: Non-equilibrium Green's function approach to low-energy fission dynamics

abstract: The concept of a compound nucleus was proposed by Bohr in 1936 to explain narrow resonances in neutron scattering off a nucleus. While a compound nucleus has been understood in terms of statistical mechanics, its description based on a many-body Hamiltonian has yet to be developed. Here we present a microscopic modeling of a compound nucleus starting from a nucleonic degree of freedom. We focus in particular on a decay of a heavy compound nucleus, that is, fission and radiative capture. To this end, we develop an approach based on a non-equilibrium Green's function, which is combined with a configuration interaction (CI) approach based on a constrained density-functional theory (DFT). We apply this approach to a barrier-top fission of $^{236}$U, restricting the model space to seniority zero configurations of neutrons and protons. Our calculation with a Skyrme energy functional yields the fission-to-capture branching ratio of around 0.07. While this value is still reasonable, the calculation underestimates the branching ratio by about a factor of 40 as compared to the empirical value, indicating a necessity of seniority non-zero configurations in the model space. We also find that the distribution of the fission probability approximately follows the chi-squared distribution with the number of degrees of freedom of the order of 1, which is consistent with the experimental finding.

categories: nucl-th cond-mat.mes-hall cond-mat.stat-mech nucl-ex physics.chem-ph


title: Federated Recommendation via Hybrid Retrieval Augmented Generation

abstract: Federated Recommendation (FR) emerges as a novel paradigm that enables privacy-preserving recommendations. However, traditional FR systems usually represent users/items with discrete identities (IDs), suffering from performance degradation due to the data sparsity and heterogeneity in FR. On the other hand, Large Language Models (LLMs) as recommenders have proven effective across various recommendation scenarios. Yet, LLM-based recommenders encounter challenges such as low inference efficiency and potential hallucination, compromising their performance in real-world scenarios. To this end, we propose GPT-FedRec, a federated recommendation framework leveraging ChatGPT and a novel hybrid Retrieval Augmented Generation (RAG) mechanism. GPT-FedRec is a two-stage solution. The first stage is a hybrid retrieval process, mining ID-based user patterns and text-based item features. Next, the retrieved results are converted into text prompts and fed into GPT for re-ranking. Our proposed hybrid retrieval mechanism and LLM-based re-rank aims to extract generalized features from data and exploit pretrained knowledge within LLM, overcoming data sparsity and heterogeneity in FR. In addition, the RAG approach also prevents LLM hallucination, improving the recommendation performance for real-world users. Experimental results on diverse benchmark datasets demonstrate the superior performance of GPT-FedRec against state-of-the-art baseline methods.


title: Towards Robustness Analysis of E-Commerce Ranking System

abstract: Information retrieval (IR) is a pivotal component in various applications. Recent advances in machine learning (ML) have enabled the integration of ML algorithms into IR, particularly in ranking systems. While there is a plethora of research on the robustness of ML-based ranking systems, these studies largely neglect commercial e-commerce systems and fail to establish a connection between real-world and manipulated query relevance. In this paper, we present the first systematic measurement study on the robustness of e-commerce ranking systems. We define robustness as the consistency of ranking outcomes for semantically identical queries. To quantitatively analyze robustness, we propose a novel metric that considers both ranking position and item-specific information that are absent in existing metrics. Our large-scale measurement study with real-world data from e-commerce retailers reveals an open opportunity to measure and improve robustness since semantically identical queries often yield inconsistent ranking results. Based on our observations, we propose several solution directions to enhance robustness, such as the use of Large Language Models. Note that the issue of robustness discussed herein does not constitute an error or oversight. Rather, in scenarios where there exists a vast array of choices, it is feasible to present a multitude of products in various permutations, all of which could be equally appealing. However, this extensive selection may lead to customer confusion. As e-commerce retailers use various techniques to improve the quality of search results, we hope that this research offers valuable guidance for measuring the robustness of the ranking systems.


title: Depth-aware Test-Time Training for Zero-shot Video Object Segmentation

abstract: Zero-shot Video Object Segmentation (ZSVOS) aims at segmenting the primary moving object without any human annotations. Mainstream solutions mainly focus on learning a single model on large-scale video datasets, which struggle to generalize to unseen videos. In this work, we introduce a test-time training (TTT) strategy to address the problem. Our key insight is to enforce the model to predict consistent depth during the TTT process. In detail, we first train a single network to perform both segmentation and depth prediction tasks. This can be effectively learned with our specifically designed depth modulation layer. Then, for the TTT process, the model is updated by predicting consistent depth maps for the same frame under different data augmentations. In addition, we explore different TTT weight updating strategies. Our empirical results suggest that the momentum-based weight initialization and looping-based training scheme lead to more stable improvements. Experiments show that the proposed method achieves clear improvements on ZSVOS. Our proposed video TTT strategy provides significant superiority over state-of-the-art TTT methods. Our code is available at: https://nifangbaage.github.io/DATTT.


title: Decentralized and Equitable Optimal Transport

abstract: This paper considers the decentralized (discrete) optimal transport (D-OT) problem. In this setting, a network of agents seeks to design a transportation plan jointly, where the cost function is the sum of privately held costs for each agent. We reformulate the D-OT problem as a constraint-coupled optimization problem and propose a single-loop decentralized algorithm with an iteration complexity of O(1/{\epsilon}) that matches existing centralized first-order approaches. Moreover, we propose the decentralized equitable optimal transport (DE-OT) problem. In DE-OT, in addition to cooperatively designing a transportation plan that minimizes transportation costs, agents seek to ensure equity in their individual costs. The iteration complexity of the proposed method to solve DE-OT is also O(1/{\epsilon}). This rate improves existing centralized algorithms, where the best iteration complexity obtained is O(1/{\epsilon}^2).


title: Can Small Language Models be Good Reasoners for Sequential Recommendation?

abstract: Large language models (LLMs) open up new horizons for sequential recommendations, owing to their remarkable language comprehension and generation capabilities. However, there are still numerous challenges that should be addressed to successfully implement sequential recommendations empowered by LLMs. Firstly, user behavior patterns are often complex, and relying solely on one-step reasoning from LLMs may lead to incorrect or task-irrelevant responses. Secondly, the prohibitively resource requirements of LLM (e.g., ChatGPT-175B) are overwhelmingly high and impractical for real sequential recommender systems. In this paper, we propose a novel Step-by-step knowLedge dIstillation fraMework for recommendation (SLIM), paving a promising path for sequential recommenders to enjoy the exceptional reasoning capabilities of LLMs in a "slim" (i.e., resource-efficient) manner. We introduce CoT prompting based on user behavior sequences for the larger teacher model. The rationales generated by the teacher model are then utilized as labels to distill the downstream smaller student model (e.g., LLaMA2-7B). In this way, the student model acquires the step-by-step reasoning capabilities in recommendation tasks. We encode the generated rationales from the student model into a dense vector, which empowers recommendation in both ID-based and ID-agnostic scenarios. Extensive experiments demonstrate the effectiveness of SLIM over state-of-the-art baselines, and further analysis showcasing its ability to generate meaningful recommendation reasoning at affordable costs.


title: Advancing Biomedical Text Mining with Community Challenges

abstract: The field of biomedical research has witnessed a significant increase in the accumulation of vast amounts of textual data from various sources such as scientific literatures, electronic health records, clinical trial reports, and social media. However, manually processing and analyzing these extensive and complex resources is time-consuming and inefficient. To address this challenge, biomedical text mining, also known as biomedical natural language processing, has garnered great attention. Community challenge evaluation competitions have played an important role in promoting technology innovation and interdisciplinary collaboration in biomedical text mining research. These challenges provide platforms for researchers to develop state-of-the-art solutions for data mining and information processing in biomedical research. In this article, we review the recent advances in community challenges specific to Chinese biomedical text mining. Firstly, we collect the information of these evaluation tasks, such as data sources and task types. Secondly, we conduct systematic summary and comparative analysis, including named entity recognition, entity normalization, attribute extraction, relation extraction, event extraction, text classification, text similarity, knowledge graph construction, question answering, text generation, and large language model evaluation. Then, we summarize the potential clinical applications of these community challenge tasks from translational informatics perspective. Finally, we discuss the contributions and limitations of these community challenges, while highlighting future directions in the era of large language models.


title: Coderivative-Based Newton Methods in Structured Nonconvex and Nonsmooth Optimization

abstract: This paper proposes and develops new Newton-type methods to solve structured nonconvex and nonsmooth optimization problems with justifying their fast local and global convergence by means of advanced tools of variational analysis and generalized differentiation. The objective functions belong to a broad class of prox-regular functions with specification to constrained optimization of nonconvex structured sums. We also develop a novel line search method, which is an extension of the proximal gradient algorithm while allowing us to globalize the proposed coderivative-based Newton methods by incorporating the machinery of forward-backward envelopes. Further applications and numerical experiments are conducted for the $\ell_0$-$\ell_2$ regularized least-square model appearing in statistics and machine learning.