title: Fermion Masses, Neutrino Mixing and Higgs-Mediated Flavor Violation in 3HDM with $S_3$ Permutation Symmetry

abstract: The Yukawa and scalar sectors of a general $S_3$-symmetric three-Higgs doublet model (3HDM) are investigated. The Yukawa interactions are constructed in an $S_3$-invariant way, while the scalar potential contains $S_3$ soft-breaking terms. Global fits to the quark/lepton masses and CKM/PMNS matrices are performed. Excellent fits to all fermion mass and mixing parameters are obtained. Both normal ordering and inverted ordering of neutrino masses are found to be admissible within the framework, with a prediction for the CP-violation phase, $\delta_{CP} \simeq 120^0$. The fit results in the Yukawa sector are further investigated, together with the scalar sector, imposing constraints from Higgs-mediated neutral meson mixing and neutron electric dipole moment (EDM). We explore the lowest allowed mass of the heavy Higgs bosons, consistent with these constraints, and find it to be about 17 TeV. The corresponding neutron EDM is around $1.7\times10^{-27}$ e-cm, which is within reach of proposed experiments. It is found that the constraints from the $K$-meson system dominate, while those from the $D$ meson system are marginal.


title: MaskCRT: Masked Conditional Residual Transformer for Learned Video Compression

abstract: Conditional coding has lately emerged as the mainstream approach to learned video compression. However, a recent study shows that it may perform worse than residual coding when the information bottleneck arises. Conditional residual coding was thus proposed, creating a new school of thought to improve on conditional coding. Notably, conditional residual coding relies heavily on the assumption that the residual frame has a lower entropy rate than that of the intra frame. Recognizing that this assumption is not always true due to dis-occlusion phenomena or unreliable motion estimates, we propose a masked conditional residual coding scheme. It learns a soft mask to form a hybrid of conditional coding and conditional residual coding in a pixel adaptive manner. We introduce a Transformer-based conditional autoencoder. Several strategies are investigated with regard to how to condition a Transformer-based autoencoder for inter-frame coding, a topic that is largely under-explored. Additionally, we propose a channel transform module (CTM) to decorrelate the image latents along the channel dimension, with the aim of using the simple hyperprior to approach similar compression performance to the channel-wise autoregressive model. Experimental results confirm the superiority of our masked conditional residual transformer (termed MaskCRT) to both conditional coding and conditional residual coding. On commonly used datasets, MaskCRT shows comparable BD-rate results to VTM-17.0 under the low delay P configuration in terms of PSNR-RGB. It also opens up a new research direction for advancing learned video compression.


title: Hairpin Motors for Electromobility: Twists and Bends of a Technological Breakthrough that Initially Arrived A Century Too Soon

abstract: There is currently a major trend to hairpin-winding motors for small and medium drives with increased power, specifically more torque density in the automotive industry. Practically all large players in the field either already use this winding technology or have announced doing so soon. However, hairpins, bar windings, and other segmented winding techniques are not purely a material and production issue. Instead their application to small drives influences all aspects of the design of machines, which are currently explored and studied by the industry. These range from not obvious gaps in the theory, parameter studies for maxima of efficiency, possible as well as advantageous winding schemes, thermal design, and ways to control ac losses to specific materials and process difficulties. Despite the apparent novelty of the trend, however, designers could revisit a widely forgotten knowledge base of more than 100 years for many of those questions. This old knowledge base and the understanding that many recently presented concepts have been developed earlier may speed up the technological development and appear to be a key to further innovation. Instead, many problems need to be solved again and technologies re-invented. Furthermore, as this technology has recently become merely industry-driven, a substantial portion of the information and technological developments are not available to the public -- a state that to our eyes may harm the innovation capacity of the drives community.


title: Outlier-immune Data-driven Linear Power Flow Model Construction via Mixed-Integer Programming

abstract: The common approaches to construct a data-driven linear power flow (DD-LPF) model cannot completely eliminate the adverse impacts of outliers in a training dataset. In this letter, a novel outlier-immune DD-LPF model construction method via mixed-integer programming is presented for automatically and optimally identifying outliers to form a more accurate LPF model. Two acceleration solution strategies are further suggested to reduce the computational time. Case studies demonstrate the superior accuracy and comparable computational time of the proposed method when compared to three common approaches.


title: Tomlinson-Harashima Cluster-Based Precoders for Cell-Free MU-MIMO Networks

abstract: Cell-free (CF) multiple-input multiple-output (MIMO) systems generally employ linear precoding techniques to mitigate the effects of multiuser interference. However, the power loss, efficiency, and precoding accuracy of linear precoders are usually improved by replacing them with nonlinear precoders that employ perturbation and modulo operation. In this work, we propose nonlinear user-centric precoders for CF MIMO, wherein different clusters of access points (APs) serve different users in CF multiple-antenna networks. Each cluster of APs is selected based on large-scale fading coefficients. The clustering procedure results in a sparse nonlinear precoder. We further devise a reduced-dimension nonlinear precoder, where clusters of users are created to reduce the complexity of the nonlinear precoder, the amount of required signaling, and the number of users. Numerical experiments show that the proposed nonlinear techniques for CF systems lead to an enhanced performance when compared to their linear counterparts.


title: Cycle structure of Mallows permutation model with the $L^1$ distance

abstract: Introduced by Mallows as a ranking model in statistics, Mallows permutation model is a class of non-uniform probability distributions on the symmetric group $S_n$. The model depends on a distance metric on $S_n$ and a scale parameter $\beta$. In this paper, we take the distance metric to be the $L^1$ distance (also known as Spearman's footrule in the statistics literature), and investigate the cycle structure of random permutations drawn from Mallows permutation model with the $L^1$ distance. We focus on the parameter regime where $\beta>0$. We show that the expected length of the cycle containing a given point is of order $\min\{\max\{\beta^{-2},1\},n\}$, and the expected diameter of the cycle containing a given point is of order $\min\{e^{-2\beta}\max\{\beta^{-2},1\}, n-1\}$. Moreover, when $\beta\ll n^{-1\slash 2}$, the sorted cycle lengths (in descending order) normalized by $n$ converge in distribution to the Poisson-Dirichlet law with parameter $1$. The proofs of the results rely on the hit and run algorithm, a Markov chain for sampling from the model.


title: Coderivatives with respect to a set of the normal cone mappings and their applications

abstract: Establishing explicit formulas of coderivatives with respect to a set of the normal cone mapping to a polyhedron, the solution set of a variational inequalities system, is one of the main goals of this paper. By using our coderivative formulas, we provide a characteristic of the Aubin property with respect to a set of that normal cone mapping and thereby give necessary optimality conditions for simple bilevel optimization problems under weak qualification conditions.


title: ShallowBlocker: Improving Set Similarity Joins for Blocking

abstract: Blocking is a crucial step in large-scale entity matching but often requires significant manual engineering from an expert for each new dataset. Recent work has show that deep learning is state-of-the-art and has great potential for achieving hands-off and accurate blocking compared to classical methods. However, in practice, such deep learning methods are often unstable, offers little interpretability, and require hyperparameter tuning and significant computational resources. In this paper, we propose a hands-off blocking method based on classical string similarity measures: ShallowBlocker. It uses a novel hybrid set similarity join combining absolute similarity, relative similarity, and local cardinality conditions with a new effective pre-candidate filter replacing size filter. We show that the method achieves state-of-the-art pair effectiveness on both unsupervised and supervised blocking in a scalable way.


title: Optimized experiment design and analysis for fully randomized benchmarking

abstract: Randomized benchmarking (RB) is a widely used strategy to assess the quality of available quantum gates in a computational context. RB involves applying known random sequences of gates to an initial state and using the statistics of a final measurement step to determine an effective depolarizing error per step of the sequence, which is a metric of gate quality. Here we investigate the advantages of fully randomized benchmarking, where a new random sequence is drawn for each experimental trial. The advantages of full randomization include smaller confidence intervals on the inferred step error, the ability to use maximum likelihood analysis without heuristics, straightforward optimization of the sequence lengths, and the ability to model and measure behaviors that go beyond the typical assumption of time-independent error rates. We discuss models of time-dependent or non-Markovian errors that generalize the basic RB model of a single exponential decay of the success probability. For any of these models, we implement a concrete protocol to minimize the uncertainty of the estimated parameters given a fixed time constraint on the complete experiment, and we implement a maximum likelihood analysis. We consider several previously published experiments and determine the potential for improvements with optimized full randomization. We experimentally observe such improvements in Clifford randomized benchmarking experiments on a single trapped ion qubit at the National Institute of Standards and Technology (NIST). For an experiment with uniform lengths and intentionally repeated sequences the step error was $2.42^{+0.30}_{-0.22}\times 10^{-5}$, and for an optimized fully randomized experiment of the same total duration the step error was $2.57^{+0.07}_{-0.06}\times 10^{-5}$. We find a substantial decrease in the uncertainty of the step error as a result of optimized fully randomized benchmarking.


title: A data driven Koopman-Schur decomposition for computational analysis of nonlinear dynamics

abstract: This paper introduces a new theoretical and computational framework for a data driven Koopman mode analysis of nonlinear dynamics. To alleviate the potential problem of ill-conditioned eigenvectors in the existing implementations of the Dynamic Mode Decomposition (DMD) and the Extended Dynamic Mode Decomposition (EDMD), the new method introduces a Koopman-Schur decomposition that is entirely based on unitary transformations. The analysis in terms of the eigenvectors as modes of a Koopman operator compression is replaced with a modal decomposition in terms of a flag of invariant subspaces that correspond to selected eigenvalues. The main computational tool from the numerical linear algebra is the partial ordered Schur decomposition that provides convenient orthonormal bases for these subspaces. In the case of real data, a real Schur form is used and the computation is based on real orthogonal transformations. The new computational scheme is presented in the framework of the Extended DMD and the kernel trick is used.


title: SecQA: A Concise Question-Answering Dataset for Evaluating Large Language Models in Computer Security

abstract: In this paper, we introduce SecQA, a novel dataset tailored for evaluating the performance of Large Language Models (LLMs) in the domain of computer security. Utilizing multiple-choice questions generated by GPT-4 based on the "Computer Systems Security: Planning for Success" textbook, SecQA aims to assess LLMs' understanding and application of security principles. We detail the structure and intent of SecQA, which includes two versions of increasing complexity, to provide a concise evaluation across various difficulty levels. Additionally, we present an extensive evaluation of prominent LLMs, including GPT-3.5-Turbo, GPT-4, Llama-2, Vicuna, Mistral, and Zephyr models, using both 0-shot and 5-shot learning settings. Our results, encapsulated in the SecQA v1 and v2 datasets, highlight the varying capabilities and limitations of these models in the computer security context. This study not only offers insights into the current state of LLMs in understanding security-related content but also establishes SecQA as a benchmark for future advancements in this critical research area.


title: Extremely small stars in scalar-tensor gravity: when stellar radius is less than Schwarzschild one

abstract: We show analytically that there exist compact stellar objects akin to neutron stars whose radius is smaller than the Schwarzschild radius defined by Arnowitt-Deser-Misner (ADM) mass. The radius of the compact object is defined by the radius where the energy density and the pressure of ordinary matter vanish, while clouds of scalar(s) can extend beyond this radius -- a situation that is often encountered in modified gravity theories, like $F(R)$ gravity and the scalar--Einstein--Gauss-Bonnet gravity. The clouds of scalar mode(s) give additional contributions to the ADM mass and as a result, the corresponding Schwarzschild radius given by the ADM mass can be larger than that of the compact object.


title: Masked Contrastive Reconstruction for Cross-modal Medical Image-Report Retrieval

abstract: Cross-modal medical image-report retrieval task plays a significant role in clinical diagnosis and various medical generative tasks. Eliminating heterogeneity between different modalities to enhance semantic consistency is the key challenge of this task. The current Vision-Language Pretraining (VLP) models, with cross-modal contrastive learning and masked reconstruction as joint training tasks, can effectively enhance the performance of cross-modal retrieval. This framework typically employs dual-stream inputs, using unmasked data for cross-modal contrastive learning and masked data for reconstruction. However, due to task competition and information interference caused by significant differences between the inputs of the two proxy tasks, the effectiveness of representation learning for intra-modal and cross-modal features is limited. In this paper, we propose an efficient VLP framework named Masked Contrastive and Reconstruction (MCR), which takes masked data as the sole input for both tasks. This enhances task connections, reducing information interference and competition between them, while also substantially decreasing the required GPU memory and training time. Moreover, we introduce a new modality alignment strategy named Mapping before Aggregation (MbA). Unlike previous methods, MbA maps different modalities to a common feature space before conducting local feature aggregation, thereby reducing the loss of fine-grained semantic information necessary for improved modality alignment. Qualitative and quantitative experiments conducted on the MIMIC-CXR dataset validate the effectiveness of our approach, demonstrating state-of-the-art performance in medical cross-modal retrieval tasks.


title: Strong frequency correlation and anti-correlation between a Raman laser and its pump laser for positive and negative dispersions

abstract: We show that the frequency of a Raman laser is highly correlated or anti-correlated with the frequency of the Raman pump laser, depending on whether the dispersion experienced by the Raman laser is positive or negative. For a subluminal laser, corresponding to a positive dispersion with a group index that is much larger than unity, the shift in its frequency is approximately the same as that in the Raman pump laser. In contrast, for a superluminal laser, corresponding to a negative dispersion with a group index that is close to zero, its frequency shifts in the direction opposite to that of the Raman pump lasers, and has an amplitude that is larger by a factor approximately equaling the inverse of the group index. These findings would play a critical role in determining the maximum achievable sensitivity of sensors employing such lasers, especially under conditions where the pump laser linewidth is broadened significantly beyond the Schawlow-Townes linewidth due to classical fluctuations.


title: Knowledge Distillation of LLM for Automatic Scoring of Science Education Assessments

abstract: This study proposes a method for knowledge distillation (KD) of fine-tuned Large Language Models (LLMs) into smaller, more efficient, and accurate neural networks. We specifically target the challenge of deploying these models on resource-constrained devices. Our methodology involves training the smaller student model (Neural Network) using the prediction probabilities (as soft labels) of the LLM, which serves as a teacher model. This is achieved through a specialized loss function tailored to learn from the LLM's output probabilities, ensuring that the student model closely mimics the teacher's performance. To validate the performance of the KD approach, we utilized a large dataset, 7T, containing 6,684 student-written responses to science questions and three mathematical reasoning datasets with student-written responses graded by human experts. We compared accuracy with state-of-the-art (SOTA) distilled models, TinyBERT, and artificial neural network (ANN) models. Results have shown that the KD approach has 3% and 2% higher scoring accuracy than ANN and TinyBERT, respectively, and comparable accuracy to the teacher model. Furthermore, the student model size is 0.03M, 4,000 times smaller in parameters and x10 faster in inferencing than the teacher model and TinyBERT, respectively. The significance of this research lies in its potential to make advanced AI technologies accessible in typical educational settings, particularly for automatic scoring.


title: A New Framework for Bounding Reachability Probabilities of Continuous-time Stochastic Systems

abstract: This manuscript presents an innovative framework for constructing barrier functions to bound reachability probabilities for continuous-time stochastic systems described by stochastic differential equations (SDEs). The reachability probabilities considered in this paper encompass two aspects: the probability of reaching a set of specified states within a predefined finite time horizon, and the probability of reaching a set of specified states at a particular time instant. The barrier functions presented in this manuscript are developed either by relaxing a parabolic partial differential equation that characterizes the exact reachability probability or by applying the Gr\"onwall's inequality. In comparison to the prevailing construction method, which relies on Doob's non-negative supermartingale inequality (or Ville's inequality), the proposed barrier functions provide stronger alternatives, complement existing methods, or fill gaps.


title: Learning-To-Rank Approach for Identifying Everyday Objects Using a Physical-World Search Engine

abstract: Domestic service robots offer a solution to the increasing demand for daily care and support. A human-in-the-loop approach that combines automation and operator intervention is considered to be a realistic approach to their use in society. Therefore, we focus on the task of retrieving target objects from open-vocabulary user instructions in a human-in-the-loop setting, which we define as the learning-to-rank physical objects (LTRPO) task. For example, given the instruction "Please go to the dining room which has a round table. Pick up the bottle on it," the model is required to output a ranked list of target objects that the operator/user can select. In this paper, we propose MultiRankIt, which is a novel approach for the LTRPO task. MultiRankIt introduces the Crossmodal Noun Phrase Encoder to model the relationship between phrases that contain referring expressions and the target bounding box, and the Crossmodal Region Feature Encoder to model the relationship between the target object and multiple images of its surrounding contextual environment. Additionally, we built a new dataset for the LTRPO task that consists of instructions with complex referring expressions accompanied by real indoor environmental images that feature various target objects. We validated our model on the dataset and it outperformed the baseline method in terms of the mean reciprocal rank and recall@k. Furthermore, we conducted physical experiments in a setting where a domestic service robot retrieved everyday objects in a standardized domestic environment, based on users' instruction in a human--in--the--loop setting. The experimental results demonstrate that the success rate for object retrieval achieved 80%. Our code is available at https://github.com/keio-smilab23/MultiRankIt.


title: Optimal Decentralized Composite Optimization for Strongly Convex Functions

abstract: This paper concentrates on decentralized composite optimization for strongly convex functions. Decentralized optimization, renowned for its robustness to network variations and the absence of a central server communication bottleneck, has garnered considerable interest in signal processing, control, and optimization communities. Although numerous algorithms have been proposed for smooth and strongly convex objective functions in recent years, the development of an optimal algorithm that includes a non-smooth regularization term remains an unresolved challenge in decentralized optimization. This paper bridges the divide between smooth decentralized optimization and decentralized composite optimization, introducing the first algorithm capable of achieving optimal computational and communication complexities. Moreover, our experimental results substantiate the efficacy and efficiency of our algorithm in both computation and communication aspects.


title: Shell-shaped quantum droplet in a three-component ultracold Bose gas

abstract: We present a scheme to generate shell-shaped droplet in a three-component (1,2,3) ultracold Bose gas. Here binary mixtures (1,2) and (2,3) form quantum droplets due to inter-species attractions, and the two droplets are mutually immiscible due to strong 1-3 repulsion. Importantly, the shared component-2 serves as a glue to link the two droplets together as a globally self-bound object. In this system, the outer droplet naturally develops a shell structure, and its radius and width can be conveniently tuned through the size of core droplet. Moreover, to reach an equilibrium with the shell, the core droplet displays very different spin densities as compared to the vacuum case. These results have been demonstrated in a realistic $^{23}$Na-$^{39}$K-$^{41}$K mixture. Our scheme liberates the shell-shaped Bose gas from stringent conditions with microgravity or fine-tuned traps, and can be readily implemented in cold atoms laboratories on Earth. This paves the way for future exploration of quantum droplets in curved space with non-trivial real-space topologies.


title: Distributed Stochastic Optimization under Heavy-Tailed Noises

abstract: This paper studies the distributed optimization problem under the influence of heavy-tailed gradient noises. Here, a heavy-tailed noise means that the noise does not necessarily satisfy the bounded variance assumption. Instead, it satisfies a more general assumption. The commonly-used bounded variance assumption is a special case of the considered noise assumption. A typical example of this kind of noise is a Pareto distribution noise with tail index within (1,2], which has infinite variance. Despite that there has been several distributed optimization algorithms proposed for the heavy-tailed noise scenario, these algorithms need a centralized server in the network which collects the information of all clients. Different from these algorithms, this paper considers that there is no centralized server and the agents can only exchange information with neighbors in a communication graph. A distributed method combining gradient clipping and distributed stochastic subgradient projection is proposed. It is proven that when the gradient descent step-size and the gradient clipping step-size meet certain conditions, the state of each agent converges to the optimal solution of the distributed optimization problem with probability 1. The simulation results validate the algorithm.


title: Modality-Collaborative Transformer with Hybrid Feature Reconstruction for Robust Emotion Recognition

abstract: As a vital aspect of affective computing, Multimodal Emotion Recognition has been an active research area in the multimedia community. Despite recent progress, this field still confronts two major challenges in real-world applications: 1) improving the efficiency of constructing joint representations from unaligned multimodal features, and 2) relieving the performance decline caused by random modality feature missing. In this paper, we propose a unified framework, Modality-Collaborative Transformer with Hybrid Feature Reconstruction (MCT-HFR), to address these issues. The crucial component of MCT is a novel attention-based encoder which concurrently extracts and dynamically balances the intra- and inter-modality relations for all associated modalities. With additional modality-wise parameter sharing, a more compact representation can be encoded with less time and space complexity. To improve the robustness of MCT, we further introduce HFR which consists of two modules: Local Feature Imagination (LFI) and Global Feature Alignment (GFA). During model training, LFI leverages complete features as supervisory signals to recover local missing features, while GFA is designed to reduce the global semantic gap between pairwise complete and incomplete representations. Experimental evaluations on two popular benchmark datasets demonstrate that our proposed method consistently outperforms advanced baselines in both complete and incomplete data scenarios.


title: FODT: Fast, Online, Distributed and Temporary Failure Recovery Approach for MEC

abstract: Mobile edge computing (MEC) can reduce the latency of cloud computing successfully. However, the edge server may fail due to the hardware of software issues. When the edge server failure happens, the users who offload tasks to this server will be affected. How to recover the services for these affected users quickly and effectively is challenging. Moreover, considering that the server failure is continuous and temporary, and the failed server can be repaired, the previous works cannot handle this problem effectively. Therefore, in this paper, we propose the fast, online, distributed, and temporary failure recovery algorithm (FODT) for MEC. In FODT, when edge sever failure happens, only the affected APs recalculate their user-server allocation strategies and the other APs do not change their strategies. For the affected access points (Aps), the strategies before server failure are reused to reduce complexity and latency. When the failed server is repaired, the influenced APs reuse the strategies before server failure to offload task to this server. Based on this approach, the FODT can achieve better performance than previous works. To the best of knowledge, the FODT is the first failure recovery algorithm, and when compared with previous research, it has higher failure recovery efficiency and lower complexity with acceptable approximate ratio.


title: High Efficiency Inference Accelerating Algorithm for NOMA-based Mobile Edge Computing

abstract: Splitting the inference model between device, edge server, and cloud can improve the performance of EI greatly. Additionally, the non-orthogonal multiple access (NOMA), which is the key supporting technologies of B5G/6G, can achieve massive connections and high spectrum efficiency. Motivated by the benefits of NOMA, integrating NOMA with model split in MEC to reduce the inference latency further becomes attractive. However, the NOMA based communication during split inference has not been properly considered in previous works. Therefore, in this paper, we integrate the NOMA into split inference in MEC, and propose the effective communication and computing resource allocation algorithm to accelerate the model inference at edge. Specifically, when the mobile user has a large model inference task needed to be calculated in the NOMA-based MEC, it will take the energy consumption of both device and edge server and the inference latency into account to find the optimal model split strategy, subchannel allocation strategy (uplink and downlink), and transmission power allocation strategy (uplink and downlink). Since the minimum inference delay and energy consumption cannot be satisfied simultaneously, and the variables of subchannel allocation and model split are discrete, the gradient descent (GD) algorithm is adopted to find the optimal tradeoff between them. Moreover, the loop iteration GD approach (Li-GD) is proposed to reduce the complexity of GD algorithm that caused by the parameter discrete. Additionally, the properties of the proposed algorithm are also investigated, which demonstrate the effectiveness of the proposed algorithms.


title: Hypergraph Enhanced Knowledge Tree Prompt Learning for Next-Basket Recommendation

abstract: Next-basket recommendation (NBR) aims to infer the items in the next basket given the corresponding basket sequence. Existing NBR methods are mainly based on either message passing in a plain graph or transition modelling in a basket sequence. However, these methods only consider point-to-point binary item relations while item dependencies in real world scenarios are often in higher order. Additionally, the importance of the same item to different users varies due to variation of user preferences, and the relations between items usually involve various aspects. As pretrained language models (PLMs) excel in multiple tasks in natural language processing (NLP) and computer vision (CV), many researchers have made great efforts in utilizing PLMs to boost recommendation. However, existing PLM-based recommendation methods degrade when encountering Out-Of-Vocabulary (OOV) items. OOV items are those whose IDs are out of PLM's vocabulary and thus unintelligible to PLM. To settle the above challenges, we propose a novel method HEKP4NBR, which transforms the knowledge graph (KG) into prompts, namely Knowledge Tree Prompt (KTP), to help PLM encode the OOV item IDs in the user's basket sequence. A hypergraph convolutional module is designed to build a hypergraph based on item similarities measured by an MoE model from multiple aspects and then employ convolution on the hypergraph to model correlations among multiple items. Extensive experiments are conducted on HEKP4NBR on two datasets based on real company data and validate its effectiveness against multiple state-of-the-art methods.


title: A dual Yamabe flow and related integral flows

abstract: We study a family of nonlinear integral flows that involve Riesz potentials on Riemannian manifolds. In the Hardy-Littlewood-Sobolev (HLS) subcritical regime, we present a precise blow-up profile exhibited by the flows. In the HLS critical regime, by introducing a \textit{dual $Q$ curvature} we demonstrate the concentration-compactness phenomenon. If, in addition, the integral kernel matches with the Green's function of a conformally invariant elliptic operator, this critical flow can be considered as a dual Yamabe flow. Convergence is then established on the unit spheres, which is also valid on certain locally conformally flat manifolds.


title: Curricular and Cyclical Loss for Time Series Learning Strategy

abstract: Time series widely exists in real-world applications and many deep learning models have performed well on it. Current research has shown the importance of learning strategy for models, suggesting that the benefit is the order and size of learning samples. However, no effective strategy has been proposed for time series due to its abstract and dynamic construction. Meanwhile, the existing one-shot tasks and continuous tasks for time series necessitate distinct learning processes and mechanisms. No all-purpose approach has been suggested. In this work, we propose a novel Curricular and CyclicaL loss (CRUCIAL) to learn time series for the first time. It is model- and task-agnostic and can be plugged on top of the original loss with no extra procedure. CRUCIAL has two characteristics: It can arrange an easy-to-hard learning order by dynamically determining the sample contribution and modulating the loss amplitude; It can manage a cyclically changed dataset and achieve an adaptive cycle by correlating the loss distribution and the selection probability. We prove that compared with monotonous size, cyclical size can reduce expected error. Experiments on 3 kinds of tasks and 5 real-world datasets show the benefits of CRUCIAL for most deep learning models when learning time series.


title: LAMOST J040901.83+329355.6 -- a new Galactic star with Wolf--Rayet characteristics on a post-AGB to CSPN transitional stage

abstract: The similarity in physical conditions in winds of low-mass post-asymptotic giant branch stars and evolved massive stars leads to the appearance of an interesting phenomenon of spectral mimicry. Due to that the discovery of every new star with Wolf--Rayet spectrum requires special study of its evolutionary status before it may be included in the list of Galactic Wolf--Rayet (WR) stars. A couple of years ago LAMOST J040901.83+323955.6 (hereafter J0409+3239) was selected as a WR star in LAMOST spectroscopic database by machine learning methods. In this work we investigated its evolutionary status. Analyzing the spatial location of J0409+3239, in the Galaxy and its position in the color-magnitude diagram we concluded what J0409+3239, is instead a low mass object with WR phenomenon. Its luminosity is $L*=1000 L_\odot$ and effective temperature $T_{\rm eff}$=40,000 K. Using new and archival photometric data we detected irregular variability on time scales from hours to tens of days with amplitude up to $\approx0.2$ mag. Comparison of the spectrum obtained in 2022 with the one from 2014 also shows an evidence of spectral variability. The absence of clearly detected circumstellar nebula does not allow to classify J0409+3239, as [WR], i.e. a central star of planetary nebula (CSPN). However, its position in Hertzsprung--Russell diagram suggests that J0409+3239, is a low mass star caught in rare transitional phase to CSPN. Estimation of J0409+3239, mass based on evolutionary tracks shows that it is less than $0.9~M_\odot$, and thus the age of the Galaxy is barely enough for the star to evolve to its current stage.


title: Geometric-Aware Low-Light Image and Video Enhancement via Depth Guidance

abstract: Low-Light Enhancement (LLE) is aimed at improving the quality of photos/videos captured under low-light conditions. It is worth noting that most existing LLE methods do not take advantage of geometric modeling. We believe that incorporating geometric information can enhance LLE performance, as it provides insights into the physical structure of the scene that influences illumination conditions. To address this, we propose a Geometry-Guided Low-Light Enhancement Refine Framework (GG-LLERF) designed to assist low-light enhancement models in learning improved features for LLE by integrating geometric priors into the feature representation space. In this paper, we employ depth priors as the geometric representation. Our approach focuses on the integration of depth priors into various LLE frameworks using a unified methodology. This methodology comprises two key novel modules. First, a depth-aware feature extraction module is designed to inject depth priors into the image representation. Then, Hierarchical Depth-Guided Feature Fusion Module (HDGFFM) is formulated with a cross-domain attention mechanism, which combines depth-aware features with the original image features within the LLE model. We conducted extensive experiments on public low-light image and video enhancement benchmarks. The results illustrate that our designed framework significantly enhances existing LLE methods.


title: SERF: Fine-Grained Interactive 3D Segmentation and Editing with Radiance Fields

abstract: Although significant progress has been made in the field of 2D-based interactive editing, fine-grained 3D-based interactive editing remains relatively unexplored. This limitation can be attributed to two main challenges: the lack of an efficient 3D representation robust to different modifications and the absence of an effective 3D interactive segmentation method. In this paper, we introduce a novel fine-grained interactive 3D segmentation and editing algorithm with radiance fields, which we refer to as SERF. Our method entails creating a neural mesh representation by integrating multi-view algorithms with pre-trained 2D models. Building upon this representation, we introduce a novel surface rendering technique that preserves local information and is robust to deformation. Moreover, this representation forms the basis for achieving accurate and interactive 3D segmentation without requiring 3D supervision. Harnessing this representation facilitates a range of interactive 3D editing operations, encompassing tasks such as interactive geometry editing and texture painting. Extensive experiments and visualization examples of editing on both real and synthetic data demonstrate the superiority of our method on representation quality and editing ability.


title: Law of the logarithm for the maximum interpoint distance constructed by high-dimensional random matrix

abstract: Suppose $\left \{ X_{i,k}; 1\le i \le p, 1\le k \le n \right \} $ is an array of i.i.d.~real random variables. Let $\left \{ p=p_{n}; n \ge1 \right \} $ be positive integers. Consider the maximum interpoint distance $M_{n}=\max_{1\le i< j\le p} \left \| \boldsymbol{X}_{i}- \boldsymbol{X}_{j} \right \|_{2} $ where $\boldsymbol{X}_{i}$ and $\boldsymbol{X}_{j}$ denote the $i$-th and $j$-th rows of the $p \times n$ matrix $\mathcal{M} _{p,n}=\left( X_{i,k} \right)_{p \times n}$, respectively. This paper shows the laws of the logarithm for $M_{n}$ under two high-dimensional settings: the polynomial rate and the exponential rate. The proofs rely on the moderation deviation principle of the partial sum of i.i.d.~random variables, the Chen--Stein Poisson approximation method and Gaussian approximation.


title: Learning Online Policies for Person Tracking in Multi-View Environments

abstract: In this paper, we introduce MVSparse, a novel and efficient framework for cooperative multi-person tracking across multiple synchronized cameras. The MVSparse system is comprised of a carefully orchestrated pipeline, combining edge server-based models with distributed lightweight Reinforcement Learning (RL) agents operating on individual cameras. These RL agents intelligently select informative blocks within each frame based on historical camera data and detection outcomes from neighboring cameras, significantly reducing computational load and communication overhead. The edge server aggregates multiple camera views to perform detection tasks and provides feedback to the individual agents. By projecting inputs from various perspectives onto a common ground plane and applying deep detection models, MVSparse optimally leverages temporal and spatial redundancy in multi-view videos. Notably, our contributions include an empirical analysis of multi-camera pedestrian tracking datasets, the development of a multi-camera, multi-person detection pipeline, and the implementation of MVSparse, yielding impressive results on both open datasets and real-world scenarios. Experimentally, MVSparse accelerates overall inference time by 1.88X and 1.60X compared to a baseline approach while only marginally compromising tracking accuracy by 2.27% and 3.17%, respectively, showcasing its promising potential for efficient multi-camera tracking applications.


title: SCPMan: Shape Context and Prior Constrained Multi-scale Attention Network for Pancreatic Segmentation

abstract: Due to the poor prognosis of Pancreatic cancer, accurate early detection and segmentation are critical for improving treatment outcomes. However, pancreatic segmentation is challenged by blurred boundaries, high shape variability, and class imbalance. To tackle these problems, we propose a multiscale attention network with shape context and prior constraint for robust pancreas segmentation. Specifically, we proposed a Multi-scale Feature Extraction Module (MFE) and a Mixed-scale Attention Integration Module (MAI) to address unclear pancreas boundaries. Furthermore, a Shape Context Memory (SCM) module is introduced to jointly model semantics across scales and pancreatic shape. Active Shape Model (ASM) is further used to model the shape priors. Experiments on NIH and MSD datasets demonstrate the efficacy of our model, which improves the state-of-the-art Dice Score for 1.01% and 1.03% respectively. Our architecture provides robust segmentation performance, against the blurry boundaries, and variations in scale and shape of pancreas.


title: Number of Scatterings in Random Walks

abstract: This paper investigates the number of scatterings a photon undergoes in random walks before escaping from a medium. The number of scatterings in random walk processes is commonly approximated as $\tau+\tau^2$ in the literature, where $\tau$ is the optical thickness measured from the center of the medium. However, it is found that this formula is not accurate. In this study, analytical solutions in sphere and slab geometries are derived for both optically thin and optically thick limits, assuming isotropic scattering. These solutions are verified using Monte Carlo simulations. In the optically thick limit, the number of scatterings is found to be $0.5\tau^2$ and $1.5\tau^2$ in a sphere and slab, respectively. In the optically thin limit, the number of scatterings is $\approx\tau$ in a sphere and $\approx\tau(1-\gamma-\ln\tau+\tau)$ in a slab, where $\gamma\simeq 0.57722$ is the Euler-Mascheroni constant. Additionally, we present approximate formulas that reasonably reproduce the simulation results well in intermediate optical depths. These results are applicable to scattering processes that exhibit forward and backward symmetry, including both isotropic and Thomson scattering.


title: Towards Squeezing-Averse Virtual Try-On via Sequential Deformation

abstract: In this paper, we first investigate a visual quality degradation problem observed in recent high-resolution virtual try-on approach. The tendency is empirically found that the textures of clothes are squeezed at the sleeve, as visualized in the upper row of Fig.1(a). A main reason for the issue arises from a gradient conflict between two popular losses, the Total Variation (TV) and adversarial losses. Specifically, the TV loss aims to disconnect boundaries between the sleeve and torso in a warped clothing mask, whereas the adversarial loss aims to combine between them. Such contrary objectives feedback the misaligned gradients to a cascaded appearance flow estimation, resulting in undesirable squeezing artifacts. To reduce this, we propose a Sequential Deformation (SD-VITON) that disentangles the appearance flow prediction layers into TV objective-dominant (TVOB) layers and a task-coexistence (TACO) layer. Specifically, we coarsely fit the clothes onto a human body via the TVOB layers, and then keep on refining via the TACO layer. In addition, the bottom row of Fig.1(a) shows a different type of squeezing artifacts around the waist. To address it, we further propose that we first warp the clothes into a tucked-out shirts style, and then partially erase the texture from the warped clothes without hurting the smoothness of the appearance flows. Experimental results show that our SD-VITON successfully resolves both types of artifacts and outperforms the baseline methods. Source code will be available at https://github.com/SHShim0513/SD-VITON.


title: Discovery of a topological exciton insulator with tunable momentum order

abstract: Topology and correlations are fundamental concepts in modern physics, but their simultaneous occurrence within a single quantum phase is exceptionally rare. In this study, we present the discovery of such a phase of matter in Ta2Pd3Te5, a semimetal where the Coulomb interaction between electrons and holes leads to the spontaneous formation of excitonic bound states below T=100 K. Our spectroscopy unveils the development of an insulating gap stemming from the condensation of these excitons, thus giving rise to a highly sought-after correlated quantum phase known as the excitonic insulator. Remarkably, our scanning tunneling microscopy measurements reveal the presence of gapless boundary modes in the excitonic insulator state. Their magnetic field response and our theoretical calculations suggest a topological origin of these modes, rendering Ta2Pd3Te5 as the first experimentally identified topological excitonic insulator in a three-dimensional material not masked by any structural phase transition. Furthermore, our study uncovers a secondary excitonic instability below T=5 K, which differs from the primary one in having finite momentum. We observe unprecedented tunability of its wavevector by an external magnetic field. These findings unlock a frontier in the study of novel correlated topological phases of matter and their tunability.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.mtrl-sci quant-ph


title: PDiT: Interleaving Perception and Decision-making Transformers for Deep Reinforcement Learning

abstract: Designing better deep networks and better reinforcement learning (RL) algorithms are both important for deep RL. This work studies the former. Specifically, the Perception and Decision-making Interleaving Transformer (PDiT) network is proposed, which cascades two Transformers in a very natural way: the perceiving one focuses on \emph{the environmental perception} by processing the observation at the patch level, whereas the deciding one pays attention to \emph{the decision-making} by conditioning on the history of the desired returns, the perceiver's outputs, and the actions. Such a network design is generally applicable to a lot of deep RL settings, e.g., both the online and offline RL algorithms under environments with either image observations, proprioception observations, or hybrid image-language observations. Extensive experiments show that PDiT can not only achieve superior performance than strong baselines in different settings but also extract explainable feature representations. Our code is available at \url{https://github.com/maohangyu/PDiT}.


title: BalMCTS: Balancing Objective Function and Search Nodes in MCTS for Constraint Optimization Problems

abstract: Constraint Optimization Problems (COP) pose intricate challenges in combinatorial problems usually addressed through Branch and Bound (B\&B) methods, which involve maintaining priority queues and iteratively selecting branches to search for solutions. However, conventional approaches take a considerable amount of time to find optimal solutions, and it is also crucial to quickly identify a near-optimal feasible solution in a shorter time. In this paper, we aim to investigate the effectiveness of employing a depth-first search algorithm for solving COP, specifically focusing on identifying optimal or near-optimal solutions within top $n$ solutions. Hence, we propose a novel heuristic neural network algorithm based on MCTS, which, by simultaneously conducting search and training, enables the neural network to effectively serve as a heuristic during Backtracking. Furthermore, our approach incorporates encoding COP problems and utilizing graph neural networks to aggregate information about variables and constraints, offering more appropriate variables for assignments. Experimental results on stochastic COP instances demonstrate that our method identifies feasible solutions with a gap of less than 17.63% within the initial 5 feasible solutions. Moreover, when applied to attendant Constraint Satisfaction Problem (CSP) instances, our method exhibits a remarkable reduction of less than 5% in searching nodes compared to state-of-the-art approaches.


title: Mental Perception of Quality: Green Marketing as a Catalyst for Brand Quality Enhancement

abstract: The environmental conservation issue has led consumers to rethink the products they purchase. Nowadays, many consumers are willing to pay more for products that genuinely adhere to environmental standards to support the environment. Consequently, concepts like green marketing have gradually infiltrated marketing literature, making environmental considerations one of the most important activities for companies. Accordingly, this research investigates the impacts of green marketing strategy on perceived brand quality (case study: food exporting companies). The study population comprises 345 employees and managers from companies such as Kalleh, Solico, Pemina, Sorbon, Mac, Pol, and Casel. Using Cochran's formula, a sample of 182 individuals was randomly selected. This research is practical; the required data were collected through surveys and questionnaires. The findings indicate that (1) green marketing strategy has a significant positive effect on perceived brand quality, (2) green products have a significant positive effect on perceived brand quality, (3) green promotion has a significant positive effect on perceived brand quality, (4) green distribution has a significant positive effect on perceived brand quality, and (5) green pricing has a significant positive effect on perceived brand quality.


title: Sharp bound for embedded eigenvalues of Dirac operators with decaying potentials

abstract: We study eigenvalues of the Dirac operator with canonical form \begin{equation} L_{p,q} \begin{pmatrix} u \\ v \end{pmatrix}= \begin{pmatrix} 0 & -1 \\ 1 & 0 \end{pmatrix}\frac{d}{dt} \begin{pmatrix} u \\ v \end{pmatrix}+\begin{pmatrix} -p & q \\ q & p \end{pmatrix}\begin{pmatrix} u \\ v \end{pmatrix},\nonumber \end{equation} where $ p$ and $q$ are real functions. Under the assumption that \begin{equation} \limsup_{x\to \infty}x\sqrt{p^2(x)+q^2(x)}<\infty,\nonumber \end{equation} the essential spectrum of $L_{p,q}$ is $(-\infty,\infty)$. We prove that $L_{p,q}$ has no eigenvalues if $$\limsup_{x\to \infty}x\sqrt{p^2(x)+q^2(x)}<\frac{1}{2}.$$ Given any $A\geq \frac{1}{2}$ and any $\lambda\in\R$, we construct functions $p$ and $q$ such that $\limsup_{x\to \infty}x\sqrt{p^2(x)+q^2(x)}=A$ and $\lambda$ is an eigenvalue of the corresponding Dirac operator $L_{p,q}$. We also construct functions $p$ and $q$ so that the corresponding Dirac operator $L_{p,q}$ has any prescribed set {(finitely or countably many)} of eigenvalues.


title: Punctuation Matters! Stealthy Backdoor Attack for Language Models

abstract: Recent studies have pointed out that natural language processing (NLP) models are vulnerable to backdoor attacks. A backdoored model produces normal outputs on the clean samples while performing improperly on the texts with triggers that the adversary injects. However, previous studies on textual backdoor attack pay little attention to stealthiness. Moreover, some attack methods even cause grammatical issues or change the semantic meaning of the original texts. Therefore, they can easily be detected by humans or defense systems. In this paper, we propose a novel stealthy backdoor attack method against textual models, which is called \textbf{PuncAttack}. It leverages combinations of punctuation marks as the trigger and chooses proper locations strategically to replace them. Through extensive experiments, we demonstrate that the proposed method can effectively compromise multiple models in various tasks. Meanwhile, we conduct automatic evaluation and human inspection, which indicate the proposed method possesses good performance of stealthiness without bringing grammatical issues and altering the meaning of sentences.


title: Video Frame Interpolation with Region-Distinguishable Priors from SAM

abstract: In existing Video Frame Interpolation (VFI) approaches, the motion estimation between neighboring frames plays a crucial role. However, the estimation accuracy in existing methods remains a challenge, primarily due to the inherent ambiguity in identifying corresponding areas in adjacent frames for interpolation. Therefore, enhancing accuracy by distinguishing different regions before motion estimation is of utmost importance. In this paper, we introduce a novel solution involving the utilization of open-world segmentation models, e.g., SAM (Segment Anything Model), to derive Region-Distinguishable Priors (RDPs) in different frames. These RDPs are represented as spatial-varying Gaussian mixtures, distinguishing an arbitrary number of areas with a unified modality. RDPs can be integrated into existing motion-based VFI methods to enhance features for motion estimation, facilitated by our designed play-and-plug Hierarchical Region-aware Feature Fusion Module (HRFFM). HRFFM incorporates RDP into various hierarchical stages of VFI's encoder, using RDP-guided Feature Normalization (RDPFN) in a residual learning manner. With HRFFM and RDP, the features within VFI's encoder exhibit similar representations for matched regions in neighboring frames, thus improving the synthesis of intermediate frames. Extensive experiments demonstrate that HRFFM consistently enhances VFI performance across various scenes.


title: Medical Report Generation based on Segment-Enhanced Contrastive Representation Learning

abstract: Automated radiology report generation has the potential to improve radiology reporting and alleviate the workload of radiologists. However, the medical report generation task poses unique challenges due to the limited availability of medical data and the presence of data bias. To maximize the utility of available data and reduce data bias, we propose MSCL (Medical image Segmentation with Contrastive Learning), a framework that utilizes the Segment Anything Model (SAM) to segment organs, abnormalities, bones, etc., and can pay more attention to the meaningful ROIs in the image to get better visual representations. Then we introduce a supervised contrastive loss that assigns more weight to reports that are semantically similar to the target while training. The design of this loss function aims to mitigate the impact of data bias and encourage the model to capture the essential features of a medical image and generate high-quality reports. Experimental results demonstrate the effectiveness of our proposed model, where we achieve state-of-the-art performance on the IU X-Ray public dataset.


title: Generalized Einstein-Rosen bridge inside black holes

abstract: We generalize the notion of Einstein-Rosen bridge by defining it as a space-like connection between two universes with regions of asymptotically minkowskian space-time infinities. The corresponding symmetry and asymmetry properties of the generalized Einstein-Rosen bridge are considered at the cases of Reissner-Nordstr\"om and Kerr metrics. We elucidate the versatility of intriguing symmetry and asymmetry phenomena outside and inside black holes. For description of the test particle (planet and photon) motion it is used the Kerr-Newman metric of the rotating and electrically charged black hole. In particular, it is demonstrated the symmetry and asymmetry of the one-way Einstein-Rosen bridge inside black hole toward and through the plethora of endless and infinite universes.


title: Option pricing under stochastic volatility on a quantum computer

abstract: We develop quantum algorithms for pricing Asian and barrier options under the Heston model, a popular stochastic volatility model, and estimate their costs, in terms of T-count, T-depth and number of logical qubits, on instances under typical market conditions. These algorithms are based on combining well-established numerical methods for stochastic differential equations and quantum amplitude estimation technique. In particular, we empirically show that, despite its simplicity, weak Euler method achieves the same level of accuracy as the better-known strong Euler method in this task. Furthermore, by eliminating the expensive procedure of preparing Gaussian states, the quantum algorithm based on weak Euler scheme achieves drastically better efficiency than the one based on strong Euler scheme. Our resource analysis suggests that option pricing under stochastic volatility is a promising application of quantum computers, and that our algorithms render the hardware requirement for reaching practical quantum advantage in financial applications less stringent than prior art.


title: Heterogeneous Encoders Scaling In The Transformer For Neural Machine Translation

abstract: Although the Transformer is currently the best-performing architecture in the homogeneous configuration (self-attention only) in Neural Machine Translation, many State-of-the-Art models in Natural Language Processing are made of a combination of different Deep Learning approaches. However, these models often focus on combining a couple of techniques only and it is unclear why some methods are chosen over others. In this work, we investigate the effectiveness of integrating an increasing number of heterogeneous methods. Based on a simple combination strategy and performance-driven synergy criteria, we designed the Multi-Encoder Transformer, which consists of up to five diverse encoders. Results showcased that our approach can improve the quality of the translation across a variety of languages and dataset sizes and it is particularly effective in low-resource languages where we observed a maximum increase of 7.16 BLEU compared to the single-encoder model.


title: Investigating Inter-Satellite Link Spanning Patterns on Networking Performance in Mega-constellations

abstract: Low Earth orbit (LEO) mega-constellations rely on inter-satellite links (ISLs) to provide global connectivity. We note that in addition to the general constellation parameters, the ISL spanning patterns are also greatly influence the final network structure and thus the network performance. In this work, we formulate the ISL spanning patterns, apply different patterns to mega-constellation and generate multiple structures. Then, we delve into the performance estimation of these networks, specifically evaluating network capacity, throughput, latency, and routing path stretch. The experimental findings provide insights into the optimal network structure under diverse conditions, showcasing superior performance when compared to alternative network configurations.


title: Lower Bounds for Set-Multilinear Branching Programs

abstract: In this paper, we prove super-polynomial lower bounds for the model of \emph{sum of ordered set-multilinear algebraic branching programs}, each with a possibly different ordering ($\sum \mathsf{smABP}$). Specifically, we give an explicit $nd$-variate polynomial of degree $d$ such that any $\sum \mathsf{smABP}$ computing it must have size $n^{\omega(1)}$ for $d$ as low as $\omega(\log n)$. Notably, this constitutes the first such lower bound in the low degree regime. Moreover, for $d = \poly(n)$, we demonstrate an exponential lower bound. This result generalizes the seminal work of Nisan (STOC, 1991), which proved an exponential lower bound for a single ordered set-multilinear ABP. The significance of our lower bounds is underscored by the recent work of Bhargav, Dwivedi, and Saxena (to appear in TAMC, 2024), which showed that super-polynomial lower bounds against a sum of ordered set-multilinear branching programs -- for a polynomial of sufficiently low degree -- would imply super-polynomial lower bounds against general ABPs, thereby resolving Valiant's longstanding conjecture that the permanent polynomial can not be computed efficiently by ABPs. More precisely, their work shows that if one could obtain such lower bounds when the degree is bounded by $O(\log n/ \log \log n)$, then it would imply super-polynomial lower bounds against general ABPs. Our results strengthen the works of Arvind \& Raja (Chic. J. Theor. Comput. Sci., 2016) and Bhargav, Dwivedi \& Saxena (to appear in TAMC, 2024), as well as the works of Ramya \& Rao (Theor. Comput. Sci., 2020) and Ghoshal \& Rao (International Computer Science Symposium in Russia, 2021), each of which established lower bounds for related or restricted versions of this model. They also strongly answer a question from the former two, which asked to prove super-polynomial lower bounds for general $\sum \mathsf{smABP}$.


title: Search for crucial events in physiological processes

abstract: The main purpose of this paper is to attract the attention of researchers working in the field of physiological processes, towards crucial events. Crucial events are often confused with extreme events thereby generating the misleading impression that their treatment should be based on quantum mechanical formalism. We show that crucial events are invisible and should not be confused with catastrophes. Crucial events are generated by self-organization processes yielding a form of swarm intelligence, and signal their action with fluctuations characterized by anomalous scaling and 1/f spectrum. The existence or the lack of crucial events can be revealed with an entropic method of analysis called the Diffusion Entropy Analysis (DEA). However, anomalous scaling and 1/f spectrum are not a compelling signature of efficient self-organization, and physiological processes with anomalous scaling and 1/f noise spectrum without crucial events are a signature of collapsing physiological organizations. In the case of physiological processes like cancer dynamics, the existence of crucial events is a signal of intelligence that must be destroyed rather than reinforced.


title: On decomposition of neighborhood of a circular cone related to principal curvatures

abstract: We give an alternative proof of a result on the uniform overlap of the algebraic sums of the sets arising from a decomposition of a neighborhood of a circular cone in $\Bbb R^3$. It is known that the uniform overlap result can be applied to make a unified approach for the proofs of a theorem on the maximal Bochner-Riesz operator on $\Bbb R^2$ and a theorem on the maximal spherical means on $\Bbb R^2$.


title: PBCounter: Weighted Model Counting on Pseudo-Boolean Formulas

abstract: In Weighted Model Counting (WMC), we assign weights to literals and compute the sum of the weights of the models of a given propositional formula where the weight of an assignment is the product of the weights of its literals. The current WMC solvers work on Conjunctive Normal Form (CNF) formulas. However, CNF is not a natural representation for human-being in many applications. Motivated by the stronger expressive power of pseudo-Boolean (PB) formulas than CNF, we propose to perform WMC on PB formulas. Based on a recent dynamic programming algorithm framework called ADDMC for WMC, we implement a weighted PB counting tool PBCounter. We compare PBCounter with the state-of-the-art weighted model counters SharpSAT-TD, ExactMC, D4, and ADDMC, where the latter tools work on CNF with encoding methods that convert PB constraints into a CNF formula. The experiments on three domains of benchmarks show that PBCounter is superior to the model counters on CNF formulas.


title: Collisions of Majorana Zero Modes

abstract: We investigate the collisions of Majorana zero modes, which are presented as inter-soliton collisional events in fermionic superfluids with spin-orbit coupling. Our results demonstrate that, the zero energy splitting, induced by the overlapping of inter-soliton Majorana wave-functions upon collision, generates an effective repulsive force for Majorana states, which in turn protected themselves against into bulk excitation. As a result, the collision between solitons associated with Majorana zero modes appears to be repulsive and elastic, as they do not penetrate each other but instead repel without energy loss. As well, similar repulsive behavior is observed in collisions between soliton-induced and defect-pinned Majorana zero modes. Our research offers new insights into the features of Majorana fermions, and robustness in the collisions of Majorana zero modes bodes well for the prospects of topological quantum computation with a multitude of Majorana qubits.


title: Optimal estimates for mappings admitting general Poisson representations in the unit ball

abstract: Suppose that $1<p\leq\infty$ and $\varphi\in L^{p}(\mathbb{B}^{n},\mathbb{R}^{n}).$ In this note, we use H\"{o}lder inequality and some basic properties of hypergeometric functions to establish the sharp constant $C_{p}$ and function $C_{p}(x)$ in the following inequalities $$|u(x)|\leq \frac{C_{p}}{(1-|x|^{2})^{(n-1)/p}}\cdot||\varphi||_{L^{p}}$$ and $$|u(x)|\leq \frac{C_{p}(x)}{(1-|x|^{2})^{(n-1)/p}}\cdot||\varphi||_{L^{p}},$$ where $u$ are those mapping from the unit ball $\mathbb{B}^{n}$ into $\mathbb{R}^{n}$ admitting general Poisson representations. The obtained results generalize and extend some known results from harmonic mappings (\cite[Proposition 6.16]{ABR92} and \cite[Theorems 1.1 and 1.2]{DM12}) and hyperbolic harmonic mappings (\cite[Theorems 1.1 and 1.2]{CJLK20}).


title: KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graph

abstract: Large language model (LLM) has achieved outstanding performance on various downstream tasks with its powerful natural language understanding and zero-shot capability, but LLM still suffers from knowledge limitation. Especially in scenarios that require long logical chains or complex reasoning, the hallucination and knowledge limitation of LLM limit its performance in question answering (QA). In this paper, we propose a novel framework KnowledgeNavigator to address these challenges by efficiently and accurately retrieving external knowledge from knowledge graph and using it as a key factor to enhance LLM reasoning. Specifically, KnowledgeNavigator first mines and enhances the potential constraints of the given question to guide the reasoning. Then it retrieves and filters external knowledge that supports answering through iterative reasoning on knowledge graph with the guidance of LLM and the question. Finally, KnowledgeNavigator constructs the structured knowledge into effective prompts that are friendly to LLM to help its reasoning. We evaluate KnowledgeNavigator on multiple public KGQA benchmarks, the experiments show the framework has great effectiveness and generalization, outperforming previous knowledge graph enhanced LLM methods and is comparable to the fully supervised models.


title: Attention-aware Social Graph Transformer Networks for Stochastic Trajectory Prediction

abstract: Trajectory prediction is fundamental to various intelligent technologies, such as autonomous driving and robotics. The motion prediction of pedestrians and vehicles helps emergency braking, reduces collisions, and improves traffic safety. Current trajectory prediction research faces problems of complex social interactions, high dynamics and multi-modality. Especially, it still has limitations in long-time prediction. We propose Attention-aware Social Graph Transformer Networks for multi-modal trajectory prediction. We combine Graph Convolutional Networks and Transformer Networks by generating stable resolution pseudo-images from Spatio-temporal graphs through a designed stacking and interception method. Furthermore, we design the attention-aware module to handle social interaction information in scenarios involving mixed pedestrian-vehicle traffic. Thus, we maintain the advantages of the Graph and Transformer, i.e., the ability to aggregate information over an arbitrary number of neighbors and the ability to perform complex time-dependent data processing. We conduct experiments on datasets involving pedestrian, vehicle, and mixed trajectories, respectively. Our results demonstrate that our model minimizes displacement errors across various metrics and significantly reduces the likelihood of collisions. It is worth noting that our model effectively reduces the final displacement error, illustrating the ability of our model to predict for a long time.


title: Optical absorption tensors based on C$_{70}$ trimers and polymers

abstract: The optical absorption spectrum of $C_{60}$-dimers and polymers was investigated by Kikuo et al. in 1996\cite{harigaya1996charge}. As a compliment to these earlier studies, the optical absorption spectrum of the $C_{70}$ fullerene has been investigated in the present study. The main purpose was then to compare the absorption spectrum of the $C_{70}$-dimers and trimers and, more specifically, to clarify the effect of these molecular structures on the absorption spectrum. What is most important and decisive is then the value of the conjugation parameter of these $C_{70}$-based molecules. In the present study, a tight-binding model was used in calculating the optical absorption spectra of both $C_{70}$ dimers and polymers, as well as $C_{70}$ trimers and polymers. The change in conjugation parameter for each of these species was found to cause variations in the corresponding optical absorption spectrum. It was found that the absorption tensor of the $C_{70}$ trimer and the polymer was, depending on the value of the conjugation parameters $b=0.5$ and $b=0.8$. The situation was almost the same for the conjugation parameters $b=0.1$ and $b=0.2$. In addition, the value of the band gap was also different depending on the different conjugation parameters, with a reduced value for the larger values of this parameter. As a conclusion, smaller values of the conjugation parameter were not found to have a large effect on the absorption spectrum of the $C_{70}$-dimers and trimers, or in other words, the effect was hardly visible. On the contrary, the larger values caused a drastic change in the optical absorption spectrum of the $C_{70}$-dimers and trimers.


title: HyKGE: A Hypothesis Knowledge Graph Enhanced Framework for Accurate and Reliable Medical LLMs Responses

abstract: In this paper, we investigate the retrieval-augmented generation (RAG) based on Knowledge Graphs (KGs) to improve the accuracy and reliability of Large Language Models (LLMs). Recent approaches suffer from insufficient and repetitive knowledge retrieval, tedious and time-consuming query parsing, and monotonous knowledge utilization. To this end, we develop a Hypothesis Knowledge Graph Enhanced (HyKGE) framework, which leverages LLMs' powerful reasoning capacity to compensate for the incompleteness of user queries, optimizes the interaction process with LLMs, and provides diverse retrieved knowledge. Specifically, HyKGE explores the zero-shot capability and the rich knowledge of LLMs with Hypothesis Outputs to extend feasible exploration directions in the KGs, as well as the carefully curated prompt to enhance the density and efficiency of LLMs' responses. Furthermore, we introduce the HO Fragment Granularity-aware Rerank Module to filter out noise while ensuring the balance between diversity and relevance in retrieved knowledge. Experiments on two Chinese medical multiple-choice question datasets and one Chinese open-domain medical Q&A dataset with two LLM turbos demonstrate the superiority of HyKGE in terms of accuracy and explainability.


title: The MSSM compatibility with the limit on electron electric dipole moment

abstract: The minimal supersymmetric standard model (MSSM) particles can generate loop-level radiative corrections that contribute to the electric dipole moment (EDM) of an electron. The upper bound on the EDM can therefore be used for delineating the MSSM parameters space. We use this setting to describe a direction of particle physics phenomenology research -- the global fits of particle physics models beyond the standard model. This is done within the context of the MSSM phenomenology framework with thirty free parameters (MSSM30). Using samples of MSSM30 parameter-space points constrained with the latest bound on the electron EDM, we show that Arg(mu M2) is the most constrained MSSM CP-violating phase. The EDM-compatible parameter regions feature multi-TeV pseudoscalar Higgs bosons and relatively lower "tan beta" values compared to previous analyses.


title: Binary Black Hole Coalescence Phenomenology from Numerical Relativity

abstract: The major source of ground-based gravitational wave detectors, the inspiral and merger of comparable mass binary black holes (BBH), consists of a slow quasicircular inspiral, a merger to form a single remnant hole, and the quasinormal ringing of that remnant. The first and last of these epochs are amenable to well developed and familiar approximations: Newtonian or post-Newtonian for the first, and BH perturbation methods for the last. Ironically, the middle epoch, the merger, generates most of the GW emission, yet has been accessible so far only to numerical relativity. Here we add the close-limit approximation for the phenomenology of the merger. With the completed set of methods (Newtonian/post-Newtonian; close limit; BH perturbation theory) we show that not only can we understand the results of BBH coalescence, but - with reasonable accuracy - we can {\it predict} the resulting radiation and remnant.


title: Factorial Moments of the Geometric Distribution of Order $k$

abstract: We derive a simple expression for the $r^{th}$ factorial moment $\mu_{(r)}$ of the geometric distribution of order $k$ with success parameter $p\in(0,1)$ (and $q=1-p$) in terms of its probability mass function $f_k(n)$. Specifically, $\mu_{(r)} = r!f_k((r+1)k+r)/((qp^k)^{r+1})$.


title: Homogenization of the first initial-boundary value problem for periodic hyperbolic systems. Principal term of approximation

abstract: Let $\mathcal{O}\subset \mathbb{R}^d$ be a bounded domain of class $C^{1,1}$. In $ L_2(\mathcal{O};\mathbb{C}^n)$, we consider a matrix elliptic second order differential operator $A_{D,\varepsilon}$ with the Dirichlet boundary condition. Here $\varepsilon >0$ is a small parameter. The coefficients of the operator $A_{D,\varepsilon}$ are periodic and depend on $\mathbf{x}/\varepsilon$. The principal terms of approximations for the operator cosine and sine functions are given in the $(H^2\rightarrow L_2)$- and $(H^1\rightarrow L_2)$-operator norms, respectively. The error estimates are of the precise order $O(\varepsilon)$ for a fixed time. The results in operator terms are derived from the quantitative homogenization estimate for approximation of the solution of the initial-boundary value problem for the equation $(\partial _t^2+A_{D,\varepsilon})\mathbf{u}_\varepsilon =\mathbf{F}$.


title: The Construction Problem of Algebraic Potentials and Reflection Groups

abstract: This paper has two aims. The first one is the construction problem of algebraic potentials of Frobenius manifolds. We show examples of such potentials for the cases of reflection groups of types $H_4,E_6,E_7,E_8$ and also include those which are already known. The second one is an application of such potentials to singularity theory. We introduce families of hypersurfaces of ${\bf C}^3$ which are deformations of $E_n$-singularities $(n=6,7,8)$ but are not the versal families of $E_n$-singularities. We study the properties of the families. In particular we show the correspondence between such families and the algebraic potentials constructed in the first aim. Moreover we discuss the relationship between the complex reflection groups $ST33$ and $ST34$ and the two families corresponding to the $E_6$-singularity and the $E_7$-singularity.


title: ANN vs SNN: A case study for Neural Decoding in Implantable Brain-Machine Interfaces

abstract: While it is important to make implantable brain-machine interfaces (iBMI) wireless to increase patient comfort and safety, the trend of increased channel count in recent neural probes poses a challenge due to the concomitant increase in the data rate. Extracting information from raw data at the source by using edge computing is a promising solution to this problem, with integrated intention decoders providing the best compression ratio. In this work, we compare different neural networks (NN) for motor decoding in terms of accuracy and implementation cost. We further show that combining traditional signal processing techniques with machine learning ones deliver surprisingly good performance even with simple NNs. Adding a block Bidirectional Bessel filter provided maximum gains of $\approx 0.05$, $0.04$ and $0.03$ in $R^2$ for ANN\_3d, SNN\_3D and ANN models, while the gains were lower ($\approx 0.02$ or less) for LSTM and SNN\_streaming models. Increasing training data helped improve the $R^2$ of all models by $0.03-0.04$ indicating they have more capacity for future improvement. In general, LSTM and SNN\_streaming models occupy the high and low ends of the pareto curves (for accuracy vs. memory/operations) respectively while SNN\_3D and ANN\_3D occupy intermediate positions. Our work presents state of the art results for this dataset and paves the way for decoder-integrated-implants of the future.


title: Towards Robust Multimodal Prompting With Missing Modalities

abstract: Recently, multimodal prompting, which introduces learnable missing-aware prompts for all missing modality cases, has exhibited impressive performance. However, it encounters two critical issues: 1) The number of prompts grows exponentially as the number of modalities increases; and 2) It lacks robustness in scenarios with different missing modality settings between training and inference. In this paper, we propose a simple yet effective prompt design to address these challenges. Instead of using missing-aware prompts, we utilize prompts as modality-specific tokens, enabling them to capture the unique characteristics of each modality. Furthermore, our prompt design leverages orthogonality between prompts as a key element to learn distinct information across different modalities and promote diversity in the learned representations. Extensive experiments demonstrate that our prompt design enhances both performance and robustness while reducing the number of prompts.


title: Scalar spin chirality induced by a circularly polarized electric field in a classical kagome magnet

abstract: Noncoplanar magnetic states with a scalar spin chirality have been intensively studied in condensed matter physics, since they exhibit fascinating physical phenomena. We theoretically propose the generation of such noncoplanar magnetic states by using a circularly polarized electric field. By performing the micromagnetic simulation, we investigate a time evolution of a classical kagome magnet irradiated by the circularly polarized electric field. As a result, we find that the noncoplanar magnetic states are induced as a nonequilibrium steady state irrespective of the ground-state spin configurations. We show that the induced scalar spin chirality is controlled by the amplitude, frequency, and polarization of the electric field. In addition, we clarify that the mechanism of the noncoplanar magnetic states is accounted for by effective field-induced three-spin interactions by adopting the Floquet formalism in the high-frequency regime. We also show a condition to enhance the scalar spin chirality. Our results present a new reference for controlling the noncoplanar magnetic states and related phenomena by the circularly polarized electric field.


title: Capacity Enhancement of n-GHZ State Super-dense Coding Channels by Purification and Quantum Neural Network

abstract: A super-dense coding protocol based on the n-GHZ state is proposed to enable the two communicating parties to choose the number of transmitted code words according to their demand and to adapt the quantum super-dense coding protocol to multiple transmitted code word scenarios. A method is proposed that combines entanglement purification and Quantum Neural Network (QNN) to improve the channel capacity of super-dense coding. By simulating a realistic quantum communication noise environment in the Cirq platform, the effect of purification and QNN on the enhancement of fidelity and channel capacity in super-dense coding communication scenarios with different dimensions under unitary and non-unitary noise conditions is analyzed. The experimental results show that the channel capacity of super-dense coding is improved in different degrees when purification and QNN are applied separately, and the combination of purification and QNN has a superimposed effect on the channel capacity enhancement of super-dense coding, and the enhancement effect is more significant in different dimensions.


title: Computations of algebraic modular forms associated with the definite quaternion algebra of discriminant $2$

abstract: In this paper, we present an algorithm to compute a basis of the space of algebraic modular forms on the maximal order of the definite quaternion algebra of discriminant $2$, and provide a database of such bases. One of our motivations is to study congruence relations of algebraic modular forms.


title: Task-Disruptive Background Suppression for Few-Shot Segmentation

abstract: Few-shot segmentation aims to accurately segment novel target objects within query images using only a limited number of annotated support images. The recent works exploit support background as well as its foreground to precisely compute the dense correlations between query and support. However, they overlook the characteristics of the background that generally contains various types of objects. In this paper, we highlight this characteristic of background which can bring problematic cases as follows: (1) when the query and support backgrounds are dissimilar and (2) when objects in the support background are similar to the target object in the query. Without any consideration of the above cases, adopting the entire support background leads to a misprediction of the query foreground as background. To address this issue, we propose Task-disruptive Background Suppression (TBS), a module to suppress those disruptive support background features based on two spatial-wise scores: query-relevant and target-relevant scores. The former aims to mitigate the impact of unshared features solely existing in the support background, while the latter aims to reduce the influence of target-similar support background features. Based on these two scores, we define a query background relevant score that captures the similarity between the backgrounds of the query and the support, and utilize it to scale support background features to adaptively restrict the impact of disruptive support backgrounds. Our proposed method achieves state-of-the-art performance on PASCAL-5 and COCO-20 datasets on 1-shot segmentation. Our official code is available at github.com/SuhoPark0706/TBSNet.


title: Semantic-aware SAM for Point-Prompted Instance Segmentation

abstract: Single-point annotation in visual tasks, with the goal of minimizing labelling costs, is becoming increasingly prominent in research. Recently, visual foundation models, such as Segment Anything (SAM), have gained widespread usage due to their robust zero-shot capabilities and exceptional annotation performance. However, SAM's class-agnostic output and high confidence in local segmentation introduce 'semantic ambiguity', posing a challenge for precise category-specific segmentation. In this paper, we introduce a cost-effective category-specific segmenter using SAM. To tackle this challenge, we have devised a Semantic-Aware Instance Segmentation Network (SAPNet) that integrates Multiple Instance Learning (MIL) with matching capability and SAM with point prompts. SAPNet strategically selects the most representative mask proposals generated by SAM to supervise segmentation, with a specific focus on object category information. Moreover, we introduce the Point Distance Guidance and Box Mining Strategy to mitigate inherent challenges: 'group' and 'local' issues in weakly supervised segmentation. These strategies serve to further enhance the overall segmentation performance. The experimental results on Pascal VOC and COCO demonstrate the promising performance of our proposed SAPNet, emphasizing its semantic matching capabilities and its potential to advance point-prompted instance segmentation. The code will be made publicly available.


title: WWW: What, When, Where to Compute-in-Memory

abstract: Compute-in-memory (CiM) has emerged as a highly energy efficient solution for performing matrix multiplication during Machine Learning (ML) inference. However, integrating compute in memory poses key questions, such as 1) What type of CiM to use: Given a multitude of CiM design characteristics, determining their suitability from architecture perspective is needed. 2) When to use CiM: ML inference includes workloads with a variety of memory and compute requirements, making it difficult to identify when CiM is more beneficial. 3) Where to integrate CiM: Each memory level has different bandwidth and capacity, creating different data reuse opportunities for CiM integration. To answer such questions regarding on-chip CiM integration for accelerating ML workloads, we use an analytical architecture evaluation methodology where we tailor the dataflow mapping. The mapping algorithm aims to achieve highest weight reuse and reduced data movements for a given CiM prototype and workload. Our experiments show that CiM integrated memory improves energy efficiency by up to 3.4x and throughput by up to 15.6x compared to tensor-core-like baseline architecture, with INT-8 precision under iso-area constraints. We believe the proposed work provides insights into what type of CiM to use, and when and where to optimally integrate it in the cache hierarchy for efficient matrix multiplication.


title: Recursive Distillation for Open-Set Distributed Robot Localization

abstract: A typical assumption in state-of-the-art self-localization models is that an annotated training dataset is available for the target workspace. However, this is not necessarily true when a robot travels around the general open world. This work introduces a novel training scheme for open-world distributed robot systems. In our scheme, a robot (``student") can ask the other robots it meets at unfamiliar places (``teachers") for guidance. Specifically, a pseudo-training dataset is reconstructed from the teacher model and then used for continual learning of the student model under domain, class, and vocabulary incremental setup. Unlike typical knowledge transfer schemes, our scheme introduces only minimal assumptions on the teacher model, so that it can handle various types of open-set teachers, including those uncooperative, untrainable (e.g., image retrieval engines), or black-box teachers (i.e., data privacy). In this paper, we investigate a ranking function as an instance of such generic models, using a challenging data-free recursive distillation scenario, where a student once trained can recursively join the next-generation open teacher set.


title: Simultaneous ground-state cooling of two levitated nanoparticles by coherent scattering

abstract: Simultaneous ground-state cooling of two levitated nanoparticles is a crucial prerequisite for investigation of macroscopic quantum effects such as quantum entanglement and quantum correlation involving translational motion of particles. Here we consider a coupled cavity-levitated-particle system and present a detailed derivation of its Hamiltonian. We find that the $y$-direction motions of the two particles are decoupled from the cavity field and both the $x$- and $z$-direction motions, and that the $z$-direction motions can be further decoupled from the cavity field and the $x$-direction motions by choosing proper locations of the particles. We study the simultaneous cooling of these mechanical modes in both the three-mode and five-mode cavity-levitated optomechanical models. It is found that there exists the dark-mode effect when the two tweezers have the same powers, which suppress the simultaneous ground-state cooling. Nevertheless, the simultaneous ground-state cooling of these modes can be realized by breaking the dark-mode effect under proper parameters. Our system provides a versatile platform to study quantum effects and applications in cavity-levitated optomechanical systems.


title: Corrosion-resistant aluminum alloy design through machine learning combined with high-throughput calculations

abstract: Efficiently designing lightweight alloys with combined high corrosion resistance and mechanical properties remains an enduring topic in materials engineering. To this end, machine learning (ML) coupled ab-initio calculations is proposed within this study. Due to the inadequate accuracy of conventional stress-strain ML models caused by corrosion factors, a novel reinforcement self-learning ML algorithm (accuracy R2 >0.92) is developed. Then, a strategy that integrates ML models, calculated energetics and mechanical moduli is implemented to optimize the Al alloys. Next, this Computation Designed Corrosion-Resistant Al alloy is fabricated that verified the simulation. The performance (elongation reaches ~30%) is attributed to the H-captured Al-Sc-Cu phases (-1.44 eV H-1) and Cu-modified {\eta}/{\eta}' precipitation inside the grain boundaries (GBs). The developed Al-Mg-Zn-Cu interatomic potential (energy accuracy 6.50 meV atom-1) proves the cracking resistance of the GB region enhanced by Cu-modification. Conceptually, our strategy is of practical importance for designing new alloys exhibiting corrosion resistance and mechanical properties.


title: Chain of Generation: Multi-Modal Gesture Synthesis via Cascaded Conditional Control

abstract: This study aims to improve the generation of 3D gestures by utilizing multimodal information from human speech. Previous studies have focused on incorporating additional modalities to enhance the quality of generated gestures. However, these methods perform poorly when certain modalities are missing during inference. To address this problem, we suggest using speech-derived multimodal priors to improve gesture generation. We introduce a novel method that separates priors from speech and employs multimodal priors as constraints for generating gestures. Our approach utilizes a chain-like modeling method to generate facial blendshapes, body movements, and hand gestures sequentially. Specifically, we incorporate rhythm cues derived from facial deformation and stylization prior based on speech emotions, into the process of generating gestures. By incorporating multimodal priors, our method improves the quality of generated gestures and eliminate the need for expensive setup preparation during inference. Extensive experiments and user studies confirm that our proposed approach achieves state-of-the-art performance.


title: Black-Box Tuning of Vision-Language Models with Effective Gradient Approximation

abstract: Parameter-efficient fine-tuning (PEFT) methods have provided an effective way for adapting large vision-language models to specific tasks or scenarios. Typically, they learn a very small scale of parameters for pre-trained models in a white-box formulation, which assumes model architectures to be known and parameters to be accessible. However, large models are often not open-source due to considerations of preventing abuse or commercial factors, hence posing a barrier to the deployment of white-box PEFT methods. To alleviate the dependence on model accessibility, we introduce collaborative black-box tuning (CBBT) for both textual prompt optimization and output feature adaptation for black-box models. Specifically, considering that the backpropagation gradients are blocked, we approximate the gradients of textual prompts by analyzing the predictions with perturbed prompts. Secondly, a lightweight adapter is deployed over the output feature of the inaccessible model, further facilitating the model adaptation process. Empowered with these designs, our CBBT is extensively evaluated on eleven downstream benchmarks and achieves remarkable improvements compared to existing black-box VL adaptation methods. Code is released at https://github.com/guozix/cbbt.


title: Eigenvalues and factors: a survey

abstract: A factor of a graph is a spanning subgraph satisfying some given conditions. An earlier survey of factors can be traced back to the Akiyama and Kano [J. Graph Theory, 1985, 9: 1-42] in which they described the characterization of factors in (bipartite) graphs and digraphs, respectively. Soon after, Kouider and Vestergaard summarized the findings related to connected factors [Graphs Combin., 2005, 21(1): 1-26]. Plummer extended the aforementioned research by providing a comprehensive overview of progress made in the study of graph factors and factorization from 1985 to 2003 [Discrete Math., 2007, 7-8: 791-821]. In this paper, we aim to summarize the relevant results regarding factors from the perspective of eigenvalues.


title: An Incremental Update Framework for Online Recommenders with Data-Driven Prior

abstract: Online recommenders have attained growing interest and created great revenue for businesses. Given numerous users and items, incremental update becomes a mainstream paradigm for learning large-scale models in industrial scenarios, where only newly arrived data within a sliding window is fed into the model, meeting the strict requirements of quick response. However, this strategy would be prone to overfitting to newly arrived data. When there exists a significant drift of data distribution, the long-term information would be discarded, which harms the recommendation performance. Conventional methods address this issue through native model-based continual learning methods, without analyzing the data characteristics for online recommenders. To address the aforementioned issue, we propose an incremental update framework for online recommenders with Data-Driven Prior (DDP), which is composed of Feature Prior (FP) and Model Prior (MP). The FP performs the click estimation for each specific value to enhance the stability of the training process. The MP incorporates previous model output into the current update while strictly following the Bayes rules, resulting in a theoretically provable prior for the robust update. In this way, both the FP and MP are well integrated into the unified framework, which is model-agnostic and can accommodate various advanced interaction models. Extensive experiments on two publicly available datasets as well as an industrial dataset demonstrate the superior performance of the proposed framework.


title: Linear vs. nonlinear modeling of black hole ringdowns

abstract: The ringdown (RD) phase of gravitational waves is of prime interest for testing general relativity (GR). The modelling of the linear quasi-normal modes (QNMs) within the Kerr spectrum -- or with agnostic parameterized deviations to that GR spectrum -- has become ordinary; however, specific attention has recently emerged to calibrate the effects of nonlinear perturbations for the predominant quadrupolar $l=2$, $m=2$ mode. In this paper, we test the performance of a few nonlinear toy models and of the nonlinear inspiral-merger-ringdown (IMR) model IMRPhenomD for faithfully representing the RD regime and we compare them with the results obtained using linear solutions as sums of QNM tones. Using several quasi-circular, non-precessing numerical waveforms, we fit the dominant $l=2$, $m=2$ mode of the strain, and we assess the results in terms of both the Bayes factor and the inferred posterior distributions for the mass and spin of the final black hole (BH). We find that the nonlinear models can be comparable or preferred over the linear QNM-only solutions when the analysis is performed from the peak of the strain, especially at high signal-to-noise ratios consistent with third-generation observatories. Since the calibration of the tones' relative amplitudes and phases in high-overtone models to the progenitor parameters is still missing, or even not achievable, we consider the use of non-linear models to be more pertinent for performing confident tests of general relativity based on the RD regime starting from early times.