abstract: Space-based gravitational wave (GW) detection is one of the most anticipated GW detection projects in the next decade, which promises to detect abundant compact binary systems. At present, deep learning methods have not been widely explored for GW waveform generation and extrapolation. To solve the data processing difficulty and the increasing waveform complexity caused by the detector's response and second-generation time-delay interferometry (TDI 2.0), an interpretable pre-trained large model named CBS-GPT (Compact Binary Systems Waveform Generation with Generative Pre-trained Transformer) is proposed. For compact binary system waveforms, three models were trained to predict the waveforms of massive black hole binaries (MBHB), extreme mass-ratio inspirals (EMRIs), and galactic binaries (GB), achieving prediction accuracies of at most 99%, 91%, and 99%, respectively. The CBS-GPT model exhibits notable generalization and interpretability, with its hidden parameters effectively capturing the intricate information of waveforms, even with the complex instrument response and a wide parameter range. Our research demonstrates the potential of large models in the GW realm, opening up new opportunities and guidance for future researches such as complex waveforms generation, gap completion, and deep learning model design for GW science.


title: Optimal Monotone Mean-Variance Problem in a Catastrophe Insurance Model

abstract: This paper explores an optimal investment and reinsurance problem involving both ordinary and catastrophe insurance businesses. The catastrophic events are modeled as following a compound Poisson process, impacting the ordinary insurance business. The claim intensity for the ordinary insurance business is described using a Cox process with a shot-noise intensity, the jump of which is proportional to the size of the catastrophe event. This intensity increases when a catastrophe occurs and then decays over time. The insurer's objective is to maximize their terminal wealth under the Monotone Mean-Variance (MMV) criterion. In contrast to the classical Mean-Variance (MV) criterion, the MMV criterion is monotonic across its entire domain, aligning better with fundamental economic principles. We first formulate the original MMV optimization problem as an auxiliary zero-sum game. Through solving the Hamilton-Jacobi-Bellman-Isaacs (HJBI) equation, explicit forms of the value function and optimal strategies are obtained. Additionally, we provides the efficient frontier within the MMV criterion. Several numerical examples are presented to demonstrate the practical implications of the results.


title: GraphTransformers for Geospatial Forecasting of Hurricane Trajectories

abstract: In this paper we introduce a novel framework for trajectory prediction of geospatial sequences using GraphTransformers. When viewed across several sequences, we observed that a graph structure automatically emerges between different geospatial points that is often not taken into account for such sequence modeling tasks. We show that by leveraging this graph structure explicitly, geospatial trajectory prediction can be significantly improved. Our GraphTransformer approach improves upon state-of-the-art Transformer based baseline significantly on HURDAT, a dataset where we are interested in predicting the trajectory of a hurricane on a 6 hourly basis.


title: LFAA: Crafting Transferable Targeted Adversarial Examples with Low-Frequency Perturbations

abstract: Deep neural networks are susceptible to adversarial attacks, which pose a significant threat to their security and reliability in real-world applications. The most notable adversarial attacks are transfer-based attacks, where an adversary crafts an adversarial example to fool one model, which can also fool other models. While previous research has made progress in improving the transferability of untargeted adversarial examples, the generation of targeted adversarial examples that can transfer between models remains a challenging task. In this work, we present a novel approach to generate transferable targeted adversarial examples by exploiting the vulnerability of deep neural networks to perturbations on high-frequency components of images. We observe that replacing the high-frequency component of an image with that of another image can mislead deep models, motivating us to craft perturbations containing high-frequency information to achieve targeted attacks. To this end, we propose a method called Low-Frequency Adversarial Attack (\name), which trains a conditional generator to generate targeted adversarial perturbations that are then added to the low-frequency component of the image. Extensive experiments on ImageNet demonstrate that our proposed approach significantly outperforms state-of-the-art methods, improving targeted attack success rates by a margin from 3.2\% to 15.5\%.


title: Predicting Astrometric Microlensing Events from Gaia DR3

abstract: Currently astrometric microlensing is the only tool that can directly measure the mass of a single star, it can also help us to detect compact objects like isolated neutron stars and black holes. The number of microlensing events that are being predicted and reported is increasing. In the paper, the potential lens stars are selected from three types of stars, high-proper-motion stars, nearby stars and high-mass stars. For each potential lens star, we select a larger search scope to find possible matching sources to avoid missing events as much as possible. Using Gaia DR3 data, we predict 4500 astrometric microlensing events with signal>0.1mas that occur between J2010.0 and J2070.0, where 1664 events are different from those found previously. There are 293 lens stars that can cause two or more events, where 5 lens stars can cause more than 50 events. We find that 116 events have the distance of background stars from the proper motion path of lens stars more than 8 arcsec in the reference epoch, where the maximum distance is 16.6 arcsec, so the cone search method of expanding the search range of sources for each potential lens star can reduce the possibility of missing events.


title: An extended Fourier pseudospectral method for the Gross-Pitaevskii equation with low regularity potential

abstract: We propose and analyze an extended Fourier pseudospectral (eFP) method for the spatial discretization of the Gross-Pitaevskii equation (GPE) with low regularity potential by treating the potential in an extended window for its discrete Fourier transform. The proposed eFP method maintains optimal convergence rates with respect to the regularity of the exact solution even if the potential is of low regularity and enjoys similar computational cost as the standard Fourier pseudospectral method, and thus it is both efficient and accurate. Furthermore, similar to the Fourier spectral/pseudospectral methods, the eFP method can be easily coupled with different popular temporal integrators including finite difference methods, time-splitting methods and exponential-type integrators. Numerical results are presented to validate our optimal error estimates and to demonstrate that they are sharp as well as to show its efficiency in practical computations.


title: Learning to Discover Skills through Guidance

abstract: In the field of unsupervised skill discovery (USD), a major challenge is limited exploration, primarily due to substantial penalties when skills deviate from their initial trajectories. To enhance exploration, recent methodologies employ auxiliary rewards to maximize the epistemic uncertainty or entropy of states. However, we have identified that the effectiveness of these rewards declines as the environmental complexity rises. Therefore, we present a novel USD algorithm, skill discovery with guidance (DISCO-DANCE), which (1) selects the guide skill that possesses the highest potential to reach unexplored states, (2) guides other skills to follow guide skill, then (3) the guided skills are dispersed to maximize their discriminability in unexplored states. Empirical evaluation demonstrates that DISCO-DANCE outperforms other USD baselines in challenging environments, including two navigation benchmarks and a continuous control benchmark. Qualitative visualizations and code of DISCO-DANCE are available at https://mynsng.github.io/discodance.


title: A Generalization of the Tang-Ding Binary Cyclic Codes

abstract: Cyclic codes are an interesting family of linear codes since they have efficient decoding algorithms and contain optimal codes as subfamilies. Constructing infinite families of cyclic codes with good parameters is important in both theory and practice. Recently, Tang and Ding [IEEE Trans. Inf. Theory, vol. 68, no. 12, pp. 7842--7849, 2022] proposed an infinite family of binary cyclic codes with good parameters. Shi et al. [arXiv:2309.12003v1, 2023] developed the binary Tang-Ding codes to the $4$-ary case. Inspired by these two works, we study $2^s$-ary Tang-Ding codes, where $s\geq 2$. Good lower bounds on the minimum distance of the $2^s$-ary Tang-Ding codes are presented. As a by-product, an infinite family of $2^s$-ary duadic codes with a square-root like lower bound is presented.


title: Coherent population transfer with polariton states in circuit QED

abstract: This article proposes a new method to increase the efficiency of stimulated Raman adiabatic passage (STIRAP) in superconducting circuits using a shortcut to the adiabaticity (STA) method. The STA speeds up the adiabatic process before decoherence has a significant effect, thus leading to increased efficiency. This method achieves fast, high-fidelity coherent population transfer, known as super-adiabatic STIRAP (saSTIRAP), in a dressed state-engineered $\Lambda$ system with polariton states in circuit QED.


title: An explicit and symmetric exponential wave integrator for the nonlinear Schr\"{o}dinger equation with low regularity potential and nonlinearity

abstract: We propose and analyze a novel symmetric Gautschi-type exponential wave integrator (sEWI) for the nonlinear Schr\"odinger equation (NLSE) with low regularity potential and typical power-type nonlinearity of the form $ |\psi|^{2\sigma}\psi $ with $ \psi $ being the wave function and $ \sigma > 0 $ being the exponent of the nonlinearity. The sEWI is explicit and stable under a time step size restriction independent of the mesh size. We rigorously establish error estimates of the sEWI under various regularity assumptions on potential and nonlinearity. For ``good" potential and nonlinearity ($H^2$-potential and $\sigma \geq 1$), we establish an optimal second-order error bound in the $L^2$-norm. For low regularity potential and nonlinearity ($L^\infty$-potential and $\sigma > 0$), we obtain a first-order $L^2$-norm error bound accompanied with a uniform $H^2$-norm bound of the numerical solution. Moreover, adopting a new technique of \textit{regularity compensation oscillation} (RCO) to analyze error cancellation, for some non-resonant time steps, the optimal second-order $L^2$-norm error bound is proved under a weaker assumption on the nonlinearity: $\sigma \geq 1/2$. For all the cases, we also present corresponding fractional order error bounds in the $H^1$-norm, which is the natural norm in terms of energy. Extensive numerical results are reported to confirm our error estimates and to demonstrate the superiority of the sEWI, including much weaker regularity requirements on potential and nonlinearity, and excellent long-time behavior with near-conservation of mass and energy.


title: Evaluating the Conservativeness of Robust Sandwich Variance Estimator in Weighted Average Treatment Effects

abstract: In causal inference, the Inverse Probability Weighting (IPW) estimator is commonly used to estimate causal effects for estimands within the class of Weighted Average Treatment Effect (WATE). When constructing confidence intervals (CIs), robust sandwich variance estimators are frequently used for practical reasons. Although these estimators are easy to calculate using widely-used statistical software, they often yield narrow CIs for commonly applied estimands, such as the Average Treatment Effect on the Treated and the Average Treatment Effect for the Overlap Populations. In this manuscript, we reexamine the asymptotic variance of the IPW estimator and clarify the conditions under which CIs derived from the sandwich variance estimator are conservative. Additionally, we propose new criteria to assess the conservativeness of CIs. The results of this investigation are validated through simulation experiments and real data analysis.


title: Thriving in a Pandemic: Lessons Learned from a Resilient University Program Seen Through the CoI Lens

abstract: In March 2020, college campuses underwent a sudden transformation to online learning due to the COVID-19 outbreak. To understand the impact of COVID-19 on students' expectations, this study conducted a three-year survey from ten core courses within the Project Management Center for Excellence at the University of Maryland. The study involved two main steps: 1) a statistical analysis to evaluate students' expectations regarding "student," "class," "instructor," and "effort;" and 2) a lexical salience-valence analysis (LSVA) through the lens of the Community of Inquiry (CoI) framework to show the changes of students' expectations. The results revealed that students' overall evaluations maintained relatively consistent amid the COVID-19 teaching period. However, there were significant shifts of the student expectations toward Cognitive, Social and Teaching Presence course elements based on LSVA results. Also, clear differences emerged between under-graduates and graduates in their expectations and preferences in course design and delivery. These insights provide practical recommendations for course instructors in designing effective online courses.


title: Graph Theoretic Approach Identifies Critical Thresholds at which Galaxy Filamentary Structures Form

abstract: Numerical simulations and observations show that galaxies are not uniformly distributed. In cosmology, the largest known structures in the universe are galaxy filaments formed from the hierarchical clustering of galaxies due to gravitational forces. These structures consist of walls and bridges that connect clusters. Here, we use graph theory to model the structures as Euclidean networks in three-dimensional space. Using percolation theory, cosmological graphs are reduced based on the valency of nodes to reveal the inner, most robust structural formation. By constraining the network, we then find thresholds for physical features, such as length-scale and density, at which galaxy filament clusters are identified.


title: Decomposed Phase Analysis using Convex Inner Approximations: a Methodology for DER Hosting Capacity in Distribution Systems

abstract: This paper uses convex inner approximations (CIA) of the AC power flow to tackle the optimization problem of quantifying a three-phase distribution feeder's capacity to host distributed energy resources (DERs). This is often connoted hosting capacity (HC), but herein we consider separative bounds for each node on positive and negative DER injections, which ensures that injections within these nodal limits satisfy feeder voltage and current limits and across nodes sum up to the feeder HC. The methodology decomposes a three-phase feeder into separate phases and applies CIA-based techniques to each phase. An analysis is developed to determine the technical condition under which this per-phase approach can still guarantee three-phase constraints. New approaches are then presented that modify the per-phase optimization problems to overcome conservativeness inherent to CIA methods and increase HC, including selectively modifying the per-phase impedances and iteratively relaxing per-phase voltage bounds. Discussion is included on trade-offs and feasibility. To validate the methodology simulation-based analysis is conducted with the IEEE 37-node test feeder and a real 534-node unbalanced radial distribution feeder.


title: SWIPT in Mixed Near- and Far-Field Channels: Joint Beam Scheduling and Power Allocation

abstract: Extremely large-scale array (XL-array) has emerged as a promising technology to enhance the spectrum efficiency and spatial resolution in future wireless networks by exploiting massive number of antennas for generating pencil-like beamforming. This also leads to a fundamental paradigm shift from conventional far-field communications towards the new near-field communications. In contrast to the existing works that mostly considered simultaneous wireless information and power transfer (SWIPT) in the far field, we consider in this paper a new and practical scenario, called mixed near- and far-field SWIPT, where energy harvesting (EH) and information decoding (ID) receivers are located in the near- and far-field regions of the XL-array base station (BS), respectively. Specifically, we formulate an optimization problem to maximize the weighted sum-power harvested at all EH receivers by jointly designing the BS beam scheduling and power allocation, under the constraints on the maximum sum-rate and BS transmit power. First, for the general case with multiple EH and ID receivers, we propose an efficient algorithm to obtain a suboptimal solution by utilizing the binary variable elimination and successive convex approximation methods. To obtain useful insights, we then study the joint design for special cases. In particular, we show that when there are multiple EH receivers and one ID receiver, in most cases, the optimal design is allocating a portion of power to the ID receiver for satisfying the rate constraint, while the remaining power is allocated to one EH receiver with the highest EH capability. This is in sharp contrast to the conventional far-field SWIPT case, for which all powers should be allocated to ID receivers. Numerical results show that our proposed joint design significantly outperforms other benchmark schemes without the optimization of beam scheduling and/or power allocation.


title: Self-Supervised Pre-Training for Precipitation Post-Processor

abstract: Obtaining a sufficient forecast lead time for local precipitation is essential in preventing hazardous weather events. Global warming-induced climate change increases the challenge of accurately predicting severe precipitation events, such as heavy rainfall. In this paper, we propose a deep learning-based precipitation post-processor for numerical weather prediction (NWP) models. The precipitation post-processor consists of (i) employing self-supervised pre-training, where the parameters of the encoder are pre-trained on the reconstruction of the masked variables of the atmospheric physics domain; and (ii) conducting transfer learning on precipitation segmentation tasks (the target domain) from the pre-trained encoder. In addition, we introduced a heuristic labeling approach to effectively train class-imbalanced datasets. Our experiments on precipitation correction for regional NWP show that the proposed method outperforms other approaches.


title: Spectral clumping for functions decreasing rapidly on a half-line

abstract: We demonstrate a phenomenon of condensation of the Fourier transform $\widehat{f}$ of a function $f$ defined on the real line $\mathbb{R}$ which decreases rapidly on one half of the line. For instance, we prove that if $f$ is square-integrable on $\mathbb{R}$, then a one-sided estimate of the form \[\rho_f(x) := \int_x^{\infty} |f(t)| \,dt = \mathcal{O}\big(e^{-c\sqrt{x}} \big), \quad x > 0\] for some $c > 0$, forces the non-zero frequencies $\sigma(f) := \{ \zeta \in \mathbb{R} : |\widehat{f}(\zeta)| > 0 \}$ to clump: this set differs from an open set $U$ only by a set of Lebesgue measure zero, and $\log |\widehat{f}|$ is locally integrable on $U$. In particular, if $f$ is non-zero, then there exists an interval on which $\log |\widehat{f}|$ is integrable. The roles of $f$ and $\widehat{f}$ above may be interchanged, and the result extends also to a large class of tempered distributions. We show that the above decay condition is close to optimal, in the following sense: a non-zero entire function $f$ exists which is square-integrable on $\mathbb{R}$, for which $\sigma(f)$ is a subset of a compact set $E$ containing no intervals, and for which the estimate $\rho_f(x) = \mathcal{O}\big( e^{-x^a}\big)$, $x > 0$, holds for every $a \in (0, 1/2)$.


title: LFG: A Generative Network for Real-Time Recommendation

abstract: Recommender systems are essential information technologies today, and recommendation algorithms combined with deep learning have become a research hotspot in this field. The recommendation model known as LFM (Latent Factor Model), which captures latent features through matrix factorization and gradient descent to fit user preferences, has given rise to various recommendation algorithms that bring new improvements in recommendation accuracy. However, collaborative filtering recommendation models based on LFM lack flexibility and has shortcomings for real-time recommendations, as they need to redo the matrix factorization and retrain using gradient descent when new users arrive. In response to this, this paper innovatively proposes a Latent Factor Generator (LFG) network, and set the movie recommendation as research theme. The LFG dynamically generates user latent factors through deep neural networks without the need for re-factorization or retrain. Experimental results indicate that the LFG recommendation model outperforms traditional matrix factorization algorithms in recommendation accuracy, providing an effective solution to the challenges of real-time recommendations with LFM.


title: Visible to Thermal image Translation for improving visual task in low light conditions

abstract: Several visual tasks, such as pedestrian detection and image-to-image translation, are challenging to accomplish in low light using RGB images. Heat variation of objects in thermal images can be used to overcome this. In this work, an end-to-end framework, which consists of a generative network and a detector network, is proposed to translate RGB image into Thermal ones and compare generated thermal images with real data. We have collected images from two different locations using the Parrot Anafi Thermal drone. After that, we created a two-stream network, preprocessed, augmented, the image data, and trained the generator and discriminator models from scratch. The findings demonstrate that it is feasible to translate RGB training data to thermal data using GAN. As a result, thermal data can now be produced more quickly and affordably, which is useful for security and surveillance applications.


title: Quantum Subspace Correction for Constraints

abstract: We demonstrate that it is possible to construct operators that stabilize the constraint-satisfying subspaces of computational problems in their Ising representations. We provide an explicit recipe to construct unitaries and associated measurements given a set of constraints. The stabilizer measurements allow the detection of constraint violations, and provide a route to recovery back into the constrained subspace. We call this technique ''quantum subspace correction". As an example, we explicitly investigate the stabilizers using the simplest local constraint subspace: Independent Set. We find an algorithm that is guaranteed to produce a perfect uniform or weighted distribution over all constraint-satisfying states when paired with a stopping condition: a quantum analogue of partial rejection sampling. The stopping condition can be modified for sub-graph approximations. We show that it can prepare exact Gibbs distributions on $d-$regular graphs below a critical hardness $\lambda_d^*$ in sub-linear time. Finally, we look at a potential use of quantum subspace correction for fault-tolerant depth-reduction. In particular we investigate how the technique detects and recovers errors induced by Trotterization in preparing maximum independent set using an adiabatic state preparation algorithm.


title: Shaping Opinions in Social Networks with Shadow Banning

abstract: The proliferation of harmful content and misinformation on social networks necessitates content moderation policies to maintain platform health. One such policy is shadow banning, which limits content visibility. The danger of shadow banning is that it can be misused by social media platforms to manipulate opinions. Here we present an optimization based approach to shadow banning that can shape opinions into a desired distribution and scale to large networks. Simulations on real network topologies show that our shadow banning policies can shift opinions and increase or decrease opinion polarization. We find that if one shadow bans with the aim of shifting opinions in a certain direction, the resulting shadow banning policy can appear neutral. This shows the potential for social media platforms to misuse shadow banning without being detected. Our results demonstrate the power and danger of shadow banning for opinion manipulation in social networks.


title: FedRec+: Enhancing Privacy and Addressing Heterogeneity in Federated Recommendation Systems

abstract: Preserving privacy and reducing communication costs for edge users pose significant challenges in recommendation systems. Although federated learning has proven effective in protecting privacy by avoiding data exchange between clients and servers, it has been shown that the server can infer user ratings based on updated non-zero gradients obtained from two consecutive rounds of user-uploaded gradients. Moreover, federated recommendation systems (FRS) face the challenge of heterogeneity, leading to decreased recommendation performance. In this paper, we propose FedRec+, an ensemble framework for FRS that enhances privacy while addressing the heterogeneity challenge. FedRec+ employs optimal subset selection based on feature similarity to generate near-optimal virtual ratings for pseudo items, utilizing only the user's local information. This approach reduces noise without incurring additional communication costs. Furthermore, we utilize the Wasserstein distance to estimate the heterogeneity and contribution of each client, and derive optimal aggregation weights by solving a defined optimization problem. Experimental results demonstrate the state-of-the-art performance of FedRec+ across various reference datasets.


title: Evolution of topological charge through chiral anomaly transport

abstract: Built upon the state-of-the-art model a multiphase transport (AMPT), we develop a new module of chiral anomaly transport (CAT), which can trace the evolution of the initial topological charge of gauge field created through sphaleron transition at finite temperature and external magnetic field in heavy ion collisions. The eventual experimental signals of chiral magnetic effect(CME) can be measured. The CAT explicitly shows the generation and evolution of the charge separation, and the signals of CME through the CAT are quantitatively in agreement with the experimental measurements in Au+Au collision at $\sqrt{s}=200 {\rm GeV}$, and the centrality dependence of the CME fraction follows that of the fireball temperature.


title: Generating Continuations in Multilingual Idiomatic Contexts

abstract: The ability to process idiomatic or literal multiword expressions is a crucial aspect of understanding and generating any language. The task of generating contextually relevant continuations for narratives containing idiomatic (or literal) expressions can allow us to test the ability of generative language models (LMs) in understanding nuanced language containing non-compositional figurative text. We conduct a series of experiments using datasets in two distinct languages (English and Portuguese) under three different training settings (zero-shot, few-shot, and fine-tuned). Our results suggest that the models are only slightly better at generating continuations for literal contexts than idiomatic contexts, with exceedingly small margins. Furthermore, the models studied in this work perform equally well across both languages, indicating the robustness of generative models in performing this task.


title: Further Development of Event-Based Analysis of X-ray Polarization Data

abstract: An event-based maximum likelihood method for handling X-ray polarimetry data is extended to include the effects of background and nonuniform sampling of the possible position angle space. While nonuniform sampling in position angle space generally introduces cross terms in the uncertainties of polarization parameters that could create degeneracies, there are interesting cases that engender no bias or parameter covariance. When including background in Poisson-based likelihood formulation, the formula for the minimum detectable polarization (MDP) has nearly the same form as for the case of Gaussian statistics derived by Elsner et al. (2012) in the limiting case of an unpolarized signal. A polarized background is also considered, which demonstrably increases uncertainties in source polarization measurements. In addition, a Kolmogorov-style test of the event position angle distribution is proposed that can provide an unbinned test of models where the polarization angle in Stokes space depends on event characteristics such as time or energy.


title: Accelerating the convergence of free electron laser simulations by retrieving a spatially-coherent component of microbunching

abstract: A simple method to reduce the numerical cost in free electron laser (FEL) simulations is presented, which is based on retrieving a spatially-coherent component of microbunching to suppress artifact effects that can potentially overestimate the FEL gain; this significantly reduces the number of macroparticles to reach the numerical convergence and enables the direct computation of amplified radiation without solving the wave equation. Examples of FEL simulations performed to demonstrate the proposed method show that the computation time to get a reliable result is reduced by 1-2 orders of magnitude depending on the simulation condition.


title: Structured Two-Stage True-Time-Delay Array Codebook Design for Multi-User Data Communication

abstract: Wideband millimeter-wave and terahertz (THz) systems can facilitate simultaneous data communication with multiple spatially separated users. It is desirable to orthogonalize users across sub-bands by deploying frequency-dependent beams with a sub-band-specific spatial response. True-Time-Delay (TTD) antenna arrays are a promising wideband architecture to implement sub-band-specific dispersion of beams across space using a single radio frequency (RF) chain. This paper proposes a structured design of analog TTD codebooks to generate beams that exhibit quantized sub-band-to-angle mapping. We introduce a structured Staircase TTD codebook and analyze the frequency-spatial behaviour of the resulting beam patterns. We develop the closed-form two-stage design of the proposed codebook to achieve the desired sub-band-specific beams and evaluate their performance in multi-user communication networks.


title: In Search of Lost Online Test-time Adaptation: A Survey

abstract: In this paper, we present a comprehensive survey on online test-time adaptation (OTTA), a paradigm focused on adapting machine learning models to novel data distributions upon batch arrival. Despite the proliferation of OTTA methods recently, the field is mired in issues like ambiguous settings, antiquated backbones, and inconsistent hyperparameter tuning, obfuscating the real challenges and making reproducibility elusive. For clarity and a rigorous comparison, we classify OTTA techniques into three primary categories and subject them to benchmarks using the potent Vision Transformer (ViT) backbone to discover genuinely effective strategies. Our benchmarks span not only conventional corrupted datasets such as CIFAR-10/100-C and ImageNet-C but also real-world shifts embodied in CIFAR-10.1 and CIFAR-10-Warehouse, encapsulating variations across search engines and synthesized data by diffusion models. To gauge efficiency in online scenarios, we introduce novel evaluation metrics, inclusive of FLOPs, shedding light on the trade-offs between adaptation accuracy and computational overhead. Our findings diverge from existing literature, indicating: (1) transformers exhibit heightened resilience to diverse domain shifts, (2) the efficacy of many OTTA methods hinges on ample batch sizes, and (3) stability in optimization and resistance to perturbations are critical during adaptation, especially when the batch size is 1. Motivated by these insights, we pointed out promising directions for future research. The source code is made available: https://github.com/Jo-wang/OTTA_ViT_survey.


title: Multi-Domain Polarization for Enhancing the Physical Layer Security of MIMO Systems

abstract: A novel Physical Layer Security (PLS) framework is conceived for enhancing the security of the wireless communication systems by exploiting multi-domain polarization in Multiple-Input Multiple-Output (MIMO) systems. We design a sophisticated key generation scheme based on multi-domain polarization, and the corresponding receivers. An in-depth analysis of the system's secrecy rate is provided, demonstrating the confidentiality of our approach in the presence of eavesdroppers having strong computational capabilities. More explicitly, our simulation results and theoretical analysis corroborate the advantages of the proposed scheme in terms of its bit error rate (BER), block error rate (BLER), and maximum achievable secrecy rate. Our findings indicate that the innovative PLS framework effectively enhances the security and reliability of wireless communication systems. For instance, in a $4\times4$ MIMO setup, the proposed PLS strategy exhibits an improvement of $2$dB compared to conventional MIMO, systems at a BLER of $2\cdot 10^{-5}$ while the eavesdropper's BLER reaches $1$.


title: Video-Helpful Multimodal Machine Translation

abstract: Existing multimodal machine translation (MMT) datasets consist of images and video captions or instructional video subtitles, which rarely contain linguistic ambiguity, making visual information ineffective in generating appropriate translations. Recent work has constructed an ambiguous subtitles dataset to alleviate this problem but is still limited to the problem that videos do not necessarily contribute to disambiguation. We introduce EVA (Extensive training set and Video-helpful evaluation set for Ambiguous subtitles translation), an MMT dataset containing 852k Japanese-English (Ja-En) parallel subtitle pairs, 520k Chinese-English (Zh-En) parallel subtitle pairs, and corresponding video clips collected from movies and TV episodes. In addition to the extensive training set, EVA contains a video-helpful evaluation set in which subtitles are ambiguous, and videos are guaranteed helpful for disambiguation. Furthermore, we propose SAFA, an MMT model based on the Selective Attention model with two novel methods: Frame attention loss and Ambiguity augmentation, aiming to use videos in EVA for disambiguation fully. Experiments on EVA show that visual information and the proposed methods can boost translation performance, and our model performs significantly better than existing MMT models. The EVA dataset and the SAFA model are available at: https://github.com/ku-nlp/video-helpful-MMT.git.


title: Equivariant Lagrangian Floer theory on compact toric manifolds

abstract: We define an equivariant Lagrangian Floer theory for Lagrangian torus fibers in a compact symplectic toric manifold equipped with a subtorus action. We show that the set of all Lagrangian torus fibers with weak bounding cochain data whose equivariant Lagrangian Floer cohomology is non-zero can be identified with a rigid analytic space. We prove that the set of these Lagrangian torus fibers is the tropicalization of the rigid analytic space. This provides a way to locate them in the moment polytope. Moreover, we prove that the dimension of such a rigid analytic space is equal to the dimension of the subtorus when the symplectic manifold is $\mathbb{CP}^n$ or has complex dimension less than or equal to 2. We also show that the Lagrangian submanifolds with non-trivial equivariant Floer cohomology are non-displaceable by $G$-equivariant Hamiltonian diffeomorphisms.


title: Importance Estimation with Random Gradient for Neural Network Pruning

abstract: Global Neuron Importance Estimation is used to prune neural networks for efficiency reasons. To determine the global importance of each neuron or convolutional kernel, most of the existing methods either use activation or gradient information or both, which demands abundant labelled examples. In this work, we use heuristics to derive importance estimation similar to Taylor First Order (TaylorFO) approximation based methods. We name our methods TaylorFO-abs and TaylorFO-sq. We propose two additional methods to improve these importance estimation methods. Firstly, we propagate random gradients from the last layer of a network, thus avoiding the need for labelled examples. Secondly, we normalize the gradient magnitude of the last layer output before propagating, which allows all examples to contribute similarly to the importance score. Our methods with additional techniques perform better than previous methods when tested on ResNet and VGG architectures on CIFAR-100 and STL-10 datasets. Furthermore, our method also complements the existing methods and improves their performances when combined with them.


title: General-Purpose Retrieval-Enhanced Medical Prediction Model Using Near-Infinite History

abstract: Developing clinical prediction models (e.g., mortality prediction) based on electronic health records (EHRs) typically relies on expert opinion for feature selection and adjusting observation window size. This burdens experts and creates a bottleneck in the development process. We propose Retrieval-Enhanced Medical prediction model (REMed) to address such challenges. REMed can essentially evaluate an unlimited number of clinical events, select the relevant ones, and make predictions. This approach effectively eliminates the need for manual feature selection and enables an unrestricted observation window. We verified these properties through experiments on 27 clinical tasks and two independent cohorts from publicly available EHR datasets, where REMed outperformed other contemporary architectures that aim to handle as many events as possible. Notably, we found that the preferences of REMed align closely with those of medical experts. We expect our approach to significantly expedite the development of EHR prediction models by minimizing clinicians' need for manual involvement.


title: The differential properties of certain permutation polynomials over finite fields

abstract: Finding functions, particularly permutations, with good differential properties has received a lot of attention due to their possible applications. For instance, in combinatorial design theory, a correspondence of perfect $c$-nonlinear functions and difference sets in some quasigroups was recently shown [1]. Additionally, in a recent manuscript by Pal and Stanica [20], a very interesting connection between the $c$-differential uniformity and boomerang uniformity when $c=-1$ was pointed out, showing that that they are the same for an odd APN permutations. This makes the construction of functions with low $c$-differential uniformity an intriguing problem. We investigate the $c$-differential uniformity of some classes of permutation polynomials. As a result, we add four more classes of permutation polynomials to the family of functions that only contains a few (non-trivial) perfect $c$-nonlinear functions over finite fields of even characteristic. Moreover, we include a class of permutation polynomials with low $c$-differential uniformity over the field of characteristic~$3$. As a byproduct, our proofs shows the permutation property of these classes. To solve the involved equations over finite fields, we use various techniques, in particular, we find explicitly many Walsh transform coefficients and Weil sums that may be of an independent interest.


title: Nonlinear dynamics in the balanced two-photon Dicke model with qubit dissipation

abstract: We study the complex nonlinear dynamics of the two-photon Dicke model in the semiclassical limit by considering cavity and qubit dissipation. In addition to the normal and super-radiant phases, another phase that contains abundant chaos-related phenomena is found under balanced rotating and counter-rotating couplings. In particular, chaos may manifest itself through period-doubling bifurcation, intermittent chaos, or quasi-periodic oscillation, depending on the value of qubit frequency. Transition mechanisms that exist in these three distinct routes are investigated through the system's long-time evolution and bifurcation diagram. Additionally, we provide a comprehensive phase diagram detailing both the existence of stable fixed points and the aforementioned chaos-related dynamics.


title: Supersymmetric QCD on the Lattice: Fine-Tuning of the Yukawa Couplings

abstract: We determine the fine-tuning of the Yukawa couplings of supersymmetric QCD, discretized on a lattice. We use perturbation theory at one-loop level. The Modified Minimal Subtraction scheme ($\overline{{\rm MS}}$) is employed; by its definition, this scheme requires perturbative calculations, in the continuum and/or on the lattice. On the lattice, we utilize the Wilson formulation for gluon, quark and gluino fields; for squark fields we use na\"ive discretization. The sheer difficulties of this study lie in the fact that different components of squark fields mix among themselves at the quantum level and the action's symmetries, such as parity and charge conjugation, allow an additional Yukawa coupling. Consequently, for an appropriate fine-tuning of the Yukawa terms, these mixings must be taken into account in the renormalization conditions. All Green's functions and renormalization factors are analytic expressions depending on the number of colors, $N_c$, the number of flavors, $N_f$, and the gauge parameter, $\alpha$, which are left unspecified. Knowledge of these renormalization factors is necessary in order to relate numerical results, coming from nonperturbative studies, to the renormalized, ``physical" Green's functions of the theory.


title: ZoomNeXt: A Unified Collaborative Pyramid Network for Camouflaged Object Detection

abstract: Recent camouflaged object detection (COD) attempts to segment objects visually blended into their surroundings, which is extremely complex and difficult in real-world scenarios. Apart from the high intrinsic similarity between camouflaged objects and their background, objects are usually diverse in scale, fuzzy in appearance, and even severely occluded. To this end, we propose an effective unified collaborative pyramid network that mimics human behavior when observing vague images and videos, \ie zooming in and out. Specifically, our approach employs the zooming strategy to learn discriminative mixed-scale semantics by the multi-head scale integration and rich granularity perception units, which are designed to fully explore imperceptible clues between candidate objects and background surroundings. The former's intrinsic multi-head aggregation provides more diverse visual patterns. The latter's routing mechanism can effectively propagate inter-frame differences in spatiotemporal scenarios and be adaptively deactivated and output all-zero results for static representations. They provide a solid foundation for realizing a unified architecture for static and dynamic COD. Moreover, considering the uncertainty and ambiguity derived from indistinguishable textures, we construct a simple yet effective regularization, uncertainty awareness loss, to encourage predictions with higher confidence in candidate regions. Our highly task-friendly framework consistently outperforms existing state-of-the-art methods in image and video COD benchmarks.


title: Network Contention-Aware Cluster Scheduling with Reinforcement Learning

abstract: With continuous advances in deep learning, distributed training is becoming common in GPU clusters. Specifically, for emerging workloads with diverse amounts, ratios, and patterns of communication, we observe that network contention can significantly degrade training throughput. However, widely used scheduling policies often face limitations as they are agnostic to network contention between jobs. In this paper, we present a new approach to mitigate network contention in GPU clusters using reinforcement learning. We formulate GPU cluster scheduling as a reinforcement learning problem and opt to learn a network contention-aware scheduling policy that efficiently captures contention sensitivities and dynamically adapts scheduling decisions through continuous evaluation and improvement. We show that compared to widely used scheduling policies, our approach reduces average job completion time by up to 18.2\% and effectively cuts the tail job completion time by up to 20.7\% while allowing a preferable trade-off between average job completion time and resource utilization.


title: UWFormer: Underwater Image Enhancement via a Semi-Supervised Multi-Scale Transformer

abstract: Underwater images often exhibit poor quality, distorted color balance and low contrast due to the complex and intricate interplay of light, water, and objects. Despite the significant contributions of previous underwater enhancement techniques, there exist several problems that demand further improvement: (i) The current deep learning methods rely on Convolutional Neural Networks (CNNs) that lack the multi-scale enhancement, and global perception field is also limited. (ii) The scarcity of paired real-world underwater datasets poses a significant challenge, and the utilization of synthetic image pairs could lead to overfitting. To address the aforementioned problems, this paper introduces a Multi-scale Transformer-based Network called UWFormer for enhancing images at multiple frequencies via semi-supervised learning, in which we propose a Nonlinear Frequency-aware Attention mechanism and a Multi-Scale Fusion Feed-forward Network for low-frequency enhancement. Besides, we introduce a special underwater semi-supervised training strategy, where we propose a Subaqueous Perceptual Loss function to generate reliable pseudo labels. Experiments using full-reference and non-reference underwater benchmarks demonstrate that our method outperforms state-of-the-art methods in terms of both quantity and visual quality.


title: Calibration by Distribution Matching: Trainable Kernel Calibration Metrics

abstract: Calibration ensures that probabilistic forecasts meaningfully capture uncertainty by requiring that predicted probabilities align with empirical frequencies. However, many existing calibration methods are specialized for post-hoc recalibration, which can worsen the sharpness of forecasts. Drawing on the insight that calibration can be viewed as a distribution matching task, we introduce kernel-based calibration metrics that unify and generalize popular forms of calibration for both classification and regression. These metrics admit differentiable sample estimates, making it easy to incorporate a calibration objective into empirical risk minimization. Furthermore, we provide intuitive mechanisms to tailor calibration metrics to a decision task, and enforce accurate loss estimation and no regret decisions. Our empirical evaluation demonstrates that employing these metrics as regularizers enhances calibration, sharpness, and decision-making across a range of regression and classification tasks, outperforming methods relying solely on post-hoc recalibration.


title: A Comparative Evaluation of Automated Analysis Tools for Solidity Smart Contracts

abstract: Blockchain smart contracts have emerged as a transformative force in the digital realm, spawning a diverse range of compelling applications. Since solidity smart contracts across various domains manage trillions of dollars in virtual coins, they become a prime target for attacks. One of the primary challenges is keeping abreast of the latest techniques and tools for developing secure smart contracts and examining those already deployed. In this paper, we seek to address these challenges from four aspects: (1) We begin by examining ten automatic tools, specifically focusing on their methodologies and their ability to identify vulnerabilities in solidity smart contracts. (2) We propose a novel criterion for evaluating these tools, based on the ISO/IEC 25010 standard. (3) To facilitate the evaluation of the selected tools, we construct a benchmark that encompasses two distinct datasets: a collection of 389 labelled smart contracts and a scaled set of 20,000 unique cases from real-world contracts. (4) We provide a comparison of the selected tools, offering insights into their strengths and weaknesses and highlighting areas where further improvements are needed. Through this evaluation, we hope to provide developers and researchers with valuable guidance on selecting and using smart contract analysis tools and contribute to the ongoing efforts to improve the security and reliability of smart contracts.


title: Topological speckles

abstract: The time evolution of a topological Su-Schrieffer-Heeger chain is analyzed through the statistics of speckle patterns. The emergence of topological edge states dramatically affects the dynamical fluctuations of the wavefunction. The intensity statistics is found to be described by a family of noncentral chi-squared distributions, with the noncentrality parameter reflecting on the degree of edge-state localization. The response of the speckle contrast with respect to the dimerization of the chain is explored in detail as well as the role of chiral symmetry-breaking disorder, number of edge states, their energy gap, and the locations between which the transport occurs. In addition to providing a venue for speckle customization, our results appeal to the use of speckle patterns for characterization of nontrivial topological properties.


title: The external photoevaporation of structured protoplanetary disks

abstract: The dust in planet-forming disks evolve rapidly through growth and radial drift, and external photoevaporation also contributes to this evolution in massive star-forming regions. We test whether the presence of substructures can explain the survival of the dust component and observed millimeter continuum emission in protoplanetary disks located within massive star-forming regions. We also characterize the dust content removed by the photoevaporative winds. For this, we performed hydrodynamical simulations of protoplanetary disks subject to irradiation fields of $F_{UV} = 10^2$, $10^3$, and $10^4\, G_0$, with different dust trap locations. We used the FRIED grid to derive the mass loss rate for each irradiation field and disk properties, and then measure the evolution of the dust mass over time. For each simulation we estimate continuum emission at $\lambda = 1.3\, \textrm{mm}$ along with the radii encompassing $90\%$ of the continuum flux, and characterize the dust size distribution entrained in the photoevaporative winds, along with the resulting far-ultraviolet (FUV) cross section. Our simulations show that the presence of dust traps can extend the lifetime of the dust component of the disk to a few millionyears if the FUV irradiation is $F_{UV} \lesssim 10^3 G_0$, but only if the dust traps are located inside the photoevaporative truncation radius. The dust component of a disk quickly disperse if the FUV irradiation is strong ($10^4\, G_0$) or if the substructures are located outside the photoevaporation radius. We do find however, that the dust grains entrained with the photoevaporative winds may result in an absorption FUV cross section of $\sigma \approx 10^{-22}\, \textrm{cm}^2$ at early times of evolution ($<$0.1 Myr), which is enough to trigger a self-shielding effect that reduces the total mass loss rate, and slow down the disk dispersal in a negative feedback loop process.


title: Handover Protocol Learning for LEO Satellite Networks: Access Delay and Collision Minimization

abstract: This study presents a novel deep reinforcement learning (DRL)-based handover (HO) protocol, called DHO, specifically designed to address the persistent challenge of long propagation delays in low-Earth orbit (LEO) satellite networks' HO procedures. DHO skips the Measurement Report (MR) in the HO procedure by leveraging its predictive capabilities after being trained with a pre-determined LEO satellite orbital pattern. This simplification eliminates the propagation delay incurred during the MR phase, while still providing effective HO decisions. The proposed DHO outperforms the legacy HO protocol across diverse network conditions in terms of access delay, collision rate, and handover success rate, demonstrating the practical applicability of DHO in real-world networks. Furthermore, the study examines the trade-off between access delay and collision rate and also evaluates the training performance and convergence of DHO using various DRL algorithms.


title: Does GPT-4 pass the Turing test?

abstract: We evaluated GPT-4 in a public online Turing test. The best-performing GPT-4 prompt passed in 49.7% of games, outperforming ELIZA (22%) and GPT-3.5 (20%), but falling short of the baseline set by human participants (66%). Participants' decisions were based mainly on linguistic style (35%) and socioemotional traits (27%), supporting the idea that intelligence, narrowly conceived, is not sufficient to pass the Turing test. Participant knowledge about LLMs and number of games played positively correlated with accuracy in detecting AI, suggesting learning and practice as possible strategies to mitigate deception. Despite known limitations as a test of intelligence, we argue that the Turing test continues to be relevant as an assessment of naturalistic communication and deception. AI models with the ability to masquerade as humans could have widespread societal consequences, and we analyse the effectiveness of different strategies and criteria for judging humanlikeness.


title: Quantum Integrability and Chaos in periodic Toda Lattice with Balanced Loss-Gain

abstract: We consider equal-mass quantum Toda lattice with balanced loss-gain for two and three particles. The two-particle Toda lattice is integrable and two integrals of motion which are in involution have been found. The bound-state energy and the corresponding eigenfunctions have been obtained numerically for a few low-lying states. The three-particle quantum Toda lattice with balanced loss-gain and velocity mediated coupling admits mixed phases of integrability and chaos depending on the value of the loss-gain parameter. We have obtained analytic expressions for two integrals of motion which are in involution. Although an analytic expression for the third integral has not been found, the numerical investigation suggests integrability below a critical value of the loss-gain strength and chaos above this critical value. The level spacing distribution changes from the Wigner-Dyson to the Poisson distribution as the loss-gain parameter passes through this critical value and approaches zero. An identical behaviour is seen in terms of the gap-ratio distribution of the energy levels. The existence of mixed phases of quantum integrability and chaos in the specified ranges of the loss-gain parameter has also been confirmed independently via the study of level repulsion and complexity in higher order excited states.

categories: nlin.CD cond-mat.other hep-th math-ph math.MP


title: A Systematic Review for Transformer-based Long-term Series Forecasting

abstract: The emergence of deep learning has yielded noteworthy advancements in time series forecasting (TSF). Transformer architectures, in particular, have witnessed broad utilization and adoption in TSF tasks. Transformers have proven to be the most successful solution to extract the semantic correlations among the elements within a long sequence. Various variants have enabled transformer architecture to effectively handle long-term time series forecasting (LTSF) tasks. In this article, we first present a comprehensive overview of transformer architectures and their subsequent enhancements developed to address various LTSF tasks. Then, we summarize the publicly available LTSF datasets and relevant evaluation metrics. Furthermore, we provide valuable insights into the best practices and techniques for effectively training transformers in the context of time-series analysis. Lastly, we propose potential research directions in this rapidly evolving field.


title: An esoteric identity with many parameters and other elliptic extensions of elementary identities

abstract: We provide elliptic extensions of elementary identities such as the sum of the first $n$ odd or even numbers, the geometric sum and the sum of the first $n$ cubes. Many such identities, and their $q$-analogues, are indefinite sums, and can be obtained from telescoping. So we used telescoping in our study to find elliptic extensions of these identities. In the course of our study, we obtained an identity with many parameters, which appears to be new even in the $q$-case. In addition, we recover some $q$-identities due to Warnaar.


title: A Spectral Analysis of The Correlated Random Walk

abstract: In this paper, we consider a spectral analysis of the Correlated Random Walk (CRW) on the path. We apply an analytical method for the Quantum Walk to CRW. For the isospectral coin cases, we obtain all of the eigenvalues and the corresponding eigenvectors of the time evolution operator of CRW, and also obtain the limiting distribution.


title: Cayley Linear-Time Computable Groups

abstract: This paper looks at the class of groups admitting normal forms for which the right multiplication by a group element is computed in linear time on a multi-tape Turing machine. We show that the groups $\mathbb{Z}_2 \wr \mathbb{Z}^2$, $\mathbb{Z}_2 \wr \mathbb{F}_2$ and Thompson's group $F$ have normal forms for which the right multiplication by a group element is computed in linear time on a $2$-tape Turing machine. This refines the results previously established by Elder and the authors that these groups are Cayley polynomial-time computable.


title: Cosmological singularities in $f(T,\phi)$ gravity

abstract: The pursuit of understanding the mysteries surrounding dark energy has sparked significant interest within the field of cosmology. While conventional approaches, such as the cosmological constant, have been extensively explored, alternative theories incorporating scalar field-based models and modified gravity have emerged as intriguing avenues. Among these, teleparallel theories of gravity, specifically the $f(T,\phi)$ formulation, have gained prominence as a means to comprehend dark energy within the framework of teleparallelism. In this study, we investigate two well-studied models of teleparallel dark energy and examine the presence of cosmological singularities within these scenarios. Using the Goriely-Hyde procedure, we examine the dynamical systems governing the cosmological equations of these models. Our analysis reveals that both models exhibit Type IV singularities, but only for a limited range of initial conditions. These results could indicate a potential edge for teleparallel cosmological models over their other modified gravity counterparts, as the models we examine seem to be only allowing for weak singularities that too under non general conditions.


title: STDA-Meta: A Meta-Learning Framework for Few-Shot Traffic Prediction

abstract: As the development of cities, traffic congestion becomes an increasingly pressing issue, and traffic prediction is a classic method to relieve that issue. Traffic prediction is one specific application of spatio-temporal prediction learning, like taxi scheduling, weather prediction, and ship trajectory prediction. Against these problems, classical spatio-temporal prediction learning methods including deep learning, require large amounts of training data. In reality, some newly developed cities with insufficient sensors would not hold that assumption, and the data scarcity makes predictive performance worse. In such situation, the learning method on insufficient data is known as few-shot learning (FSL), and the FSL of traffic prediction remains challenges. On the one hand, graph structures' irregularity and dynamic nature of graphs cannot hold the performance of spatio-temporal learning method. On the other hand, conventional domain adaptation methods cannot work well on insufficient training data, when transferring knowledge from different domains to the intended target domain.To address these challenges, we propose a novel spatio-temporal domain adaptation (STDA) method that learns transferable spatio-temporal meta-knowledge from data-sufficient cities in an adversarial manner. This learned meta-knowledge can improve the prediction performance of data-scarce cities. Specifically, we train the STDA model using a Model-Agnostic Meta-Learning (MAML) based episode learning process, which is a model-agnostic meta-learning framework that enables the model to solve new learning tasks using only a small number of training samples. We conduct numerous experiments on four traffic prediction datasets, and our results show that the prediction performance of our model has improved by 7\% compared to baseline models on the two metrics of MAE and RMSE.


title: Choose A Table: Tensor Dirichlet Process Multinomial Mixture Model with Graphs for Passenger Trajectory Clustering

abstract: Passenger clustering based on trajectory records is essential for transportation operators. However, existing methods cannot easily cluster the passengers due to the hierarchical structure of the passenger trip information, including multiple trips within each passenger and multi-dimensional information about each trip. Furthermore, existing approaches rely on an accurate specification of the clustering number to start. Finally, existing methods do not consider spatial semantic graphs such as geographical proximity and functional similarity between the locations. In this paper, we propose a novel tensor Dirichlet Process Multinomial Mixture model with graphs, which can preserve the hierarchical structure of the multi-dimensional trip information and cluster them in a unified one-step manner with the ability to determine the number of clusters automatically. The spatial graphs are utilized in community detection to link the semantic neighbors. We further propose a tensor version of Collapsed Gibbs Sampling method with a minimum cluster size requirement. A case study based on Hong Kong metro passenger data is conducted to demonstrate the automatic process of cluster amount evolution and better cluster quality measured by within-cluster compactness and cross-cluster separateness. The code is available at https://github.com/bonaldli/TensorDPMM-G.


title: A Multi-Modal Foundation Model to Assist People with Blindness and Low Vision in Environmental Interaction

abstract: People with blindness and low vision (pBLV) encounter substantial challenges when it comes to comprehensive scene recognition and precise object identification in unfamiliar environments. Additionally, due to the vision loss, pBLV have difficulty in accessing and identifying potential tripping hazards on their own. In this paper, we present a pioneering approach that leverages a large vision-language model to enhance visual perception for pBLV, offering detailed and comprehensive descriptions of the surrounding environments and providing warnings about the potential risks. Our method begins by leveraging a large image tagging model (i.e., Recognize Anything (RAM)) to identify all common objects present in the captured images. The recognition results and user query are then integrated into a prompt, tailored specifically for pBLV using prompt engineering. By combining the prompt and input image, a large vision-language model (i.e., InstructBLIP) generates detailed and comprehensive descriptions of the environment and identifies potential risks in the environment by analyzing the environmental objects and scenes, relevant to the prompt. We evaluate our approach through experiments conducted on both indoor and outdoor datasets. Our results demonstrate that our method is able to recognize objects accurately and provide insightful descriptions and analysis of the environment for pBLV.


title: Value sets of non-permutation polynomials over the residue class rings of integers

abstract: In this paper, we study the value sets of non-permutation polynomial functions over the residue class ring $\mathbb{Z}/m\mathbb{Z}$. When $m=p^r$ is a power of some prime $p$, an upper bound is given for the size of the value set of a polynomial function which is not a permutation. We also show that this upper bound can be achieved by some integral polynomials. Finally, we generalize the results for any positive integer $m$ with known prime decomposition.


title: Achieving Scalable Capacity in Wireless Mesh Networks

abstract: Wireless mesh networks play a critical role in enabling key networking scenarios in beyond-5G (B5G) and 6G networks, including integrated access and backhaul (IAB), multi-hop sidelinks, and V2X. However, it still poses a challenge to deliver scalable per-node throughput via mesh networking, which significantly limits the potential of large-scale deployment of wireless mesh networks. Existing research has achieved $O(1)$ per-node throughput in a dense network, but how to achieve scalability remains an unresolved issue for an extended wireless network where the network size increases with a constant node density. This issue prevents a wireless mesh network from large-scale deployment. To this end, this paper aims to develop a theoretical approach to achieving scalable per-node throughput in wireless mesh networks. First, the key factors that limit the per-node throughput of wireless mesh networks are analyzed, through which two major ones are identified, i.e., link sharing and interference. Next, a multi-tier hierarchical architecture is proposed to overcome the link-sharing issue. The inter-tier interference under this architecture is then mitigated by utilizing orthogonal frequency allocation between adjacent tiers, while the intra-tier interference is reduced by considering two specific transmission schemes, one is MIMO spatial multiplexing with time-division, the other is MIMO beamforming. Theoretical analysis shows that the multi-tier mesh networking architecture can achieve a per-node throughput of $\Theta(1)$ in both schemes, as long as certain conditions on network parameters including bandwidth, antenna numbers, and node numbers of each tier are satisfied. A case study on a realistic deployment of 10,000 nodes is then carried out, which demonstrates that a scalable throughput of $\Theta(1)$ is achievable with a reasonable assumption on bandwidth and antenna numbers.


title: Reconstructing Human Pose from Inertial Measurements: A Generative Model-based Compressive Sensing Approach

abstract: The ability to sense, localize, and estimate the 3D position and orientation of the human body is critical in virtual reality (VR) and extended reality (XR) applications. This becomes more important and challenging with the deployment of VR/XR applications over the next generation of wireless systems such as 5G and beyond. In this paper, we propose a novel framework that can reconstruct the 3D human body pose of the user given sparse measurements from Inertial Measurement Unit (IMU) sensors over a noisy wireless environment. Specifically, our framework enables reliable transmission of compressed IMU signals through noisy wireless channels and effective recovery of such signals at the receiver, e.g., an edge server. This task is very challenging due to the constraints of transmit power, recovery accuracy, and recovery latency. To address these challenges, we first develop a deep generative model at the receiver to recover the data from linear measurements of IMU signals. The linear measurements of the IMU signals are obtained by a linear projection with a measurement matrix based on the compressive sensing theory. The key to the success of our framework lies in the novel design of the measurement matrix at the transmitter, which can not only satisfy power constraints for the IMU devices but also obtain a highly accurate recovery for the IMU signals at the receiver. This can be achieved by extending the set-restricted eigenvalue condition of the measurement matrix and combining it with an upper bound for the power transmission constraint. Our framework can achieve robust performance for recovering 3D human poses from noisy compressed IMU signals. Additionally, our pre-trained deep generative model achieves signal reconstruction accuracy comparable to an optimization-based approach, i.e., Lasso, but is an order of magnitude faster.


title: Dissipation entanglement control of two coupled qubits via strong driving fields

abstract: An analytical theory to calculate the dissipatively stable concurrence in the system of two coupled flux superconducting qubits in the strong driving field is developed. The conditions for the entanglement state generation and destruction during the formation of the multiphoton transitions regions due to the interference of Landau--Zener--St\"uckelberg--Majorana are found. Based on the solution of the Floquet--Markov equation, the technique is proposed to adjust the amplitudes of dc- and ac-fields for effective control of the entanglement between qubit states while taking into account the effects of the decoherence.


title: On the eigenvalues and Seidel eigenvalues of chain graphs

abstract: In this paper we consider the eigenvalues and the Seidel eigenvalues of a chain graph. An$\dbar$eli\'{c}, da Fonseca, Simi\'{c}, and Du \cite{andelic2020tridiagonal} conjectured that there do not exist non-isomorphic cospectral chain graphs with respect to the adjacency spectrum. Here we disprove this conjecture. Furthermore, by considering the relation between the Seidel matrix and the adjacency matrix of a graph, we solve two problems on the number of distinct Seidel eigenvalues of a chain graph, which was posed by Mandal, Mehatari, and Das \cite{mandal2022spectrum}.


title: Effective connectivity signatures in major depressive disorder: fMRI study using a multi-site dataset

abstract: Diagnosis of major depressive disorder (MDD) primarily relies on the patient's self-reported symptoms and a clinical evaluation. Effective connectivity (EC) from resting-state functional magnetic resonance imaging (rs-fMRI) analysis can reflect the directionality of connections between brain regions, making it a candidate method to classify MDD. This study used Granger causality analysis to extract EC features from a large multi-site MDD dataset. The ComBat algorithm and multivariate linear regression were used to harmonize site difference and to remove age and sex covariates, respectively. Two-sample t-tests and model-based feature selection methods were used to screen for highly discriminative EC features for MDD, and LightGBM was used to classify MDD. In this large-scale multi-site rs-fMRI dataset, 97 EC features deemed highly discriminative for MDD were screened. In the nested five-fold cross-validation, the best classification model with the 97 EC features achieved accuracy, sensitivity, and specificity of 94.35%, 93.52%, and 95.25%, respectively. In another independent large dataset, which tested the generalization performance of the 97 EC features, the best classification models achieved 94.74%, 90.59%, and 96.75% for accuracy, sensitivity, and specificity, respectively. This work demonstrated that EC had a reasonable discriminative ability and supported the notion for using EC to potentially assist clinical diagnosis of MDD.


title: A Lipid Rafts Theory of Alzheimer's Disease

abstract: I present a theory of Alzheimer's Disease (AD) that explains its symptoms, pathology, and risk factors. To do this, I introduce a new theory of brain plasticity that elucidates the physiological roles of AD-related agents. New events generate synaptic and branching candidates competing for long-term enhancement. Competition resolution crucially depends on the formation of membrane lipid rafts, which requires astrocyte-produced cholesterol. Sporadic AD is caused by impaired formation of plasma membrane lipid rafts, which prevents the conversion of short- to long-term memory, and yields excessive tau phosphorylation, intracellular cholesterol accumulation, synaptic dysfunction, and neurodegeneration. Amyloid beta (Abeta) production is promoted by cholesterol during the switch to competition resolution, and cholesterol accumulation stimulates chronic Abeta production, secretion, and aggregation. The theory addresses all of the major established facts known about the disease, and is supported by strong evidence.


title: Generation of electro-optic frequency combs with optimized flatness in a silicon ring resonator modulator

abstract: The flatness of electro-optic frequency combs (EOFCs) generated in a single silicon ring resonator modulator (RRM) is optimized by employing harmonic superposition of the radio-frequency driving signal. A differential evolution algorithm is employed in conjunction with a simplified model of the RRM for offline optimization of the amplitudes and phases of harmonic driving signals and the operating point of the RRM. The optimized driving signals are then applied to a silicon RRM. EOFCs containing 7 and 9 lines are synthesized with a power imbalance between the lines of 2.9 dB and 5.4 dB, respectively, compared to 9.4 dB for an optimized 5-line comb generated from a single sinusoidal driving signal.


title: HEDNet: A Hierarchical Encoder-Decoder Network for 3D Object Detection in Point Clouds

abstract: 3D object detection in point clouds is important for autonomous driving systems. A primary challenge in 3D object detection stems from the sparse distribution of points within the 3D scene. Existing high-performance methods typically employ 3D sparse convolutional neural networks with small kernels to extract features. To reduce computational costs, these methods resort to submanifold sparse convolutions, which prevent the information exchange among spatially disconnected features. Some recent approaches have attempted to address this problem by introducing large-kernel convolutions or self-attention mechanisms, but they either achieve limited accuracy improvements or incur excessive computational costs. We propose HEDNet, a hierarchical encoder-decoder network for 3D object detection, which leverages encoder-decoder blocks to capture long-range dependencies among features in the spatial space, particularly for large and distant objects. We conducted extensive experiments on the Waymo Open and nuScenes datasets. HEDNet achieved superior detection accuracy on both datasets than previous state-of-the-art methods with competitive efficiency. The code is available at https://github.com/zhanggang001/HEDNet.


title: Powers of generalized binomial edge ideals of path graphs

abstract: In this article, we study the powers of the generalized binomial edge ideal $\mathcal{J}_{K_m,P_n}$ of a path graph $P_n$. We explicitly compute their regularities and determine the limit of their depths. We also show that these ordinary powers coincide with their symbolic powers. Additionally, we study the Rees algebra and the special fiber ring of $\mathcal{J}_{K_m,P_n}$ via Sagbi basis theory. In particular, we obtain exact formulas for the regularity of these blowup algebras.


title: Dynamically Updating Event Representations for Temporal Relation Classification with Multi-category Learning

abstract: Temporal relation classification is a pair-wise task for identifying the relation of a temporal link (TLINK) between two mentions, i.e. event, time, and document creation time (DCT). It leads to two crucial limits: 1) Two TLINKs involving a common mention do not share information. 2) Existing models with independent classifiers for each TLINK category (E2E, E2T, and E2D) hinder from using the whole data. This paper presents an event centric model that allows to manage dynamic event representations across multiple TLINKs. Our model deals with three TLINK categories with multi-task learning to leverage the full size of data. The experimental results show that our proposal outperforms state-of-the-art models and two transfer learning baselines on both the English and Japanese data.


title: The Toll Walk Transit Function of a Graph: Axiomatic Characterizations and First-Order Non-definability

abstract: A walk $W=w_1w_2\dots w_k$, $k\geq 2$, is called a toll walk if $w_1\neq w_k$ and $w_2$ and $w_{k-1}$ are the only neighbors of $w_1$ and $w_k$, respectively, on $W$ in a graph $G$. A toll walk interval $T(u,v)$, $u,v\in V(G)$, contains all the vertices that belong to a toll walk between $u$ and $v$. The toll walk intervals yield a toll walk transit function $T:V(G)\times V(G)\rightarrow 2^{V(G)}$. We represent several axioms that characterize the toll walk transit function among chordal graphs, trees, asteroidal triple-free graphs, Ptolemaic graphs, and distance hereditary graphs. We also show that the toll walk transit function can not be described in the language of first-order logic for an arbitrary graph.


title: Study of speaker localization with binaural microphone array incorporating auditory filters and lateral angle estimation

abstract: Speaker localization for binaural microphone arrays has been widely studied for applications such as speech communication, video conferencing, and robot audition. Many methods developed for this task, including the direct path dominance (DPD) test, share common stages in their processing, which include transformation using the short-time Fourier transform (STFT), and a direction of arrival (DOA) search that is based on the head related transfer function (HRTF) set. In this paper, alternatives to these processing stages, motivated by human hearing, are proposed. These include incorporating an auditory filter bank to replace the STFT, and a new DOA search based on transformed HRTF as steering vectors. A simulation study and an experimental study are conducted to validate the proposed alternatives, and both are applied to two binaural DOA estimation methods; the results show that the proposed method compares favorably with current methods.


title: Coded Caching Schemes for Multiaccess Topologies via Combinatorial Design

abstract: This paper studies a multiaccess coded caching (MACC) where the connectivity topology between the users and the caches can be described by a class of combinatorial designs. Our model includes as special cases several MACC topologies considered in previous works. The considered MACC network includes a server containing $N$ files, $\Gamma$ cache nodes and $K$ cacheless users, where each user can access $L$ cache nodes. The server is connected to the users via an error-free shared link, while the users can retrieve the cache content of the connected cache-nodes while the users can directly access the content in their connected cache-nodes. Our goal is to minimise the worst-case transmission load on the shared link in the delivery phase. The main limitation of the existing MACC works is that only some specific access topologies are considered, and thus the number of users $K$ should be either linear or exponential to $\Gamma$. We overcome this limitation by formulating a new access topology derived from two classical combinatorial structures, referred to as the $t$-design and the $t$-group divisible design. In these topologies, $K$ scales linearly, polynomially, or even exponentially with $\Gamma$. By leveraging the properties of the considered combinatorial structures, we propose two classes of coded caching schemes for a flexible number of users, where the number of users can scale linearly, polynomially or exponentially with the number of cache nodes. In addition, our schemes can unify most schemes for the shared link network and unify many schemes for the multi-access network except for the cyclic wrap-around topology.


title: Breathing Life into Faces: Speech-driven 3D Facial Animation with Natural Head Pose and Detailed Shape

abstract: The creation of lifelike speech-driven 3D facial animation requires a natural and precise synchronization between audio input and facial expressions. However, existing works still fail to render shapes with flexible head poses and natural facial details (e.g., wrinkles). This limitation is mainly due to two aspects: 1) Collecting training set with detailed 3D facial shapes is highly expensive. This scarcity of detailed shape annotations hinders the training of models with expressive facial animation. 2) Compared to mouth movement, the head pose is much less correlated to speech content. Consequently, concurrent modeling of both mouth movement and head pose yields the lack of facial movement controllability. To address these challenges, we introduce VividTalker, a new framework designed to facilitate speech-driven 3D facial animation characterized by flexible head pose and natural facial details. Specifically, we explicitly disentangle facial animation into head pose and mouth movement and encode them separately into discrete latent spaces. Then, these attributes are generated through an autoregressive process leveraging a window-based Transformer architecture. To augment the richness of 3D facial animation, we construct a new 3D dataset with detailed shapes and learn to synthesize facial details in line with speech content. Extensive quantitative and qualitative experiments demonstrate that VividTalker outperforms state-of-the-art methods, resulting in vivid and realistic speech-driven 3D facial animation.


title: Enhanced dendrite nucleation and Li-clustering at vacancies on graphene

abstract: An ever present challenge for Li-ion batteries is the formation of metallic dendrites on cycling that dramatically reduces cycle life and leads to the untimely failure of the cell. In this work we investigate the modes of Li-cluster formation on pristine and defective graphene. Firstly, we demonstrate that on a defect free surface the cluster formation is impeded by the thermodynamic instability of \ce{Li_2} and \ce{Li_3} clusters. In contrast, the presence of a vacancy dramatically favours clustering. This provides insights into the two modes of Li-growth observed: for the pristine basal plane if the Li-Li repulsion of the small clusters can be overcome then plating type behaviour would be predicted (rate / voltage dependent and at any point on the surface); whilst dendritic growth would be predicted to nucleate from vacancy sites, either pre-existing in the material or formed as a result of processing.


title: Intelligent-Reflecting-Surface-Assisted UAV Communications for 6G Networks

abstract: In 6th-Generation (6G) mobile networks, Intelligent Reflective Surfaces (IRSs) and Unmanned Aerial Vehicles (UAVs) have emerged as promising technologies to address the coverage difficulties and resource constraints faced by terrestrial networks. UAVs, with their mobility and low costs, offer diverse connectivity options for mobile users and a novel deployment paradigm for 6G networks. However, the limited battery capacity of UAVs, dynamic and unpredictable channel environments, and communication resource constraints result in poor performance of traditional UAV-based networks. IRSs can not only reconstruct the wireless environment in a unique way, but also achieve wireless network relay in a cost-effective manner. Hence, it receives significant attention as a promising solution to solve the above challenges. In this article, we conduct a comprehensive survey on IRS-assisted UAV communications for 6G networks. First, primary issues, key technologies, and application scenarios of IRS-assisted UAV communications for 6G networks are introduced. Then, we put forward specific solutions to the issues of IRS-assisted UAV communications. Finally, we discuss some open issues and future research directions to guide researchers in related fields.


title: Contrast-agent-induced deterministic component of CT-density in the abdominal aorta during routine angiography: proof of concept study

abstract: Background and objective: CTA is a gold standard of preoperative diagnosis of abdominal aorta and typically used for geometric-only characteristic extraction. We assume that a model describing the dynamic behavior of the contrast agent in the vessel can be developed from the data of routine CTA studies, allowing the procedure to be investigated and optimized without the need for additional perfusion CT studies. Obtained spatial distribution of CA can be valuable for both increasing the diagnostic value of a particular study and improving the CT data processing tools. Methods: In accordance with the Beer-Lambert law and the absence of chemical interaction between blood and CA, we postulated the existence of a deterministic CA-induced component in the CT signal density. The proposed model, having a double-sigmoid structure, contains six coefficients relevant to the properties of hemodynamics. To validate the model, expert segmentation was performed using the 3D Slicer application for the CTA data obtained from publicly available source. The model was fitted to the data using the non-linear least square method with Levenberg-Marquardt optimization. Results: We analyzed 594 CTA images (4 studies with median size of 144 slices, IQR [134; 158.5]; 1:1 normal:pathology balance). Goodness-of-fit was proved by Wilcox test (p-value > 0.05 for all cases). The proposed model correctly simulated normal blood flow and hemodynamics disturbances caused by local abnormalities (aneurysm, thrombus and arterial branching). Conclusions: Proposed approach can be useful for personalized CA modeling of vessels, improvement of CTA image processing and preparation of synthetic CT training data for artificial intelligence.


title: Topological plasma transport from a diffusion view

abstract: Recent studies have identified plasma as a topological material. Yet, these researches often depict plasma as a fluid governed by electromagnetic fields, i.e., a classical wave system. Indeed, plasma transport can be characterized by a unique diffusion process distinguished by its collective behaviors. In this work, we adopt a simplified diffusion-migration method to elucidate the topological plasma transport. Drawing parallels to the thermal conduction-convection system, we introduce a double ring model to investigate the plasma density behaviors in the anti-parity-time reversal (APT) unbroken and broken phases. Subsequently, by augmenting the number of rings, we have established a coupled ring chain structure. This structure serves as a medium for realizing the APT symmetric one-dimensional (1D) reciprocal model, representing the simplest tight-binding model with a trivial topology. To develop a model featuring topological properties, we should modify the APT symmetric 1D reciprocal model from the following two aspects: hopping amplitude and onsite potential. From the hopping amplitude, we incorporate the non-reciprocity to facilitate the non-Hermitian skin effect, an intrinsic non-Hermitian topology. Meanwhile, from the onsite potential, the quasiperiodic modulation has been adopted onto the APT symmetric 1D reciprocal model. This APT symmetric 1D Aubry-Andr\'e-Harper model is of topological nature. Additionally, we suggest the potential applications for these diffusive plasma topological states. This study establishes a diffusion-based approach to realizing topological states in plasma, potentially inspiring further advancements in plasma physics.


title: Finding a Maximum Restricted $t$-Matching via Boolean Edge-CSP

abstract: The problem of finding a maximum $2$-matching without short cycles has received significant attention due to its relevance to the Hamilton cycle problem. This problem is generalized to finding a maximum $t$-matching which excludes specified complete $t$-partite subgraphs, where $t$ is a fixed positive integer. The polynomial solvability of this generalized problem remains an open question. In this paper, we present polynomial-time algorithms for the following two cases of this problem: in the first case the forbidden complete $t$-partite subgraphs are edge-disjoint; and in the second case the maximum degree of the input graph is at most $2t-1$. Our result for the first case extends the previous work of Nam (1994) showing the polynomial solvability of the problem of finding a maximum $2$-matching without cycles of length four, where the cycles of length four are vertex-disjoint. The second result expands upon the works of B\'{e}rczi and V\'{e}gh (2010) and Kobayashi and Yin (2012), which focused on graphs with maximum degree at most $t+1$. Our algorithms are obtained from exploiting the discrete structure of restricted $t$-matchings and employing an algorithm for the Boolean edge-CSP.


title: Breaking Language Barriers in Multilingual Mathematical Reasoning: Insights and Observations

abstract: Existing research predominantly focuses on developing powerful language learning models (LLMs) for mathematical reasoning within monolingual languages, with few explorations in preserving efficacy in a multilingual context. To bridge this gap, this paper pioneers exploring and training powerful Multilingual Math Reasoning (xMR) LLMs. Firstly, by utilizing translation, we construct the first multilingual math reasoning instruction dataset, MGSM8KInstruct, encompassing ten distinct languages, thus addressing the issue of training data scarcity in xMR tasks. Based on the collected dataset, we propose different training strategies to build powerful xMR LLMs, named MathOctopus, notably outperform conventional open-source LLMs and exhibit superiority over ChatGPT in few-shot scenarios. Notably, MathOctopus-13B reaches 47.6% accuracy which exceeds ChatGPT 46.3% on MGSM testset. Beyond remarkable results, we unearth several pivotal observations and insights from extensive experiments: (1) When extending the rejection sampling strategy to the multilingual context, it proves effective for model performances, albeit limited. (2) Employing parallel corpora for math Supervised Fine-Tuning (SFT) across multiple languages not only significantly enhances model performance multilingually but also elevates their monolingual performance. This indicates that crafting multilingual corpora can be regarded as a vital strategy for enhancing model performance in a specific language, especially in mathematical reasoning tasks. For instance, MathOctopus-7B improves its counterparts that trained on English from 42.2% to 50.8% on GSM8K testset.


title: Relativistic description of asymmetric fully heavy tetraquarks in the diquark-antidiquark model

abstract: Masses of the ground, orbitally and radially excited states of the asymmetric fully heavy tetraquarks, composed of charm (c) and bottom (b) quarks and antiquarks are calculated in the relativistic diquark-antidiquark picture. The relativistic quark model based on the quasipotential approach and quantum chromodynamics is used to construct the quasipotentials of the quark-quark and diquark-antidiquark interactions. These quasipotentials consist of the short-range one-gluon exchange and long-distance linear confinement interactions. Relativistic effects are consistently taken into account. A tetraquark is considered as a bound state of a diquark and an antidiquark which are treated as a spatially extended colored objects and interact as a whole. It is shown that most of the investigated tetraquarks states (including all ground states) lie above the fall-apart strong decay thresholds into a meson pair. As a result they can be observed as wide resonances. Nevertheless, several orbitally excited states lie slightly above or even below these fall-apart thresholds, thus they could be narrow states.


title: Relative normalization

abstract: G{\"o}del's second incompleteness theorem forbids to prove, in a given theory U, the consistency of many theories-in particular, of the theory U itself-as well as it forbids to prove the normalization property for these theories, since this property implies their consistency. When we cannot prove in a theory U the consistency of a theory T , we can try to prove a relative consistency theorem, that is, a theorem of the form: If U is consistent then T is consistent. Following the same spirit, we show in this paper how to prove relative normalization theorems, that is, theorems of the form: If U is 1-consistent, then T has the normalization property.


title: Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Prior

abstract: Creating believable motions for various characters has long been a goal in computer graphics. Current learning-based motion synthesis methods depend on extensive motion datasets, which are often challenging, if not impossible, to obtain. On the other hand, pose data is more accessible, since static posed characters are easier to create and can even be extracted from images using recent advancements in computer vision. In this paper, we utilize this alternative data source and introduce a neural motion synthesis approach through retargeting. Our method generates plausible motions for characters that have only pose data by transferring motion from an existing motion capture dataset of another character, which can have drastically different skeletons. Our experiments show that our method effectively combines the motion features of the source character with the pose features of the target character, and performs robustly with small or noisy pose data sets, ranging from a few artist-created poses to noisy poses estimated directly from images. Additionally, a conducted user study indicated that a majority of participants found our retargeted motion to be more enjoyable to watch, more lifelike in appearance, and exhibiting fewer artifacts. Project page: https://cyanzhao42.github.io/pose2motion


title: Diversified Node Sampling based Hierarchical Transformer Pooling for Graph Representation Learning

abstract: Graph pooling methods have been widely used on downsampling graphs, achieving impressive results on multiple graph-level tasks like graph classification and graph generation. An important line called node dropping pooling aims at exploiting learnable scoring functions to drop nodes with comparatively lower significance scores. However, existing node dropping methods suffer from two limitations: (1) for each pooled node, these models struggle to capture long-range dependencies since they mainly take GNNs as the backbones; (2) pooling only the highest-scoring nodes tends to preserve similar nodes, thus discarding the affluent information of low-scoring nodes. To address these issues, we propose a Graph Transformer Pooling method termed GTPool, which introduces Transformer to node dropping pooling to efficiently capture long-range pairwise interactions and meanwhile sample nodes diversely. Specifically, we design a scoring module based on the self-attention mechanism that takes both global context and local context into consideration, measuring the importance of nodes more comprehensively. GTPool further utilizes a diversified sampling method named Roulette Wheel Sampling (RWS) that is able to flexibly preserve nodes across different scoring intervals instead of only higher scoring nodes. In this way, GTPool could effectively obtain long-range information and select more representative nodes. Extensive experiments on 11 benchmark datasets demonstrate the superiority of GTPool over existing popular graph pooling methods.


title: An Implementation of Multimodal Fusion System for Intelligent Digital Human Generation

abstract: With the rapid development of artificial intelligence (AI), digital humans have attracted more and more attention and are expected to achieve a wide range of applications in several industries. Then, most of the existing digital humans still rely on manual modeling by designers, which is a cumbersome process and has a long development cycle. Therefore, facing the rise of digital humans, there is an urgent need for a digital human generation system combined with AI to improve development efficiency. In this paper, an implementation scheme of an intelligent digital human generation system with multimodal fusion is proposed. Specifically, text, speech and image are taken as inputs, and interactive speech is synthesized using large language model (LLM), voiceprint extraction, and text-to-speech conversion techniques. Then the input image is age-transformed and a suitable image is selected as the driving image. Then, the modification and generation of digital human video content is realized by digital human driving, novel view synthesis, and intelligent dressing techniques. Finally, we enhance the user experience through style transfer, super-resolution, and quality evaluation. Experimental results show that the system can effectively realize digital human generation. The related code is released at https://github.com/zyj-2000/CUMT_2D_PhotoSpeaker.


title: Dynamic heterogeneity at the experimental glass transition predicted by transferable machine learning

abstract: We develop a transferable machine learning model which predicts structural relaxation from amorphous supercooled liquid structures. The trained networks are able to predict dynamic heterogeneity across a broad range of temperatures and time scales with excellent accuracy and transferability. We use the network transferability to predict dynamic heterogeneity down to the experimental glass transition temperature, $T_g$, where structural relaxation cannot be analyzed using molecular dynamics simulations. The results indicate that the strength, the geometry and the characteristic length scale of the dynamic heterogeneity evolve much more slowly near $T_g$ compared to their evolution at higher temperatures. Our results show that machine learning techniques can provide physical insights on the nature of the glass transition that cannot be gained using conventional simulation techniques.