title: AG-ReID.v2: Bridging Aerial and Ground Views for Person Re-identification

abstract: Aerial-ground person re-identification (Re-ID) presents unique challenges in computer vision, stemming from the distinct differences in viewpoints, poses, and resolutions between high-altitude aerial and ground-based cameras. Existing research predominantly focuses on ground-to-ground matching, with aerial matching less explored due to a dearth of comprehensive datasets. To address this, we introduce AG-ReID.v2, a dataset specifically designed for person Re-ID in mixed aerial and ground scenarios. This dataset comprises 100,502 images of 1,615 unique individuals, each annotated with matching IDs and 15 soft attribute labels. Data were collected from diverse perspectives using a UAV, stationary CCTV, and smart glasses-integrated camera, providing a rich variety of intra-identity variations. Additionally, we have developed an explainable attention network tailored for this dataset. This network features a three-stream architecture that efficiently processes pairwise image distances, emphasizes key top-down features, and adapts to variations in appearance due to altitude differences. Comparative evaluations demonstrate the superiority of our approach over existing baselines. We plan to release the dataset and algorithm source code publicly, aiming to advance research in this specialized field of computer vision. For access, please visit https://github.com/huynguyen792/AG-ReID.v2.


title: Bregman Proximal Linearized ADMM for Minimizing Separable Sums Coupled by a Difference of Functions

abstract: In this paper, we develop a splitting algorithm incorporating Bregman distances to solve a broad class of linearly constrained composite optimization problems, whose objective function is the separable sum of possibly nonconvex nonsmooth functions and a smooth function, coupled by a difference of functions. This structure encapsulates numerous significant nonconvex and nonsmooth optimization problems in the current literature including the linearly constrained difference-of-convex problems. Relying on the successive linearization and alternating direction method of multipliers (ADMM), the proposed algorithm exhibits the global subsequential convergence to a stationary point of the underlying problem. We also establish the convergence of the full sequence generated by our algorithm under the Kurdyka-Lojasiewicz property and some mild assumptions. The efficiency of the proposed algorithm is tested on a robust principal component analysis problem and a nonconvex optimal power flow problem.


title: Algorithms for Computing Closest Points for Segments

abstract: Given a set $P$ of $n$ points and a set $S$ of $n$ segments in the plane, we consider the problem of computing for each segment of $S$ its closest point in $P$. The previously best algorithm solves the problem in $n^{4/3}2^{O(\log^*n)}$ time [Bespamyatnikh, 2003] and a lower bound (under a somewhat restricted model) $\Omega(n^{4/3})$ has also been proved. In this paper, we present an $O(n^{4/3})$ time algorithm and thus solve the problem optimally (under the restricted model). In addition, we also present data structures for solving the online version of the problem, i.e., given a query segment (or a line as a special case), find its closest point in $P$. Our new results improve the previous work.


title: Stability of Hydrides in Sub-Neptune Exoplanets with Thick Hydrogen-Rich Atmospheres

abstract: Many sub-Neptune exoplanets have been believed to be composed of a thick hydrogen-dominated atmosphere and a high-temperature heavier-element-dominant core. From an assumption that there is no chemical reaction between hydrogen and silicates/metals at the atmosphere-interior boundary, the cores of sub-Neptunes have been modeled with molten silicates and metals (magma) in previous studies. In large sub-Neptunes, pressure at the atmosphere-magma boundary can reach tens of gigapascals where hydrogen is a dense liquid. A recent experiment showed that hydrogen can induce the reduction of Fe$^{2+}$ in (Mg,Fe)O to Fe$^0$ metal at the pressure-temperature conditions relevant to the atmosphere-interior boundary. However, it is unclear if Mg, one of the abundant heavy elements in the planetary interiors, remains oxidized or can be reduced by H. Our experiments in the laser-heated diamond-anvil cell found that heating of MgO + Fe to 3500-4900 K (close to or above their melting temperatures) in a H medium leads to the formation of Mg$_2$FeH$_6$ and H$_2$O at 8-13 GPa. At 26-29 GPa, the behavior of the system changes, and Mg-H in an H fluid and H$_2$O were detected with separate FeH$_x$. The observations indicate the dissociation of the Mg-O bond by H and subsequent production of hydride and water. Therefore, the atmosphere-magma interaction can lead to a fundamentally different mineralogy for sub-Neptune exoplanets compared with rocky planets. The change in the chemical reaction at the higher pressures can also affect the size demographics (i.e., "radius cliff") and the atmosphere chemistry of sub-Neptune exoplanets.


title: Probabilistic degenerate Fubini polynomials associated with random variables

abstract: Let Y be a random variable such that the moment generating function of Y exists in a neighborhood of the origin. The aim of this paper is to study probabilistic versions of the degenerate Fubini polynomials and the degenerate Fubini polynomials of order $r$, namely the probabilisitc degenerate Fubini polynomials associated with Y and the probabilistic degenerate Fubini polynomials of order r associated with Y. We derive some properties, explicit expressions, certain identities and recurrence relations for those polynomials.


title: Spectral integral variation of signed graphs

abstract: We characterize when the spectral variation of the signed Laplacian matrices is integral after a new edge is added to a signed graph. As an application, for every fixed signed complete graph, we fully characterize the class of signed graphs to which one can recursively add new edges keeping spectral integral variation to make the signed complete graph.


title: The Fate of Simple Organics on Titan's Surface: A Theoretical Perspective

abstract: Atmospheric photochemistry on Titan continuously transforms methane and nitrogen gases into various organic compounds. This study explores the fate of these molecules when they land on Titan's surface. Our analytical exploration reveals that most simple organics found in Titan's atmosphere, including all nitriles, triple-bonded hydrocarbons, and benzene, land as solids. Only a few compounds are in the liquid phase, while only ethylene remains gaseous. For the simple organics that land as solids, we further examine their interactions with Titan's lake liquids. Utilizing principles of buoyancy, we found that flotation can be achieved via porosity-induced (25-60% porosity) or capillary force-induced buoyancy for HCN ices on ethane-rich lakes. Otherwise, these ices would sink and become lakebed sediments. By evaluating the timescale of flotation, our findings suggest that porosity-induced flotation of millimeter-sized and larger sediments is the only plausible mechanism for floating solids to explain the transient "magic islands" phenomena on Titan's lakes.


title: Period modulations of the long secondary periods on the AGB stars

abstract: 30$\%$--50$\%$ of the luminous pulsating red-giant stars show light variations of a longer period than the pulsation periods. Those periods are called long secondary periods (LSP). There has been debated for many years but the origin of the LSP is still unknown. To explain the LSP variations, there have been many approaches in not only observations but also theoretical studies. However, the invariance of the length of the LSPs has been investigated little. Thus, we studied the temporal variations of the period by performing the weighted wavelet-Z-transform analysis. Using the OGLE-III database, the $I$-band light curves of 6904 and 1945 LSP candidates in the Large/Small Magellanic Clouds, respectively, were analyzed. Most of our sample stars indicated that the period corresponding to the LSP was constant during the observation term. However, 101 and 44 LSP stars in the LMC and SMC, respectively, showed the signature of the temporal variations of the LSPs. There were diversities of the period modulations i.e. monotonic increase or decrease, or constant until the middle and then increase, etc. The comet-like companion is one of the possible explanations for the LSP variations, but this hypothesis cannot explain the period modulations because the LSP is determined by the orbital period.


title: Signatures of room-temperature superconductivity emerging in two-dimensional domains within the new Bi/Pb-based ceramic cuprate superconductors at ambient pressure

abstract: We predict the possibility of realizing room-temperature superconductivity in different 2D domains within the ceramic high-Tc cuprates at ambient pressure and experimentally confirm this prediction of 2D room-temperature superconductivity in the newly derived Bi/Pb-based ceramic cuprates containing many grain boundaries, interfaces and multiplate blocks. We argue that, in these high-Tc materials, besides bulk superconductivity in 3D domains there is also strongly enhanced 2D superconductivity emerging in the 3D-2D crossover region well above the superconducting transition temperature Tc. We study the possibility of the existence of distinct 3D and 2D superconducting phases in high-Tc ceramic cuprates, in which the unconventional Cooper pairs behave like bosons and condense below certain critical temperatures into 3D and 2D Bose superfluids in 3D and 2D domains. We show that the superconducting transition temperature in 2D domains is much higher than in 3D domains and can reach up to room temperature. We report signatures of room-temperature superconductivity occurring at different grain boundaries and 3D/2D interfaces and in multiplate blocks within the ceramic superconductors, synthesized by using the new melt technology in a large solar furnace. The samples of these materials synthesized under the influence of concentrated solar energy have the bulk Tc values ranging from 100 K to about 140 K and the more higher superconducting transition temperatures, possibly even as high as room temperature in the 3D-2D crossover region. The remnant 2D superconductivity in newly derived Bi/Pb-based ceramic cuprate superconductors is observed at temperatures 200-300 K well above the bulk Tc and the onset of room-temperature superconductivity is evidenced by the observations of a sharp step-like drop in the resistance and a well-detectable partial Meissner effect at around 300 K and ambient pressure.


title: Training and Serving System of Foundation Models: A Comprehensive Survey

abstract: Foundation models (e.g., ChatGPT, DALL-E, PengCheng Mind, PanGu-$\Sigma$) have demonstrated extraordinary performance in key technological areas, such as natural language processing and visual recognition, and have become the mainstream trend of artificial general intelligence. This has led more and more major technology giants to dedicate significant human and financial resources to actively develop their foundation model systems, which drives continuous growth of these models' parameters. As a result, the training and serving of these models have posed significant challenges, including substantial computing power, memory consumption, bandwidth demands, etc. Therefore, employing efficient training and serving strategies becomes particularly crucial. Many researchers have actively explored and proposed effective methods. So, a comprehensive survey of them is essential for system developers and researchers. This paper extensively explores the methods employed in training and serving foundation models from various perspectives. It provides a detailed categorization of these state-of-the-art methods, including finer aspects such as network, computing, and storage. Additionally, the paper summarizes the challenges and presents a perspective on the future development direction of foundation model systems. Through comprehensive discussion and analysis, it hopes to provide a solid theoretical basis and practical guidance for future research and applications, promoting continuous innovation and development in foundation model systems.


title: Simple Hierarchical Planning with Diffusion

abstract: Diffusion-based generative methods have proven effective in modeling trajectories with offline datasets. However, they often face computational challenges and can falter in generalization, especially in capturing temporal abstractions for long-horizon tasks. To overcome this, we introduce the Hierarchical Diffuser, a simple, fast, yet surprisingly effective planning method combining the advantages of hierarchical and diffusion-based planning. Our model adopts a "jumpy" planning strategy at the higher level, which allows it to have a larger receptive field but at a lower computational cost -- a crucial factor for diffusion-based planning methods, as we have empirically verified. Additionally, the jumpy sub-goals guide our low-level planner, facilitating a fine-tuning stage and further improving our approach's effectiveness. We conducted empirical evaluations on standard offline reinforcement learning benchmarks, demonstrating our method's superior performance and efficiency in terms of training and planning speed compared to the non-hierarchical Diffuser as well as other hierarchical planning methods. Moreover, we explore our model's generalization capability, particularly on how our method improves generalization capabilities on compositional out-of-distribution tasks.


title: Information entropy in excited states in confined quantum systems

abstract: The present contribution constitutes a brief account of information theoretical analysis in several representative model as well as real quantum mechanical systems. There has been an overwhelming interest to study such measures in various quantum systems, as evidenced by a vast amount of publications in the literature that has taken place in recent years. However, while such works are numerous in so-called \emph{free} systems, there is a genuine lack of these in their constrained counterparts. With this in mind, this chapter will focus on some of the recent exciting progresses that has been witnessed in our laboratory \cite{sen06,roy14mpla,roy14mpla_manning,roy15ijqc, roy16ijqc, mukherjee15,mukherjee16,majumdar17,mukherjee18a,mukherjee18b,mukherjee18c,mukherjee18d,majumdar20,mukherjee21,majumdar21a, majumdar21b}, and elsewhere, with special emphasis on following prototypical systems, namely, (i) double well (DW) potential (symmetric and asymmetric) (ii) \emph{free}, as well as a \emph{confined hydrogen atom} (CHA) enclosed in a spherical impenetrable cavity (iii) a many-electron atom under similar enclosed environment.


title: Recent Advancement in 3D Biometrics using Monocular Camera

abstract: Recent literature has witnessed significant interest towards 3D biometrics employing monocular vision for robust authentication methods. Motivated by this, in this work we seek to provide insight on recent development in the area of 3D biometrics employing monocular vision. We present the similarity and dissimilarity of 3D monocular biometrics and classical biometrics, listing the strengths and challenges. Further, we provide an overview of recent techniques in 3D biometrics with monocular vision, as well as application systems adopted by the industry. Finally, we discuss open research problems in this area of research


title: Technical Report: Modeling Average False Positive Rates of Recycling Bloom Filters

abstract: Bloom Filters are a space-efficient data structure used for the testing of membership in a set that errs only in the False Positive direction. However, the standard analysis that measures this False Positive rate provides a form of worst case bound that is both overly conservative for the majority of network applications that utilize Bloom Filters, and reduces accuracy by not taking into account the actual state (number of bits set) of the Bloom Filter after each arrival. In this paper, we more accurately characterize the False Positive dynamics of Bloom Filters as they are commonly used in networking applications. In particular, network applications often utilize a Bloom Filter that "recycles": it repeatedly fills, and upon reaching a certain level of saturation, empties and fills again. In this context, it makes more sense to evaluate performance using the average False Positive rate instead of the worst case bound. We show how to efficiently compute the average False Positive rate of recycling Bloom Filter variants via renewal and Markov models. We apply our models to both the standard Bloom Filter and a "two-phase" variant, verify the accuracy of our model with simulations, and find that the previous analysis' worst-case formulation leads to up to a 30\% reduction in the efficiency of Bloom Filter when applied in network applications, while two-phase overhead diminishes as the needed False Positive rate is tightened.


title: Carrier Selectivity and Passivation at the Group V elemental 2D Material--Si Interface of a PV Device

abstract: This study investigates the interfacial characteristics relevant to photovoltaic (PV) devices of the Group--V elemental 2D layers with Si. The surface passivation and carrier selectivity of the interface between $\alpha$ and $\beta$ allotropes of arsenene, antimonene, and bismuthene monolayers with Si (100) and Si(111) were estimated \emph{via} first--principles calculations. Amongst the various interface configurations studied, all of the Si(111)--based slabs and only a couple of the Si(100)--based slabs are found to be stable. Bader charge analysis reveals that charge transfer from/to the Si slab to (As)/from (Sb and Bi) in the 2D layer occurs, indicating a strong interaction between atoms across the interface. Comparing within the various configurations of a particular charge (electron or hole) selective layer, the structural distortion of the Si slab is the lowest for $\alpha$--As/Si and $\beta$-Bi/Si. This translates as a lower surface density of states (DOS) in the band gap arising out of the Si slab when integrated with $\alpha$--arsenene and $\beta$--bismuthene, implying better surface passivation. All-in-all, our analysis suggests $\alpha$-As as the best candidate for a passivating electron selective layer, while $\beta$-Bi can be a promising candidate for a passivating hole selective layer.


title: Enhancing 3D-Air Signature by Pen Tip Tail Trajectory Awareness: Dataset and Featuring by Novel Spatio-temporal CNN

abstract: This work proposes a novel process of using pen tip and tail 3D trajectory for air signature. To acquire the trajectories we developed a new pen tool and a stereo camera was used. We proposed SliT-CNN, a novel 2D spatial-temporal convolutional neural network (CNN) for better featuring of the air signature. In addition, we also collected an air signature dataset from $45$ signers. Skilled forgery signatures per user are also collected. A detailed benchmarking of the proposed dataset using existing techniques and proposed CNN on existing and proposed dataset exhibit the effectiveness of our methodology.


title: Improving sample efficiency of high dimensional Bayesian optimization with MCMC

abstract: Sequential optimization methods are often confronted with the curse of dimensionality in high-dimensional spaces. Current approaches under the Gaussian process framework are still burdened by the computational complexity of tracking Gaussian process posteriors and need to partition the optimization problem into small regions to ensure exploration or assume an underlying low-dimensional structure. With the idea of transiting the candidate points towards more promising positions, we propose a new method based on Markov Chain Monte Carlo to efficiently sample from an approximated posterior. We provide theoretical guarantees of its convergence in the Gaussian process Thompson sampling setting. We also show experimentally that both the Metropolis-Hastings and the Langevin Dynamics version of our algorithm outperform state-of-the-art methods in high-dimensional sequential optimization and reinforcement learning benchmarks.


title: Benchmarking PathCLIP for Pathology Image Analysis

abstract: Accurate image classification and retrieval are of importance for clinical diagnosis and treatment decision-making. The recent contrastive language-image pretraining (CLIP) model has shown remarkable proficiency in understanding natural images. Drawing inspiration from CLIP, PathCLIP is specifically designed for pathology image analysis, utilizing over 200,000 image and text pairs in training. While the performance the PathCLIP is impressive, its robustness under a wide range of image corruptions remains unknown. Therefore, we conduct an extensive evaluation to analyze the performance of PathCLIP on various corrupted images from the datasets of Osteosarcoma and WSSS4LUAD. In our experiments, we introduce seven corruption types including brightness, contrast, Gaussian blur, resolution, saturation, hue, and markup at four severity levels. Through experiments, we find that PathCLIP is relatively robustness to image corruptions and surpasses OpenAI-CLIP and PLIP in zero-shot classification. Among the seven corruptions, blur and resolution can cause server performance degradation of the PathCLIP. This indicates that ensuring the quality of images is crucial before conducting a clinical test. Additionally, we assess the robustness of PathCLIP in the task of image-image retrieval, revealing that PathCLIP performs less effectively than PLIP on Osteosarcoma but performs better on WSSS4LUAD under diverse corruptions. Overall, PathCLIP presents impressive zero-shot classification and retrieval performance for pathology images, but appropriate care needs to be taken when using it. We hope this study provides a qualitative impression of PathCLIP and helps understand its differences from other CLIP models.


title: Adaptive Discounting of Training Time Attacks

abstract: Among the most insidious attacks on Reinforcement Learning (RL) solutions are training-time attacks (TTAs) that create loopholes and backdoors in the learned behaviour. Not limited to a simple disruption, constructive TTAs (C-TTAs) are now available, where the attacker forces a specific, target behaviour upon a training RL agent (victim). However, even state-of-the-art C-TTAs focus on target behaviours that could be naturally adopted by the victim if not for a particular feature of the environment dynamics, which C-TTAs exploit. In this work, we show that a C-TTA is possible even when the target behaviour is un-adoptable due to both environment dynamics as well as non-optimality with respect to the victim objective(s). To find efficient attacks in this context, we develop a specialised flavour of the DDPG algorithm, which we term gammaDDPG, that learns this stronger version of C-TTA. gammaDDPG dynamically alters the attack policy planning horizon based on the victim's current behaviour. This improves effort distribution throughout the attack timeline and reduces the effect of uncertainty the attacker has about the victim. To demonstrate the features of our method and better relate the results to prior research, we borrow a 3D grid domain from a state-of-the-art C-TTA for our experiments. Code is available at "bit.ly/github-rb-gDDPG".


title: A Deep Q-Learning based Smart Scheduling of EVs for Demand Response in Smart Grids

abstract: Economic and policy factors are driving the continuous increase in the adoption and usage of electrical vehicles (EVs). However, despite being a cleaner alternative to combustion engine vehicles, EVs have negative impacts on the lifespan of microgrid equipment and energy balance due to increased power demand and the timing of their usage. In our view grid management should leverage on EVs scheduling flexibility to support local network balancing through active participation in demand response programs. In this paper, we propose a model-free solution, leveraging Deep Q-Learning to schedule the charging and discharging activities of EVs within a microgrid to align with a target energy profile provided by the distribution system operator. We adapted the Bellman Equation to assess the value of a state based on specific rewards for EV scheduling actions and used a neural network to estimate Q-values for available actions and the epsilon-greedy algorithm to balance exploitation and exploration to meet the target energy profile. The results are promising showing that the proposed solution can effectively schedule the EVs charging and discharging actions to align with the target profile with a Person coefficient of 0.99, handling effective EVs scheduling situations that involve dynamicity given by the e-mobility features, relying only on data with no knowledge of EVs and microgrid dynamics.


title: PeVatron Candidate SNR G106.3+2.7 in a Low-density Cavity: a Multiwavelength Test

abstract: In this paper, we constrain the density of the interstellar medium (ISM) around the hadronic PeVatron candidate, supernova remnant (SNR) G106.3+2.7, based on X-ray and $\gamma$-ray observations. The purpose of this investigation is to understand the influence of the gaseous environment on this SNR as a proton PeVatron candidate. By modelling the self-regulated propagation of the CRs injected from the SNR, we calculate the $\gamma$-ray emission of CRs via the hadronuclear interactions with the molecular cloud and the ISM, and use the measured $\gamma$-ray flux to constrain the ISM density around the SNR. Our results support the picture that the SNR is expanding into a low-density ($n<0.05 cm^{-3}$) cavity, enabling the SNR to be a potential proton PeVatron despite that it presently is not in the very early phase.


title: CscK metrics near the canonical class

abstract: Let $X$ be a K\"ahler manifold with semi-ample canonical bundle $K_X$. It is proved by Jian-Shi-Song that for any K\"ahler class $\gamma$, there exists $\delta>0$ such that for all $t\in (0, \delta)$ there exists a unique cscK metric $g_t$ in $K_X+ t \gamma $. In this paper, we prove that $\{ (X, g_t) \}_{ t\in (0, \delta)} $ have uniformly bounded K\"ahler potentials, volume forms and diameters. As a consequence, these metric spaces are pre-compact in the Gromov-Hausdorff sense.


title: GTA: Guided Transfer of Spatial Attention from Object-Centric Representations

abstract: Utilizing well-trained representations in transfer learning often results in superior performance and faster convergence compared to training from scratch. However, even if such good representations are transferred, a model can easily overfit the limited training dataset and lose the valuable properties of the transferred representations. This phenomenon is more severe in ViT due to its low inductive bias. Through experimental analysis using attention maps in ViT, we observe that the rich representations deteriorate when trained on a small dataset. Motivated by this finding, we propose a novel and simple regularization method for ViT called Guided Transfer of spatial Attention (GTA). Our proposed method regularizes the self-attention maps between the source and target models. A target model can fully exploit the knowledge related to object localization properties through this explicit regularization. Our experimental results show that the proposed GTA consistently improves the accuracy across five benchmark datasets especially when the number of training data is small.


title: The integer group determinants for GA(1,p) and related semidirect products

abstract: We consider the integer group determinants for groups that are semidirect products of $\mathbb Z_p$ and $\mathbb Z_n$ with $p$ prime and $n\mid p-1$. We give a complete description of the integer group determinants for the general affine groups of degree one GA(1,5) and GA(1,7), and for $\mathbb Z_7\rtimes \mathbb Z_3,$ $\mathbb Z_{11}\rtimes \mathbb Z_5$ and $\mathbb Z_{13}\rtimes \mathbb Z_6,$ showing that the obvious divisibility and congruence conditions arising from the form of the group determinant when $n=p-1$ or $\frac{1}{2}(p-1)$, can be sufficient as well as necessary for these types of groups.


title: Correlated spectro-polarimetric study along the Z track in XTE J1701-462 puts constraints on its coronal geometry

abstract: Context. In September 2022, the transient neutron star low-mass X-ray binary XTE J1701-462 went into a new outburst. Aims. The objective of this work is to examine the evolution of the accretion geometry of XTE J1701-462 by studying the spectro-polarimetric properties along the Z track of this source. The simultaneous observations archived by the Insight-Hard X-ray Modulation Telescope (HXMT) and the Imaging X-ray Polarimetry Explorer (IXPE) give us the opportunity. Methods. We present a comprehensive X-ray spectro-polarimetric analysis of XTE J1701-462, using simultaneous observations from IXPE, Insight-HXMT and NuSTAR. For IXPE observations, two methods are employed to measure the polarization: a model-independent measurement with PCUBE and a model-dependent polarization-spectral analysis with XSPEC. The corresponding spectra from Insight-HXMT and NuSTAR are studied with two configurations that correspond to a slab-like corona and a spherical shell-like corona, respectively. Results. Significant polarization characteristics are detected in XTE J1701-462. The polarization degree shows a decreasing trend along the Z track, reducing from (4.84 $\pm$ 0.37)% to (3.76 $\pm$ 0.43)% on the horizontal branch and jumping to less than 1% on the normal branch. The simultaneous spectral analysis from Insight-HXMT and NuSTAR suggests that the redistribution between the thermal and Comptonized emission could be the reason for the PD evolution along the Z track. Based on the correlated spectro-polarimetric properties, we propose that this source likely has a slab coronal geometry and the size/thickness of the corona decreases along the Z track.


title: MalModel: Hiding Malicious Payload in Mobile Deep Learning Models with Black-box Backdoor Attack

abstract: Mobile malware has become one of the most critical security threats in the era of ubiquitous mobile computing. Despite the intensive efforts from security experts to counteract it, recent years have still witnessed a rapid growth of identified malware samples. This could be partly attributed to the newly-emerged technologies that may constantly open up under-studied attack surfaces for the adversaries. One typical example is the recently-developed mobile machine learning (ML) framework that enables storing and running deep learning (DL) models on mobile devices. Despite obvious advantages, this new feature also inadvertently introduces potential vulnerabilities (e.g., on-device models may be modified for malicious purposes). In this work, we propose a method to generate or transform mobile malware by hiding the malicious payloads inside the parameters of deep learning models, based on a strategy that considers four factors (layer type, layer number, layer coverage and the number of bytes to replace). Utilizing the proposed method, we can run malware in DL mobile applications covertly with little impact on the model performance (i.e., as little as 0.4% drop in accuracy and at most 39ms latency overhead).


title: Exception-aware Lifecycle Model Construction for Framework APIs

abstract: The implementation of complex software systems usually depends on low-level frameworks or third-party libraries. During their evolution, the APIs adding and removing behaviors may cause unexpected compatibility problems. So, precisely analyzing and constructing the framework/ library's API lifecycle model is of great importance. Existing works have proposed the API existence-changing model for defect detection, while not considering the influence of semantic changes in APIs. In some cases, developers will not remove or deprecate APIs but modify their semantics by adding, removing, or modifying their exception-thrown code, which may bring potential defects to upper-level code. Therefore, besides the API existence model, it is also necessary for developers to be concerned with the exception-related code evolution in APIs, which requires the construction of exception-aware API lifecycle models for framework/library projects. To achieve automatic exception-aware API lifecycle model construction, this paper adopts a static analysis technique to extract exception summary information in the framework API code and adopts a multi-step matching strategy to obtain the changing process of exceptions. Then, it generates exception-aware API lifecycle models for the given framework/library project. With this approach, the API lifecycle extraction tool, JavaExP, is implemented, which is based on Java bytecode analysis. Compared to the state-of-the-art tool, JavaExP achieves both a higher F1 score (+60%) and efficiency (+7x), whose precision of exception matching and changing results is 98%. Compared to the exception-unaware API lifecycle modeling on 60 versions, JavaExp can identify 18% times more API changes. Among the 75,433 APIs under analysis, 20% of APIs have changed their exception-throwing behavior at least once after API introduction, which may bring many hidden compatibility issues.


title: Nurse-in-the-Loop Artificial Intelligence for Precision Management of Type 2 Diabetes in a Clinical Trial Utilizing Transfer-Learned Predictive Digital Twin

abstract: Background: Type 2 diabetes (T2D) is a prevalent chronic disease with a significant risk of serious health complications and negative impacts on the quality of life. Given the impact of individual characteristics and lifestyle on the treatment plan and patient outcomes, it is crucial to develop precise and personalized management strategies. Artificial intelligence (AI) provides great promise in combining patterns from various data sources with nurses' expertise to achieve optimal care. Methods: This is a 6-month ancillary study among T2D patients (n = 20, age = 57 +- 10). Participants were randomly assigned to an intervention (AI, n=10) group to receive daily AI-generated individualized feedback or a control group without receiving the daily feedback (non-AI, n=10) in the last three months. The study developed an online nurse-in-the-loop predictive control (ONLC) model that utilizes a predictive digital twin (PDT). The PDT was developed using a transfer-learning-based Artificial Neural Network. The PDT was trained on participants self-monitoring data (weight, food logs, physical activity, glucose) from the first three months, and the online control algorithm applied particle swarm optimization to identify impactful behavioral changes for maintaining the patient's glucose and weight levels for the next three months. The ONLC provided the intervention group with individualized feedback and recommendations via text messages. The PDT was re-trained weekly to improve its performance. Findings: The trained ONLC model achieved >=80% prediction accuracy across all patients while the model was tuned online. Participants in the intervention group exhibited a trend of improved daily steps and stable or improved total caloric and total carb intake as recommended.


title: GainNet: Coordinates the Odd Couple of Generative AI and 6G Networks

abstract: The rapid expansion of AI-generated content (AIGC) reflects the iteration from assistive AI towards generative AI (GAI) with creativity. Meanwhile, the 6G networks will also evolve from the Internet-of-everything to the Internet-of-intelligence with hybrid heterogeneous network architectures. In the future, the interplay between GAI and the 6G will lead to new opportunities, where GAI can learn the knowledge of personalized data from the massive connected 6G end devices, while GAI's powerful generation ability can provide advanced network solutions for 6G network and provide 6G end devices with various AIGC services. However, they seem to be an odd couple, due to the contradiction of data and resources. To achieve a better-coordinated interplay between GAI and 6G, the GAI-native networks (GainNet), a GAI-oriented collaborative cloud-edge-end intelligence framework, is proposed in this paper. By deeply integrating GAI with 6G network design, GainNet realizes the positive closed-loop knowledge flow and sustainable-evolution GAI model optimization. On this basis, the GAI-oriented generic resource orchestration mechanism with integrated sensing, communication, and computing (GaiRom-ISCC) is proposed to guarantee the efficient operation of GainNet. Two simple case studies demonstrate the effectiveness and robustness of the proposed schemes. Finally, we envision the key challenges and future directions concerning the interplay between GAI models and 6G networks.


title: A backdoor attack against link prediction tasks with graph neural networks

abstract: Graph Neural Networks (GNNs) are a class of deep learning models capable of processing graph-structured data, and they have demonstrated significant performance in a variety of real-world applications. Recent studies have found that GNN models are vulnerable to backdoor attacks. When specific patterns (called backdoor triggers, e.g., subgraphs, nodes, etc.) appear in the input data, the backdoor embedded in the GNN models is activated, which misclassifies the input data into the target class label specified by the attacker, whereas when there are no backdoor triggers in the input, the backdoor embedded in the GNN models is not activated, and the models work normally. Backdoor attacks are highly stealthy and expose GNN models to serious security risks. Currently, research on backdoor attacks against GNNs mainly focus on tasks such as graph classification and node classification, and backdoor attacks against link prediction tasks are rarely studied. In this paper, we propose a backdoor attack against the link prediction tasks based on GNNs and reveal the existence of such security vulnerability in GNN models, which make the backdoored GNN models to incorrectly predict unlinked two nodes as having a link relationship when a trigger appear. The method uses a single node as the trigger and poison selected node pairs in the training graph, and then the backdoor will be embedded in the GNN models through the training process. In the inference stage, the backdoor in the GNN models can be activated by simply linking the trigger node to the two end nodes of the unlinked node pairs in the input data, causing the GNN models to produce incorrect link prediction results for the target node pairs.


title: Modelling Open-Source Software Reliability Incorporating Swarm Intelligence-Based Techniques

abstract: In the software industry, two software engineering development best practices coexist: open-source and closed-source software. The former has a shared code that anyone can contribute, whereas the latter has a proprietary code that only the owner can access. Software reliability is crucial in the industry when a new product or update is released. Applying meta-heuristic optimization algorithms for closed-source software reliability prediction has produced significant and accurate results. Now, open-source software dominates the landscape of cloud-based systems. Therefore, providing results on open-source software reliability - as a quality indicator - would greatly help solve the open-source software reliability growth-modelling problem. The reliability is predicted by estimating the parameters of the software reliability models. As software reliability models are inherently nonlinear, traditional approaches make estimating the appropriate parameters difficult and ineffective. Consequently, software reliability models necessitate a high-quality parameter estimation technique. These objectives dictate the exploration of potential applications of meta-heuristic swarm intelligence optimization algorithms for optimizing the parameter estimation of nonhomogeneous Poisson process-based open-source software reliability modelling. The optimization algorithms are firefly, social spider, artificial bee colony, grey wolf, particle swarm, moth flame, and whale. The applicability and performance evaluation of the optimization modelling approach is demonstrated through two real open-source software reliability datasets. The results are promising.


title: Zero-shot Microclimate Prediction with Deep Learning

abstract: Weather station data is a valuable resource for climate prediction, however, its reliability can be limited in remote locations. To compound the issue, making local predictions often relies on sensor data that may not be accessible for a new, previously unmonitored location. In response to these challenges, we propose a novel zero-shot learning approach designed to forecast various climate measurements at new and unmonitored locations. Our method surpasses conventional weather forecasting techniques in predicting microclimate variables by leveraging knowledge extracted from other geographic locations.


title: The Strongly Stable Matching Problem with Closures

abstract: In this paper, we consider one-to-one matchings between two disjoint groups of agents. Each agent has a preference over a subset of the agents in the other group, and these preferences may contain ties. Strong stability is one of the stability concepts in this setting. In this paper, we consider the following variant of strong stability, and we consider computational complexity issues for this solution concept. In our setting, we are given a subset of the agents on one side. Then when an agent in this subset is not matched to any partner, this agent cannot become a part of a blocking pair. In this paper, we first prove that the problem of determining the existence of a stable matching in this setting is NP-complete. Then we give two polynomial-time solvable cases of our problem. Interestingly, one of our positive results gives a unified approach to the strongly stable matching problem and the envy-free matching problem.


title: Global Hypersurfaces of Section for Geodesic Flows on Convex Hypersurfaces

abstract: We construct a global hypersurface of section for the geodesic flow of a convex hypersurface in Euclidean space admits an isometric involution. This generalizes the Birkhoff annulus to higher dimensions.


title: Towards Integrated Fine-tuning and Inference when Generative AI meets Edge Intelligence

abstract: The high-performance generative artificial intelligence (GAI) represents the latest evolution of computational intelligence, while the blessing of future 6G networks also makes edge intelligence (EI) full of development potential. The inevitable encounter between GAI and EI can unleash new opportunities, where GAI's pre-training based on massive computing resources and large-scale unlabeled corpora can provide strong foundational knowledge for EI, while EI can harness fragmented computing resources to aggregate personalized knowledge for GAI. However, the natural contradictory features pose significant challenges to direct knowledge sharing. To address this, in this paper, we propose the GAI-oriented synthetical network (GaisNet), a collaborative cloud-edge-end intelligence framework that buffers contradiction leveraging data-free knowledge relay, where the bidirectional knowledge flow enables GAI's virtuous-cycle model fine-tuning and task inference, achieving mutualism between GAI and EI with seamless fusion and collaborative evolution. Experimental results demonstrate the effectiveness of the proposed mechanisms. Finally, we discuss the future challenges and directions in the interplay between GAI and EI.


title: Infinite-LLM: Efficient LLM Service for Long Context with DistAttention and Distributed KVCache

abstract: The rapid proliferation of Large Language Models (LLMs) has been a driving force in the growth of cloud-based LLM services, which are now integral to advancing AI applications. However, the dynamic auto-regressive nature of LLM service, along with the need to support exceptionally long context lengths, demands the flexible allocation and release of substantial resources. This presents considerable challenges in designing cloud-based LLM service systems, where inefficient management can lead to performance degradation or resource wastage. In response to these challenges, this work introduces DistAttention, a novel distributed attention algorithm that segments the KV Cache into smaller, manageable units, enabling distributed processing and storage of the attention module. Based on that, we propose DistKV-LLM, a distributed LLM serving system that dynamically manages KV Cache and effectively orchestrates all accessible GPU and CPU memories spanning across the data center. This ensures a high-performance LLM service on the cloud, adaptable to a broad range of context lengths. Validated in a cloud environment with 32 NVIDIA A100 GPUs in configurations from 2 to 32 instances, our system exhibited 1.03-2.4x end-to-end throughput improvements and supported context lengths 2-19x longer than current state-of-the-art LLM service systems, as evidenced by extensive testing across 18 datasets with context lengths up to 1,900K.


title: A full-time scale energy management and battery size optimization for off-grid renewable power to hydrogen systems: A battery energy storage-based grid-forming case in Inner Mongolian

abstract: Hydrogen plays an important role in the context of global carbon reduction. For an off-grid renewable power to hydrogen system (OReP2HS), a grid-forming (GFM) source is essential to provide frequency and voltage references. Here, we take battery works as a GFM source, and the OReP2HS we focus on is comprised of solar photovoltaic, wind turbines, and alkaline electrolyzers for hydrogen generation. An elaborative full-time scale energy management strategy (EMS) covers GFM control to system scheduling (from milliseconds to hours) and is proposed to support high-precision production simulations. Loads of electrolysers are designed to track the renewable power closely to partly replace the energy balancing requirement of the battery. A continuous operation strategy during an emergency like a unit drop is also included in the presented EMS. An off-line simulation-based iterative searching algorithm is developed to find the most suitable size of the battery with the minimum levelized cost of hydrogen (LCOH). A practical OReP2H project located in Inner Mongolian, China is taken as a case study. Simulation results demonstrate the feasibility of the proposed method, and the optimized capacity of the battery (3.4MWh) only accounts for 13.6% of the total installed capacity of the sources with the proposed EMS. Sensitivity analysis shows that LOCH rises from 28.829 CYN/kg to 37.814 CYN/kg, with the time-step for fast power regulation of electrolysers changing from 4s to 1 min with a ramp rate of 0.05MW/s.


title: Spin-Lattice Coupling Induced Rich Magnetic States in CrF$_3$ monolayer

abstract: We systematically studied the spin-lattice couplings in the CrF$_3$ monolayer. Our study reveals that the spin exchange constants between the nearest neighbors are notably affected by these couplings. Specifically, the couplings arise predominantly from three distinct phonon modes, namely the covariant, rotation, and stretch of the Cr-F-Cr-F rhombus. By integrating out the phonon degrees of freedom, we derived an effective spin Hamiltonian featuring four-spin product terms, which yields a remarkably intricate magnetic phase diagram. Significantly, numerous plateau states characterized by fractional magnetizations, including 1/2, 1/3, 2/3, 1/4, 1/5, 5/8, 1/9, and 2/9, emerge in the vicinity of the phase transition boundary separating ferromagnetic and antiferromagnetic states. These findings show the profound influence of spin-lattice couplings on magnetic properties near the magnetic phase boundaries, and the predicted plateau states are expected to be observable in future experiments.


title: Cost-Effectiveness Analysis of COVID-19 Vaccination : A review of some Vaccination Models

abstract: The sudden and rapid spread of the COVID_19 pandemic with its terrible consequences has put the management of governments and the various world institutions into a crisis. They have been subjected to a considerable economic effort to be taken to combat the spread of the pandemic. The economic investment for the research and purchase of vaccines intended for populations is subject to cos-benefit analyzes in various situations in different cases. In this review work, several recent models are analyzed where the appearance of the components is coupled with the economic aspect. The analysis of these models is detailed and the results discussed from different points of view.


title: A unified multichannel far-field speech recognition system: combining neural beamforming with attention based end-to-end model

abstract: Far-field speech recognition is a challenging task that conventionally uses signal processing beamforming to attack noise and interference problem. But the performance has been found usually limited due to heavy reliance on environmental assumption. In this paper, we propose a unified multichannel far-field speech recognition system that combines the neural beamforming and transformer-based Listen, Spell, Attend (LAS) speech recognition system, which extends the end-to-end speech recognition system further to include speech enhancement. Such framework is then jointly trained to optimize the final objective of interest. Specifically, factored complex linear projection (fCLP) has been adopted to form the neural beamforming. Several pooling strategies to combine look directions are then compared in order to find the optimal approach. Moreover, information of the source direction is also integrated in the beamforming to explore the usefulness of source direction as a prior, which is usually available especially in multi-modality scenario. Experiments on different microphone array geometry are conducted to evaluate the robustness against spacing variance of microphone array. Large in-house databases are used to evaluate the effectiveness of the proposed framework and the proposed method achieve 19.26\% improvement when compared with a strong baseline.


title: Message Feedback Interference Cancellation Aided UAMP Iterative Detector for OTFS Systems

abstract: The designing of efficient signal detectors is important and yet challenge for orthogonal time frequency space (OTFS) systems in high-mobility scenarios. In this letter, we develop an efficient message feedback interference cancellation aided unitary approximate message passing (denoted as UAMPMFIC) iterative detector, where the latest feedback messages from variable nodes are utilized for more reliable interference cancellation and performance improvement. A fast recursive scheme is leveraged in the proposed UAMP-MFIC detector to prevent complexity increasing. To further alleviate the error-propagation and improve the receiver performance, we also develop the bidirectional symbol detection structures, where Turbo UAMP-MFIC detector and iterative weight UAMP-MFIC detector are proposed to efficiently fuse the estimation results of forward and backward UAMP-MFIC detectors. The simulation results are finally provided to demonstrate performance improvement of our proposed detectors over existing detectors.


title: LMaaS: Exploring Pricing Strategy of Large Model as a Service for Communication

abstract: The next generation of communication is envisioned to be intelligent communication, that can replace traditional symbolic communication, where highly condensed semantic information considering both source and channel will be extracted and transmitted with high efficiency. The recent popular large models such as GPT4 and the boosting learning techniques lay a solid foundation for the intelligent communication, and prompt the practical deployment of it in the near future. Given the characteristics of "training once and widely use" of those multimodal large language models, we argue that a pay-as-you-go service mode will be suitable in this context, referred to as Large Model as a Service (LMaaS). However, the trading and pricing problem is quite complex with heterogeneous and dynamic customer environments, making the pricing optimization problem challenging in seeking on-hand solutions. In this paper, we aim to fill this gap and formulate the LMaaS market trading as a Stackelberg game with two steps. In the first step, we optimize the seller's pricing decision and propose an Iterative Model Pricing (IMP) algorithm that optimizes the prices of large models iteratively by reasoning customers' future rental decisions, which is able to achieve a near-optimal pricing solution. In the second step, we optimize customers' selection decisions by designing a robust selecting and renting (RSR) algorithm, which is guaranteed to be optimal with rigorous theoretical proof. Extensive experiments confirm the effectiveness and robustness of our algorithms.


title: Solving convex optimization problems via a second order dynamical system with implicit Hessian damping and Tikhonov regularization

abstract: This paper deals with a second order dynamical system with a Tikhonov regularization term in connection to the minimization problem of a convex Fr\'echet differentiable function. The fact that beside the asymptotically vanishing damping we also consider an implicit Hessian driven damping in the dynamical system under study allows us, via straightforward explicit discretization, to obtain inertial algorithms of gradient type. We show that the value of the objective function in a generated trajectory converges rapidly to the global minimum of the objective function and depending the Tikhonov regularization parameter the generated trajectory converges weakly to a minimizer of the objective function or the generated trajectory converges strongly to the element of minimal norm from the $\argmin$ set of the objective function. We also obtain the fast convergence of the velocities towards zero and some integral estimates. Our analysis reveals that the Tikhonov regularization parameter and the damping parameters are strongly correlated, there is a setting of the parameters that separates the cases when weak convergence of the trajectories to a minimizer and strong convergence of the trajectories to the minimal norm minimizer can be obtained.


title: Progressive Knowledge Distillation Of Stable Diffusion XL Using Layer Level Loss

abstract: Stable Diffusion XL (SDXL) has become the best open source text-to-image model (T2I) for its versatility and top-notch image quality. Efficiently addressing the computational demands of SDXL models is crucial for wider reach and applicability. In this work, we introduce two scaled-down variants, Segmind Stable Diffusion (SSD-1B) and Segmind-Vega, with 1.3B and 0.74B parameter UNets, respectively, achieved through progressive removal using layer-level losses focusing on reducing the model size while preserving generative quality. We release these models weights at https://hf.co/Segmind. Our methodology involves the elimination of residual networks and transformer blocks from the U-Net structure of SDXL, resulting in significant reductions in parameters, and latency. Our compact models effectively emulate the original SDXL by capitalizing on transferred knowledge, achieving competitive results against larger multi-billion parameter SDXL. Our work underscores the efficacy of knowledge distillation coupled with layer-level losses in reducing model size while preserving the high-quality generative capabilities of SDXL, thus facilitating more accessible deployment in resource-constrained environments.


title: MusicAOG: an Energy-Based Model for Learning and Sampling a Hierarchical Representation of Symbolic Music

abstract: In addressing the challenge of interpretability and generalizability of artificial music intelligence, this paper introduces a novel symbolic representation that amalgamates both explicit and implicit musical information across diverse traditions and granularities. Utilizing a hierarchical and-or graph representation, the model employs nodes and edges to encapsulate a broad spectrum of musical elements, including structures, textures, rhythms, and harmonies. This hierarchical approach expands the representability across various scales of music. This representation serves as the foundation for an energy-based model, uniquely tailored to learn musical concepts through a flexible algorithm framework relying on the minimax entropy principle. Utilizing an adapted Metropolis-Hastings sampling technique, the model enables fine-grained control over music generation. A comprehensive empirical evaluation, contrasting this novel approach with existing methodologies, manifests considerable advancements in interpretability and controllability. This study marks a substantial contribution to the fields of music analysis, composition, and computational musicology.


title: Global well-posedness and large-time behavior of classical solutions to the Euler-Navier-Stokes system in R^3

abstract: In this paper, we study the Cauchy problem of a two-phase flow system consisting of the compressible isothermal Euler equations and the incompressible Navier-Stokes equations coupled through the drag force, which can be formally derived from the Vlasov-Fokker-Planck/incompressible Navier-Stokes equations. When the initial data is a small perturbation around an equilibrium state, we prove the global well-posedness of the classical solutions to this system and show the solutions tends to the equilibrium state as time goes to infinity. In order to resolve the main difficulty arising from the pressure term of the incompressible Navier-Stokes equations, we properly use the Hodge decomposition, spectral analysis, and energy method to obtain the $L^2$ time decay rates of the solution when the initial perturbation belongs to $L^1$ space. Furthermore, we show that the above time decay rates are optimal.


title: Preliminary report: Initial evaluation of StdPar implementations on AMD GPUs for HPC

abstract: Recently, AMD platforms have not supported offloading C++17 PSTL (StdPar) programs to the GPU. Our previous work highlights how StdPar is able to achieve good performance across NVIDIA and Intel GPU platforms. In that work, we acknowledged AMD's past effort such as HCC, which unfortunately is deprecated and does not support newer hardware platforms. Recent developments by AMD, Codeplay, and AdaptiveCpp (previously known as hipSYCL or OpenSYCL) have enabled multiple paths for StdPar programs to run on AMD GPUs. This informal report discusses our experiences and evaluation of currently available StdPar implementations for AMD GPUs. We conduct benchmarks using our suite of HPC mini-apps with ports in many heterogeneous programming models, including StdPar. We then compare the performance of StdPar, using all available StdPar compilers, to contemporary heterogeneous programming models supported on AMD GPUs: HIP, OpenCL, Thrust, Kokkos, OpenMP, SYCL. Where appropriate, we discuss issues encountered and workarounds applied during our evaluation. Finally, the StdPar model discussed in this report largely depends on Unified Shared Memory (USM) performance and very few AMD GPUs have proper support for this feature. As such, this report demonstrates a proof-of-concept host-side userspace pagefault solution for models that use the HIP API. We discuss performance improvements achieved with our solution using the same set of benchmarks.


title: Displaying risk in mergers: a diagrammatic approach for exchange ratio determination

abstract: This article extends, in a stochastic setting, previous results in the determination of feasible exchange ratios for merging companies. A first outcome is that shareholders of the companies involved in the merging process face both an upper and a lower bounds for acceptable exchange ratios. Secondly, in order for the improved `bargaining region' to be intelligibly displayed, the diagrammatic approach developed by Kulpa is exploited.


title: Homophily-Related: Adaptive Hybrid Graph Filter for Multi-View Graph Clustering

abstract: Recently there is a growing focus on graph data, and multi-view graph clustering has become a popular area of research interest. Most of the existing methods are only applicable to homophilous graphs, yet the extensive real-world graph data can hardly fulfill the homophily assumption, where the connected nodes tend to belong to the same class. Several studies have pointed out that the poor performance on heterophilous graphs is actually due to the fact that conventional graph neural networks (GNNs), which are essentially low-pass filters, discard information other than the low-frequency information on the graph. Nevertheless, on certain graphs, particularly heterophilous ones, neglecting high-frequency information and focusing solely on low-frequency information impedes the learning of node representations. To break this limitation, our motivation is to perform graph filtering that is closely related to the homophily degree of the given graph, with the aim of fully leveraging both low-frequency and high-frequency signals to learn distinguishable node embedding. In this work, we propose Adaptive Hybrid Graph Filter for Multi-View Graph Clustering (AHGFC). Specifically, a graph joint process and graph joint aggregation matrix are first designed by using the intrinsic node features and adjacency relationship, which makes the low and high-frequency signals on the graph more distinguishable. Then we design an adaptive hybrid graph filter that is related to the homophily degree, which learns the node embedding based on the graph joint aggregation matrix. After that, the node embedding of each view is weighted and fused into a consensus embedding for the downstream task. Experimental results show that our proposed model performs well on six datasets containing homophilous and heterophilous graphs.


title: Geometric-Facilitated Denoising Diffusion Model for 3D Molecule Generation

abstract: Denoising diffusion models have shown great potential in multiple research areas. Existing diffusion-based generative methods on de novo 3D molecule generation face two major challenges. Since majority heavy atoms in molecules allow connections to multiple atoms through single bonds, solely using pair-wise distance to model molecule geometries is insufficient. Therefore, the first one involves proposing an effective neural network as the denoising kernel that is capable to capture complex multi-body interatomic relationships and learn high-quality features. Due to the discrete nature of graphs, mainstream diffusion-based methods for molecules heavily rely on predefined rules and generate edges in an indirect manner. The second challenge involves accommodating molecule generation to diffusion and accurately predicting the existence of bonds. In our research, we view the iterative way of updating molecule conformations in diffusion process is consistent with molecular dynamics and introduce a novel molecule generation method named Geometric-Facilitated Molecular Diffusion (GFMDiff). For the first challenge, we introduce a Dual-Track Transformer Network (DTN) to fully excevate global spatial relationships and learn high quality representations which contribute to accurate predictions of features and geometries. As for the second challenge, we design Geometric-Facilitated Loss (GFLoss) which intervenes the formation of bonds during the training period, instead of directly embedding edges into the latent space. Comprehensive experiments on current benchmarks demonstrate the superiority of GFMDiff.


title: Robot Vulnerability and the Elicitation of User Empathy

abstract: This paper describes a between-subjects Amazon Mechanical Turk study (n = 220) that investigated how a robot's affective narrative influences its ability to elicit empathy in human observers. We first conducted a pilot study to develop and validate the robot's affective narratives. Then, in the full study, the robot used one of three different affective narrative strategies (funny, sad, neutral) while becoming less functional at its shopping task over the course of the interaction. As the functionality of the robot degraded, participants were repeatedly asked if they were willing to help the robot. The results showed that conveying a sad narrative significantly influenced the participants' willingness to help the robot throughout the interaction and determined whether participants felt empathetic toward the robot throughout the interaction. Furthermore, a higher amount of past experience with robots also increased the participants' willingness to help the robot. This work suggests that affective narratives can be useful in short-term interactions that benefit from emotional connections between humans and robots.


title: The dimension of polynomial growth holomorphic functions and forms on gradient K\"ahler Ricci shrinkers

abstract: We study polynomial growth holomorphic functions and forms on complete gradient shrinking Ricci solitons. By relating to the spectral data of the $f$-Laplacian, we show that the dimension of the space of polynomial growth holomorphic functions or holomorphic $(p,0)$-forms are finite. In particular, a sharp dimension estimate for the space of linear growth holomorphic functions was obtained. Under some additional curvature assumption, we prove a sharp estimate for the frequency of polynomial growth holomorphic functions, which was used to obtain dimension upper bound as a power function of the polynomial order.


title: Beyond Fidelity: Explaining Vulnerability Localization of Learning-based Detectors

abstract: Vulnerability detectors based on deep learning (DL) models have proven their effectiveness in recent years. However, the shroud of opacity surrounding the decision-making process of these detectors makes it difficult for security analysts to comprehend. To address this, various explanation approaches have been proposed to explain the predictions by highlighting important features, which have been demonstrated effective in other domains such as computer vision and natural language processing. Unfortunately, an in-depth evaluation of vulnerability-critical features, such as fine-grained vulnerability-related code lines, learned and understood by these explanation approaches remains lacking. In this study, we first evaluate the performance of ten explanation approaches for vulnerability detectors based on graph and sequence representations, measured by two quantitative metrics including fidelity and vulnerability line coverage rate. Our results show that fidelity alone is not sufficient for evaluating these approaches, as fidelity incurs significant fluctuations across different datasets and detectors. We subsequently check the precision of the vulnerability-related code lines reported by the explanation approaches, and find poor accuracy in this task among all of them. This can be attributed to the inefficiency of explainers in selecting important features and the presence of irrelevant artifacts learned by DL-based detectors.


title: PAHD: Perception-Action based Human Decision Making using Explainable Graph Neural Networks on SAR Images

abstract: Synthetic Aperture Radar (SAR) images are commonly utilized in military applications for automatic target recognition (ATR). Machine learning (ML) methods, such as Convolutional Neural Networks (CNN) and Graph Neural Networks (GNN), are frequently used to identify ground-based objects, including battle tanks, personnel carriers, and missile launchers. Determining the vehicle class, such as the BRDM2 tank, BMP2 tank, BTR60 tank, and BTR70 tank, is crucial, as it can help determine whether the target object is an ally or an enemy. While the ML algorithm provides feedback on the recognized target, the final decision is left to the commanding officers. Therefore, providing detailed information alongside the identified target can significantly impact their actions. This detailed information includes the SAR image features that contributed to the classification, the classification confidence, and the probability of the identified object being classified as a different object type or class. We propose a GNN-based ATR framework that provides the final classified class and outputs the detailed information mentioned above. This is the first study to provide a detailed analysis of the classification class, making final decisions more straightforward. Moreover, our GNN framework achieves an overall accuracy of 99.2\% when evaluated on the MSTAR dataset, improving over previous state-of-the-art GNN methods.


title: Analysis of a wavelet frame based two-scale model for enhanced edges

abstract: Image restoration is a class of important tasks that emerges from a wide range of scientific disciplines. It has been noticed that most practical images can be modeled as a composition from a sparse singularity set (edges) where the image contents or their gradients change drastically, and cartoon chunks in which a high degree of regularity is dominant. Enhancing edges while promoting regularity elsewhere has been an important criterion for successful restoration in many image classes. In this article, we present a wavelet frame based image restoration model that captures potential edges and facilitates the restoration procedure by a dedicated treatment both of singularity and of cartoon. Moreover, its geometric robustness is enhanced by exploiting subtle inter-scale information available in the coarse image. To substantiate our intuition, we prove that this model converges to one variant of the celebrated Mumford-Shah model when adequate asymptotic specifications are given.


title: Scaling Laws Governing the Elastic Properties of 3D-Graphenes

abstract: In this study, we have comprehensively investigated the scaling law for elastic properties of three-dimensional honeycomb-like graphenes (3D-graphenes) using hybrid neural network potential based molecular dynamics simulations and theoretical analyses. The elastic constants as functions of honeycomb hole size, denoted by the graphene wall length $L$, were provided. All five independent elastic constants in the large $L$ limit are proportional to $L^{-1}$. The associated coefficients are combinations of two-dimensional graphene's elastic constants. High-order terms including $L^{-2}$ and $L^{-3}$ emerge for finite $L$ values. They have three origins, the distorted areas close to the joint lines of 3D-graphenes, the variation of solid angles between graphene plates, and the bending distortion of graphene plates. Significantly, the chirality becomes essential with the decreasing of $L$, because the joint line structures are different between the armchair and zigzag type 3D-graphenes. Our findings provide insights into the elastic properties of graphene-based superstructures and can be used for further studies on graphene-based materials.


title: Further Applications of Schur Rings to Produce GRRs for Dihedral Groups

abstract: This note is a continuation of postgraduate thesis research carried out by the first author under the supervision of the second author at the University of Malta. In that research we took a look at several results relating Schur rings to sufficient conditions for GRRs and then applied those results to produce numerical methods for constructing trivalent GRRs for dihedral groups very quickly.


title: Scaffolding fundamentals and recent advances in sustainable scaffolding techniques for cultured meat development

abstract: In cultured meat (CM) products the paramount significance lies in the fundamental attributes like texture and sensory of the processed end product. To cater to the tactile and gustatory preferences of real meat, the product needs to be designed to incorporate its texture and sensory attributes. Presently CM products are mainly grounded products like sausage, nugget, frankfurter, burger patty, surimi, and steak with less sophistication and need to mimic real meat to grapple with the traditional meat market. The existence of fibrous microstructure in connective and muscle tissues has attracted considerable interest in the realm of tissue engineering. Scaffolding plays an important role in CM production by aiding cell adhesion, growth, differentiation, and alignment. A wide array of scaffolding technologies has been developed for implementation in the realm of biomedical research. In recent years researchers also focus on edible scaffolding to ease the process of CM. However, it is imperative to implement cutting edge technologies like 3D scaffolds, 3D printing, electrospun nanofibers in order to advance the creation of sustainable and edible scaffolding methods in CM production, with the ultimate goal of replicating the sensory and nutritional attributes to mimic real meat cut. This review discusses recent advances in scaffolding techniques and biomaterials related to structured CM production and required advances to create muscle fiber structures to mimic real meat. Keywords: Cultured meat, Scaffolding, Biomaterials, Edible scaffolding, Electrospinning, 3D bioprinting, real meat.


title: A Data-driven dE/dx Simulation with Normalizing Flow

abstract: In high-energy physics, precise measurements rely on highly reliable detector simulations. Traditionally, these simulations involve incorporating experiment data to model detector responses and fine-tuning them. However, due to the complexity of the experiment data, tuning the simulation can be challenging. One crucial aspect for charged particle identification is the measurement of energy deposition per unit length (referred to as dE/dx). This paper proposes a data-driven dE/dx simulation method using the Normalizing Flow technique, which can learn the dE/dx distribution directly from experiment data. By employing this method, not only can the need for manual tuning of the dE/dx simulation be eliminated, but also high-precision simulation can be achieved.


title: Interlayer magnetic interactions and ferroelectricity in $\pi$/3-twisted CrX$_2$ (X = Se, Te) bilayers

abstract: Recently, two-dimensional (2D) bilayer magnetic systems have been widely studied. Their interlayer magnetic interactions play a vital role in the magnetic properties. In this paper, we theoretically studied the interlayer magnetic interactions, magnetic states and ferroelectricity of $\pi$/3-twisted CrX$_2$ (X = Se, Te) bilayers ($\pi$/3-CrX$_2$). Our study reveals that the lateral shift could switch the magnetic state of the $\pi$/3-CrSe$_2$ between interlayer ferromagnetic and antiferromagnetic, while just tuning the strength of the interlayer antiferromagnetic interactions in $\pi$/3-CrTe$_2$. Furthermore, the lateral shift can alter the off-plane electric polarization in both $\pi$/3-CrSe$_2$ and $\pi$/3-CrTe$_2$. These results show that stacking is an effective way to tune both the magnetic and ferroelectric properties of 1T-CrX$_2$ bilayers, making the 1T-CrX$_2$ bilayers hold promise for 2D spintronic devices.


title: Nonconvex High-Dimensional Time-Varying Coefficient Estimation for Noisy High-Frequency Observations

abstract: In this paper, we propose a novel high-dimensional time-varying coefficient estimator for noisy high-frequency observations. In high-frequency finance, we often observe that noises dominate a signal of an underlying true process. Thus, we cannot apply usual regression procedures to analyze noisy high-frequency observations. To handle this issue, we first employ a smoothing method for the observed variables. However, the smoothed variables still contain non-negligible noises. To manage these non-negligible noises and the high dimensionality, we propose a nonconvex penalized regression method for each local coefficient. This method produces consistent but biased local coefficient estimators. To estimate the integrated coefficients, we propose a debiasing scheme and obtain a debiased integrated coefficient estimator using debiased local coefficient estimators. Then, to further account for the sparsity structure of the coefficients, we apply a thresholding scheme to the debiased integrated coefficient estimator. We call this scheme the Thresholded dEbiased Nonconvex LASSO (TEN-LASSO) estimator. Furthermore, this paper establishes the concentration properties of the TEN-LASSO estimator and discusses a nonconvex optimization algorithm.


title: VoroNav: Voronoi-based Zero-shot Object Navigation with Large Language Model

abstract: In the realm of household robotics, the Zero-Shot Object Navigation (ZSON) task empowers agents to adeptly traverse unfamiliar environments and locate objects from novel categories without prior explicit training. This paper introduces VoroNav, a novel semantic exploration framework that proposes the Reduced Voronoi Graph to extract exploratory paths and planning nodes from a semantic map constructed in real time. By harnessing topological and semantic information, VoroNav designs text-based descriptions of paths and images that are readily interpretable by a large language model (LLM). In particular, our approach presents a synergy of path and farsight descriptions to represent the environmental context, enabling LLM to apply commonsense reasoning to ascertain waypoints for navigation. Extensive evaluation on HM3D and HSSD validates VoroNav surpasses existing benchmarks in both success rate and exploration efficiency (absolute improvement: +2.8% Success and +3.7% SPL on HM3D, +2.6% Success and +3.8% SPL on HSSD). Additionally introduced metrics that evaluate obstacle avoidance proficiency and perceptual efficiency further corroborate the enhancements achieved by our method in ZSON planning. Project page: https://voro-nav.github.io


title: Tracking sustainability: co-evolution of economic and ecological activities in the industrialization of the United Kingdom and China

abstract: The co-evolution of economic and ecological activities represents one of the fundamental challenges in the realm of sustainable development. This study on the word trends in mainstream newspapers from the UK and China reveals that both early-industrialised countries and latecomers follow three modes of economic and ecological co-evolution. First, both economic and ecological words demonstrate an S-shaped growth trajectory, and the mode underscores the importance of information propagation, whilst also highlighting the crucial role of self-organisation in the accept society. Second, the co-occurrence of these two type words exhibits a Z-shaped relationship: for two-thirds of the observed period, they display synergistic interactions, while the remaining time shows trade-offs. Lastly, the words related to ecological degradation follow M-shaped trajectories in parallel with economic growth, suggesting periodic disruptions and reconstructions in their interrelationships. Our findings contribute to a more nuanced understanding of the co-evolutionary mechanisms that govern collective behaviours in human society.


title: Probing Inert Triplet Model at a multi-TeV muon collider via vector boson fusion with forward muon tagging

abstract: This study investigates the potential of a multi-TeV Muon Collider (MuC) for probing the Inert Triplet Model (ITM), which introduces a triplet scalar field with hypercharge $Y=0$ to the Standard Model. The ITM stands out as a compelling Beyond the Standard Model scenario, featuring a neutral triplet $T^0$ and charged triplets $T^\pm$. Notably, $T^0$ is posited as a dark matter (DM) candidate, being odd under a $Z_2$ symmetry. Rigorous evaluations against theoretical, collider, and DM experimental constraints corner the triplet scalar mass to a narrow TeV-scale region, within which three benchmark points are identified, with $T^\pm$ masses of 1.2 TeV, 1.85 TeV, and 2.3 TeV, for the collider study. The ITM's unique $TTVV$ four-point vertex, differing from fermionic DM models, facilitates efficient pair production through Vector Boson Fusion (VBF). This characteristic positions the MuC as an ideal platform for exploring the ITM, particularly due to the enhanced VBF cross-sections at high collision energies. To address the challenge of the soft decay products of $T^\pm$ resulting from the narrow mass gap between $T^\pm$ and $T^0$, we propose using Disappearing Charged Tracks (DCTs) from $T^\pm$ and Forward muons as key signatures. We provide event counts for these signatures at MuC energies of 6 TeV and 10 TeV, with respective luminosities of 4 ab$^{-1}$ and 10 ab$^{-1}$. Despite the challenge of beam-induced backgrounds contaminating the signal, we demonstrate that our proposed final states enable the MuC to achieve a $5\sigma$ discovery for the identified benchmark points, particularly highlighting the effectiveness of the final state with one DCT and one Forward muon.


title: A multi-objective optimization framework for terrain modification based on a combined hydrological and earthwork cost-benefit

abstract: The escalating risk of urban inundation has drawn increased attention to urban stormwater management. This study proposes a multi-objective optimization for terrain modification, combining the Non-dominated Sorting Genetic Algorithm II (NSGA-II) with digital elevation model (DEM)-based hydrological cost factor analysis. To reduce the precipitation erosive forces and runoff kinetic energy, the resulting framework offers the possibility of efficiently searching numerous solutions for trade-off sets that meet three conflicting objectives: minimizing maximum flow velocity, maximizing runoff path length and minimizing earthwork costs. Our application case study in H{\o}je Taastrup, Denmark, demonstrates the ability of the optimization framework to iteratively generate diversified modification scenarios, which form the reference for topography planning. The three individual objective preferred solutions, a balanced solution, and twenty solutions under regular ordering are selected and visualized to determine the limits of the optimization and the cost-effectiveness tendency. Integrating genetic algorithms with DEM-based hydrological analysis demonstrates the potential to consider more complicated hydrological benefit objectives with open-ended characteristics. It provides a novel and efficient way to optimize topographic characteristics for improving holistic stormwater management strategies.


title: A procdh topology

abstract: In this article we propose a definition of a procdh topos. We show that it encodes procdh excision, has bounded homotopy dimension and therefore is hypercomplete and admits a conservative family of fibre functors. We also describe the local rings. As an application, we show that nonconnective $K$-theory is the procdh sheafification of connective $K$-theory, and that the motivic cohomology recently proposed by Elmanto and Morrow is the procdh sheafification of Voevodsky's motivic cohomology.


title: Nearly optimal quasienergy estimation and eigenstate preparation of time-periodic Hamiltonians by Sambe space formalism

abstract: Time-periodic (Floquet) systems are one of the most interesting nonequilibrium systems. As the computation of energy eigenvalues and eigenstates of time-independent Hamiltonians is a central problem in both classical and quantum computation, quasienergy and Floquet eigenstates are the important targets. However, their computation has difficulty of time dependence; the problem can be mapped to a time-independent eigenvalue problem by the Sambe space formalism, but it instead requires additional infinite dimensional space and seems to yield higher computational cost than the time-independent cases. It is still unclear whether they can be computed with guaranteed accuracy as efficiently as the time-independent cases. We address this issue by rigorously deriving the cutoff of the Sambe space to achieve the desired accuracy and organizing quantum algorithms for computing quasienergy and Floquet eigenstates based on the cutoff. The quantum algorithms return quasienergy and Floquet eigenstates with guaranteed accuracy like Quantum Phase Estimation (QPE), which is the optimal algorithm for outputting energy eigenvalues and eigenstates of time-independent Hamiltonians. While the time periodicity provides the additional dimension for the Sambe space and ramifies the eigenstates, the query complexity of the algorithms achieves the near-optimal scaling in allwable errors. In addition, as a by-product of these algorithms, we also organize a quantum algorithm for Floquet eigenstate preparation, in which a preferred gapped Floquet eigenstate can be deterministically implemented with nearly optimal query complexity in the gap. These results show that, despite the difficulty of time-dependence, quasienergy and Floquet eigenstates can be computed almost as efficiently as time-independent cases, shedding light on the accurate and fast simulation of nonequilibrium systems on quantum computers.


title: Joint User Association and Power Control for Cell-Free Massive MIMO

abstract: This work proposes novel approaches that jointly design user equipment (UE) association and power control (PC) in a downlink user-centric cell-free massive multiple-input multiple-output (CFmMIMO) network, where each UE is only served by a set of access points (APs) for reducing the fronthaul signalling and computational complexity. In order to maximize the sum spectral efficiency (SE) of the UEs, we formulate a mixed-integer nonconvex optimization problem under constraints on the per-AP transmit power, quality-of-service rate requirements, maximum fronthaul signalling load, and maximum number of UEs served by each AP. In order to solve the formulated problem efficiently, we propose two different schemes according to the different sizes of the CFmMIMO systems. For small-scale CFmMIMO systems, we present a successive convex approximation (SCA) method to obtain a stationary solution and also develop a learning-based method (JointCFNet) to reduce the computational complexity. For large-scale CFmMIMO systems, we propose a low-complexity suboptimal algorithm using accelerated projected gradient (APG) techniques. Numerical results show that our JointCFNet can yield similar performance and significantly decrease the run time compared with the SCA algorithm in small-scale systems. The presented APG approach is confirmed to run much faster than the SCA algorithm in the large-scale system while obtaining an SE performance close to that of the SCA approach. Moreover, the median sum SE of the APG method is up to about 2.8 fold higher than that of the heuristic baseline scheme.


title: VoxelNextFusion: A Simple, Unified and Effective Voxel Fusion Framework for Multi-Modal 3D Object Detection

abstract: LiDAR-camera fusion can enhance the performance of 3D object detection by utilizing complementary information between depth-aware LiDAR points and semantically rich images. Existing voxel-based methods face significant challenges when fusing sparse voxel features with dense image features in a one-to-one manner, resulting in the loss of the advantages of images, including semantic and continuity information, leading to sub-optimal detection performance, especially at long distances. In this paper, we present VoxelNextFusion, a multi-modal 3D object detection framework specifically designed for voxel-based methods, which effectively bridges the gap between sparse point clouds and dense images. In particular, we propose a voxel-based image pipeline that involves projecting point clouds onto images to obtain both pixel- and patch-level features. These features are then fused using a self-attention to obtain a combined representation. Moreover, to address the issue of background features present in patches, we propose a feature importance module that effectively distinguishes between foreground and background features, thus minimizing the impact of the background features. Extensive experiments were conducted on the widely used KITTI and nuScenes 3D object detection benchmarks. Notably, our VoxelNextFusion achieved around +3.20% in AP@0.7 improvement for car detection in hard level compared to the Voxel R-CNN baseline on the KITTI test dataset


title: Verifying Relational Explanations: A Probabilistic Approach

abstract: Explanations on relational data are hard to verify since the explanation structures are more complex (e.g. graphs). To verify interpretable explanations (e.g. explanations of predictions made in images, text, etc.), typically human subjects are used since it does not necessarily require a lot of expertise. However, to verify the quality of a relational explanation requires expertise and is hard to scale-up. GNNExplainer is arguably one of the most popular explanation methods for Graph Neural Networks. In this paper, we develop an approach where we assess the uncertainty in explanations generated by GNNExplainer. Specifically, we ask the explainer to generate explanations for several counterfactual examples. We generate these examples as symmetric approximations of the relational structure in the original data. From these explanations, we learn a factor graph model to quantify uncertainty in an explanation. Our results on several datasets show that our approach can help verify explanations from GNNExplainer by reliably estimating the uncertainty of a relation specified in the explanation.


title: Single Crystal Growth and Transport Properties of van der Waals Materials $AB$Te$_\mathbf{4}$ ($A/B$ = Ti, Zr, Hf)

abstract: Monolayers of $AB$Te$_4$ ($A$/$B$ = Ti, Zr, Hf) were theoretically predicted to be two-dimensional topological insulators, but little has been known about the physical properties of these compounds. Here, we report on the single crystal growth, bulk transport properties, and band structure calculations of these compounds. The magnetotransport properties indicate that all three compounds are multi-carrier systems. The experimental results of ZrTiTe$_4$ and HfTiTe$_4$ can be well fitted by the multi-carrier formula assuming two types of carriers, while three carrier components were necessary for HfZrTe$_4$. Interestingly, one of the carrier mobilities of HfZrTe$_4$ exceeded 1000 cm$^2$V$^{-1}$s$^{-1}$, which was nearly one order in magnitude larger than the carrier mobilities of ZrTiTe$_4$ and HfTiTe$_4$. Our band structure calculations showed that all three compounds are semimetals consistent with the magnetotransport properties. The band structure around the $\Gamma$-point of HfZrTe$_4$ exhibits features that are distinct from the other two compounds, which is likely the reason of the different carrier properties.


title: XUAT-Copilot: Multi-Agent Collaborative System for Automated User Acceptance Testing with Large Language Model

abstract: In past years, we have been dedicated to automating user acceptance testing (UAT) process of WeChat Pay, one of the most influential mobile payment applications in China. A system titled XUAT has been developed for this purpose. However, there is still a human-labor-intensive stage, i.e, test scripts generation, in the current system. Therefore, in this paper, we concentrate on methods of boosting the automation level of the current system, particularly the stage of test scripts generation. With recent notable successes, large language models (LLMs) demonstrate significant potential in attaining human-like intelligence and there has been a growing research area that employs LLMs as autonomous agents to obtain human-like decision-making capabilities. Inspired by these works, we propose an LLM-powered multi-agent collaborative system, named XUAT-Copilot, for automated UAT. The proposed system mainly consists of three LLM-based agents responsible for action planning, state checking and parameter selecting, respectively, and two additional modules for state sensing and case rewriting. The agents interact with testing device, make human-like decision and generate action command in a collaborative way. The proposed multi-agent system achieves a close effectiveness to human testers in our experimental studies and gains a significant improvement of Pass@1 accuracy compared with single-agent architecture. More importantly, the proposed system has launched in the formal testing environment of WeChat Pay mobile app, which saves a considerable amount of manpower in the daily development work.


title: Non-reduced valuation rings and descent for smooth blowup squares

abstract: We consider a class of non-reduced valuation rings, known in the literature as chain rings. We observe that the Grothendieck topology generated by the Zariski topology and smooth blowup squares is exactly the topology which has chain rings for its local rings, and that sheaves for this topology are \emph{not} characterised by excision for smooth blowup squares.


title: Beyond symmetry-protected BICs: transmission through asymmetric crossbar junctions in one-dimensional waveguides

abstract: Over the last few decades, the study of Bound States in the Continuum, their formation, and properties has attracted lots of attention, especially in optics and photonics. It is particularly noticeable that most of these investigations base their studies on symmetric systems. In this article, we study the formation of bound states in the continuum in electronic and photonic transport systems consisting of crossbar junctions formed by one-dimensional waveguides, considering asymmetric junctions with commensurable lengths for the upper and lower arms. We also study how BICs form in linear junction arrays as a function of the distance between consecutive junctions and their commensurability with the upper and lower arms. We solve the Helmholtz equation for the crossbar junctions and calculate the transmission probability, probability density in the intersections, and quality factor. The presence of quasi-BICs is reflected in the transmission probability as a sharp resonance in the middle of a symmetric Fano resonance along with Dirac's delta functions in the probability density and divergence in the quality factors.


title: TripleSurv: Triplet Time-adaptive Coordinate Loss for Survival Analysis

abstract: A core challenge in survival analysis is to model the distribution of censored time-to-event data, where the event of interest may be a death, failure, or occurrence of a specific event. Previous studies have showed that ranking and maximum likelihood estimation (MLE)loss functions are widely-used for survival analysis. However, ranking loss only focus on the ranking of survival time and does not consider potential effect of samples for exact survival time values. Furthermore, the MLE is unbounded and easily subject to outliers (e.g., censored data), which may cause poor performance of modeling. To handle the complexities of learning process and exploit valuable survival time values, we propose a time-adaptive coordinate loss function, TripleSurv, to achieve adaptive adjustments by introducing the differences in the survival time between sample pairs into the ranking, which can encourage the model to quantitatively rank relative risk of pairs, ultimately enhancing the accuracy of predictions. Most importantly, the TripleSurv is proficient in quantifying the relative risk between samples by ranking ordering of pairs, and consider the time interval as a trade-off to calibrate the robustness of model over sample distribution. Our TripleSurv is evaluated on three real-world survival datasets and a public synthetic dataset. The results show that our method outperforms the state-of-the-art methods and exhibits good model performance and robustness on modeling various sophisticated data distributions with different censor rates. Our code will be available upon acceptance.


title: German Text Embedding Clustering Benchmark

abstract: This work introduces a benchmark assessing the performance of clustering German text embeddings in different domains. This benchmark is driven by the increasing use of clustering neural text embeddings in tasks that require the grouping of texts (such as topic modeling) and the need for German resources in existing benchmarks. We provide an initial analysis for a range of pre-trained mono- and multilingual models evaluated on the outcome of different clustering algorithms. Results include strong performing mono- and multilingual models. Reducing the dimensions of embeddings can further improve clustering. Additionally, we conduct experiments with continued pre-training for German BERT models to estimate the benefits of this additional training. Our experiments suggest that significant performance improvements are possible for short text. All code and datasets are publicly available.


title: Synergistic Formulaic Alpha Generation for Quantitative Trading based on Reinforcement Learning

abstract: Mining of formulaic alpha factors refers to the process of discovering and developing specific factors or indicators (referred to as alpha factors) for quantitative trading in stock market. To efficiently discover alpha factors in vast search space, reinforcement learning (RL) is commonly employed. This paper proposes a method to enhance existing alpha factor mining approaches by expanding a search space and utilizing pretrained formulaic alpha set as initial seed values to generate synergistic formulaic alpha. We employ information coefficient (IC) and rank information coefficient (Rank IC) as performance evaluation metrics for the model. Using CSI300 market data, we conducted real investment simulations and observed significant performance improvement compared to existing techniques.


title: Resonant Decay of Kinetic Alfv\'en Waves and Implication on Spectral Cascading

abstract: A general equation describing the resonant nonlinear mode-coupling among kinetic Alfv\'en waves (KAWs) is derived using nonlinear gyrokinetic theory, which can be applied to study the potentially strong spectral energy transfer of KAWs. As a first application, the parametric decay of a pump KAW into two sideband KAWs are studied, with particular emphasis on the cascading in perpendicular wavenumber. It is found that, for the "co-propagating" cases with all three KAWs propagating in the same direction along the equilibrium magnetic field line, it exhibits a dual cascading character in the perpendicular wavenumber space; while for the "counter-propagating" cases with one sideband propagating in the opposite direction with respect to the pump wave, it instead, can exhibit both dual and inverse cascading behaviors. The implications on SAW instability nonlinear saturation and charged particle transport in fusion plasmas is also discussed.