title: Training Generative Question-Answering on Synthetic Data Obtained from an Instruct-tuned Model

abstract: This paper presents a simple and cost-effective method for synthesizing data to train question-answering systems. For training, fine-tuning GPT models is a common practice in resource-rich languages like English, however, it becomes challenging for non-English languages due to the scarcity of sufficient question-answer (QA) pairs. Existing approaches use question and answer generators trained on human-authored QA pairs, which involves substantial human expenses. In contrast, we use an instruct-tuned model to generate QA pairs in a zero-shot or few-shot manner. We conduct experiments to compare various strategies for obtaining QA pairs from the instruct-tuned model. The results demonstrate that a model trained on our proposed synthetic data achieves comparable performance to a model trained on manually curated datasets, without incurring human costs.


title: Samples on Thin Ice: Re-Evaluating Adversarial Pruning of Neural Networks

abstract: Neural network pruning has shown to be an effective technique for reducing the network size, trading desirable properties like generalization and robustness to adversarial attacks for higher sparsity. Recent work has claimed that adversarial pruning methods can produce sparse networks while also preserving robustness to adversarial examples. In this work, we first re-evaluate three state-of-the-art adversarial pruning methods, showing that their robustness was indeed overestimated. We then compare pruned and dense versions of the same models, discovering that samples on thin ice, i.e., closer to the unpruned model's decision boundary, are typically misclassified after pruning. We conclude by discussing how this intuition may lead to designing more effective adversarial pruning methods in future work.


title: Additive one-rank hull codes over finite fields

abstract: This article explores additive codes with one-rank hull, offering key insights and constructions. The article introduces a novel approach to finding one-rank hull codes over finite fields by establishing a connection between self-orthogonal elements and solutions of quadratic forms. It also provides a precise count of self-orthogonal elements for any duality over the finite field $\mathbb{F}_q$, particularly odd primes. Additionally, construction methods for small rank hull codes are introduced. The highest possible minimum distance among additive one-rank hull codes is denoted by $d_1[n,k]_{p^e,M}$. The value of $d_1[n,k]_{p^e,M}$ for $k=1,2$ and $n\geq 2$ with respect to any duality $M$ over any finite field $\mathbb{F}_{p^e}$ is determined. Furthermore, the new quaternary one-rank hull codes are identified over non-symmetric dualities with better parameters than symmetric ones.


title: Turbulent properties of stationary flows in porous media

abstract: In this study, we investigated the flow dynamics in a fixed bed of hydrogel beads using Particle Tracking Velocimetry to compute the velocity field in the middle of the bed for moderate Reynolds numbers. We discovered that despite the overall stationarity of the flow and relatively low Reynolds number, it exhibits complex multiscale spatial dynamics reminiscent of those observed in classical turbulence. We found evidence of the presence of an inertial range and a direct energy cascade, and were able to obtain a value for a "porous" Kolmogorov constant of $C_2 = 3.1\pm 0.3$. This analogy with turbulence opens up new possibilities for understanding mixing and global transport properties in porous media.


title: Self acceleration from spectral geometry in dissipative quantum-walk dynamics

abstract: Dynamic behaviors of a physical system often originate from its spectral properties. In open systems, where the effective non-Hermitian description enables a wealth of spectral structures on the complex plane, the concomitant dynamics is significantly enriched, whereas the identification and comprehension of the underlying connections are challenging. Here we experimentally demonstrate the correspondence between the transient self acceleration of local excitations and the non-Hermitian spectral topology using lossy photonic quantum walks. Focusing first on one-dimensional quantum walks, we show that the measured short-time acceleration of the wave function is proportional to the area enclosed by the eigenspectrum. We then reveal similar correspondence in two-dimension quantum walks, where the self acceleration is proportional to the volume enclosed by the eigenspectrum in the complex parameter space. In both dimensions, the transient self acceleration crosses over to a long-time behavior dominated by a constant flow at the drift velocity. Our results unveil the universal correspondence between spectral topology and transient dynamics, and offer a sensitive probe for phenomena in non-Hermitian systems that originate from spectral geometry.


title: Inverse problems in elastohydrodynamics

abstract: Exploring fluid-structure interactions is essential for understanding the physical principle underlying flow control in biological and man-made systems. Traditionally, we assume that the geometry is known, and from it, the solution to the coupled elastohydrodynamic problem is determined. Solving the inverse problem -- finding the geometry that leads to a desired flow -- has received comparatively less attention. Here, we present a strategy for solving inverse hydroelastic problems. Specifically, we compute the shape of a soft channel that yields a desired flow-rate versus pressure-drop relationship. The analysis is based on low-Reynolds-number hydrodynamics and linear elasticity. We demonstrate its usefulness in understanding intercellular transport in plants and the design of check valves. The sensitivity of the algorithm to fabrication errors and other limitations are discussed.


title: To token or not to token: A Comparative Study of Text Representations for Cross-Lingual Transfer

abstract: Choosing an appropriate tokenization scheme is often a bottleneck in low-resource cross-lingual transfer. To understand the downstream implications of text representation choices, we perform a comparative analysis on language models having diverse text representation modalities including 2 segmentation-based models (\texttt{BERT}, \texttt{mBERT}), 1 image-based model (\texttt{PIXEL}), and 1 character-level model (\texttt{CANINE}). First, we propose a scoring Language Quotient (LQ) metric capable of providing a weighted representation of both zero-shot and few-shot evaluation combined. Utilizing this metric, we perform experiments comprising 19 source languages and 133 target languages on three tasks (POS tagging, Dependency parsing, and NER). Our analysis reveals that image-based models excel in cross-lingual transfer when languages are closely related and share visually similar scripts. However, for tasks biased toward word meaning (POS, NER), segmentation-based models prove to be superior. Furthermore, in dependency parsing tasks where word relationships play a crucial role, models with their character-level focus, outperform others. Finally, we propose a recommendation scheme based on our findings to guide model selection according to task and language requirements.


title: The difficult path to coalescence: massive black hole dynamics in merging low mass dark matter haloes and galaxies

abstract: We present a high resolution numerical study of the sinking and merging of massive black holes (MBHs) with masses in the range of $10^3 - 10^7 \, \mathrm{M}_\odot$ in multiple minor mergers of low mass dark matter halos without and with galaxies ($4\times 10^8 \, \mathrm{M}_\odot \lesssim \mathrm{M}_{\mathrm{halo}} \lesssim 2\times 10^{10} \, \mathrm{M}_\odot)$. The Ketju simulation code, a combination of the Gadget tree solver with accurate regularised integration, uses unsoftened forces between the star/dark matter components and the MBHs for an accurate treatment of dynamical friction and scattering of dark matter/stars by MBH binaries or multiples. Post-Newtonian corrections up to order 3.5 for MBH interactions allow for coalescence by gravitational wave emission and gravitational recoil kicks. Low mass MBHs ($\lesssim 10^5 \, \mathrm{M}_\odot$) hardly sink to the centre or merge. Sinking MBHs have various complex evolution paths - binaries, triplets, free-floating MBHs, and dynamically or recoil ejected MBHs. Collisional interactions with dark matter alone can drive MBHs to coalescence. The highest mass MBHs of $\gtrsim 10^6 M_\odot$ mostly sink to the centre and trigger the scouring of dark matter and stellar cores. The scouring can transform a centrally baryon dominated system to a dark matter dominated system. Our idealized high-resolution study highlights the difficulty to bring in and keep low mass MBHs in the centres of low mass halos/galaxies - a remaining challenge for merger assisted MBH seed growth mechanisms.


title: RT-SRTS: Angle-Agnostic Real-Time Simultaneous 3D Reconstruction and Tumor Segmentation from Single X-Ray Projection

abstract: Radiotherapy is one of the primary treatment methods for tumors, but the organ movement caused by respiration limits its accuracy. Recently, 3D imaging from a single X-ray projection has received extensive attention as a promising approach to address this issue. However, current methods can only reconstruct 3D images without directly locating the tumor and are only validated for fixed-angle imaging, which fails to fully meet the requirements of motion control in radiotherapy. In this study, a novel imaging method RT-SRTS is proposed which integrates 3D imaging and tumor segmentation into one network based on multi-task learning (MTL) and achieves real-time simultaneous 3D reconstruction and tumor segmentation from a single X-ray projection at any angle. Furthermore, the attention enhanced calibrator (AEC) and uncertain-region elaboration (URE) modules have been proposed to aid feature extraction and improve segmentation accuracy. The proposed method was evaluated on fifteen patient cases and compared with three state-of-the-art methods. It not only delivers superior 3D reconstruction but also demonstrates commendable tumor segmentation results. Simultaneous reconstruction and segmentation can be completed in approximately 70 ms, significantly faster than the required time threshold for real-time tumor tracking. The efficacies of both AEC and URE have also been validated in ablation studies. The code of work is available at https://github.com/ZywooSimple/RT-SRTS.


title: Supersaturation beyond color-critical graphs

abstract: The supersaturation problem for a given graph $F$ asks for the minimum number $h_F(n,q)$ of copies of $F$ in an $n$-vertex graph with $ex(n,F)+q$ edges. Subsequent works by Rademacher, Erd\H{o}s, and Lov\'{a}sz and Simonovits determine the optimal range of $q$ (which is linear in $n$) for cliques $F$ such that $h_F(n,q)$ equals the minimum number $t_F(n,q)$ of copies of $F$ obtained from a maximum $F$-free $n$-vertex graph by adding $q$ new edges. A breakthrough result of Mubayi extends this line of research from cliques to color-critical graphs $F$, and this was further strengthened by Pikhurko and Yilma who established the equality $h_F(n,q)=t_F(n,q)$ for $1\leq q\leq \epsilon_F n$ and sufficiently large $n$. In this paper, we present several results on the supersaturation problem that extend beyond the existing framework. Firstly, we explicitly construct infinitely many graphs $F$ with restricted properties for which $h_F(n,q)<q\cdot t_F(n,1)$ holds when $n\gg q\geq 4$, thus refuting a conjecture of Mubayi. Secondly, we extend the result of Pikhurko-Yilma by showing the equality $h_F(n,q)=t_F(n,q)$ in the range $1\leq q\leq \epsilon_F n$ for any member $F$ in a diverse and abundant graph family (which includes color-critical graphs, disjoint unions of cliques $K_r$, and the Petersen graph). Lastly, we prove the existence of a graph $F$ for any positive integer $s$ such that $h_F(n,q)=t_F(n,q)$ holds when $1\leq q\leq \epsilon_F n^{1-1/s}$, and $h_F(n,q)<t_F(n,q)$ when $n^{1-1/s}/\epsilon_F\leq q\leq \epsilon_F n$, indicating that $q=\Theta(n^{1-1/s})$ serves as the threshold for the equality $h_F(n,q)=t_F(n,q)$. We also discuss some additional remarks and related open problems.


title: Jointly Optimized Global-Local Visual Localization of UAVs

abstract: Navigation and localization of UAVs present a challenge when global navigation satellite systems (GNSS) are disrupted and unreliable. Traditional techniques, such as simultaneous localization and mapping (SLAM) and visual odometry (VO), exhibit certain limitations in furnishing absolute coordinates and mitigating error accumulation. Existing visual localization methods achieve autonomous visual localization without error accumulation by matching with ortho satellite images. However, doing so cannot guarantee real-time performance due to the complex matching process. To address these challenges, we propose a novel Global-Local Visual Localization (GLVL) network. Our GLVL network is a two-stage visual localization approach, combining a large-scale retrieval module that finds similar regions with the UAV flight scene, and a fine-grained matching module that localizes the precise UAV coordinate, enabling real-time and precise localization. The training process is jointly optimized in an end-to-end manner to further enhance the model capability. Experiments on six UAV flight scenes encompassing both texture-rich and texture-sparse regions demonstrate the ability of our model to achieve the real-time precise localization requirements of UAVs. Particularly, our method achieves a localization error of only 2.39 meters in 0.48 seconds in a village scene with sparse texture features.


title: On Using GUI Interaction Data to Improve Text Retrieval-based Bug Localization

abstract: One of the most important tasks related to managing bug reports is localizing the fault so that a fix can be applied. As such, prior work has aimed to automate this task of bug localization by formulating it as an information retrieval problem, where potentially buggy files are retrieved and ranked according to their textual similarity with a given bug report. However, there is often a notable semantic gap between the information contained in bug reports and identifiers or natural language contained within source code files. For user-facing software, there is currently a key source of information that could aid in bug localization, but has not been thoroughly investigated - information from the GUI. We investigate the hypothesis that, for end user-facing applications, connecting information in a bug report with information from the GUI, and using this to aid in retrieving potentially buggy files, can improve upon existing techniques for bug localization. To examine this phenomenon, we conduct a comprehensive empirical study that augments four baseline techniques for bug localization with GUI interaction information from a reproduction scenario to (i) filter out potentially irrelevant files, (ii) boost potentially relevant files, and (iii) reformulate text-retrieval queries. To carry out our study, we source the current largest dataset of fully-localized and reproducible real bugs for Android apps, with corresponding bug reports, consisting of 80 bug reports from 39 popular open-source apps. Our results illustrate that augmenting traditional techniques with GUI information leads to a marked increase in effectiveness across multiple metrics, including a relative increase in Hits@10 of 13-18%. Additionally, through further analysis, we find that our studied augmentations largely complement existing techniques.


title: Volumetric Medical Image Segmentation via Scribble Annotations and Shape Priors

abstract: Recently, weakly-supervised image segmentation using weak annotations like scribbles has gained great attention in computer vision and medical image analysis, since such annotations are much easier to obtain compared to time-consuming and labor-intensive labeling at the pixel/voxel level. However, due to a lack of structure supervision on regions of interest (ROIs), existing scribble-based methods suffer from poor boundary localization. Furthermore, most current methods are designed for 2D image segmentation, which do not fully leverage the volumetric information if directly applied to each image slice. In this paper, we propose a scribble-based volumetric image segmentation, Scribble2D5, which tackles 3D anisotropic image segmentation and aims to its improve boundary prediction. To achieve this, we augment a 2.5D attention UNet with a proposed label propagation module to extend semantic information from scribbles and use a combination of static and active boundary prediction to learn ROI's boundary and regularize its shape. Also, we propose an optional add-on component, which incorporates the shape prior information from unpaired segmentation masks to further improve model accuracy. Extensive experiments on three public datasets and one private dataset demonstrate our Scribble2D5 achieves state-of-the-art performance on volumetric image segmentation using scribbles and shape prior if available.


title: Low-Resource Clickbait Spoiling for Indonesian via Question Answering

abstract: Clickbait spoiling aims to generate a short text to satisfy the curiosity induced by a clickbait post. As it is a newly introduced task, the dataset is only available in English so far. Our contributions include the construction of manually labeled clickbait spoiling corpus in Indonesian and an evaluation on using cross-lingual zero-shot question answering-based models to tackle clikcbait spoiling for low-resource language like Indonesian. We utilize selection of multilingual language models. The experimental results suggest that XLM-RoBERTa (large) model outperforms other models for phrase and passage spoilers, meanwhile, mDeBERTa (base) model outperforms other models for multipart spoilers.


title: An SiO Toroid and Wide-angle Outflow associated with the Massive Protostar W75N(B)-VLA2

abstract: We have carried out ALMA observations of the massive star-forming region W75N(B), which contains the massive protostars VLA1, VLA2, and VLA3. Particularly, VLA2 is an enigmatic protostar associated with a wind-driven H$_2$O maser shell, which has evolved from an almost isotropic outflow to a collimated one in just 20 years. The shell expansion seemed to be halted by an obstacle located to the northeast of VLA2. Here we present our findings from observing the 1.3 mm continuum and H$_2$CO and SiO emission lines. Within a region of $\sim 30"$ ($\sim 39,000$ au) diameter, we have detected 40 compact mm-continuum sources, three of them coinciding with VLA1, VLA2, and VLA3. While the H$_2$CO emission is mainly distributed in a fragmented structure around the three massive protostars, but without any of the main H$_2$CO clumps spatially coinciding with them, the SiO is highly concentrated on VLA2, indicating the presence of very strong shocks generated near this protostar. The SiO emission is clearly resolved into an elongated structure ($\sim 0.6"\times0.3"$; $\sim 780$ au$\times$390 au) perpendicular to the major axis of the wind-driven maser shell. The structure and kinematics of the SiO emission are consistent with a toroid and a wide-angle outflow surrounding a central mass of $\sim 10$ M$_{\odot}$, thus supporting previous theoretical predictions regarding the evolution of the outflow. Additionally, we have identified the expected location and estimated the gas density of the obstacle that is hindering the expansion of the maser shell.


title: A Carbon Tracking Model for Federated Learning: Impact of Quantization and Sparsification

abstract: Federated Learning (FL) methods adopt efficient communication technologies to distribute machine learning tasks across edge devices, reducing the overhead in terms of data storage and computational complexity compared to centralized solutions. Rather than moving large data volumes from producers (sensors, machines) to energy-hungry data centers, raising environmental concerns due to resource demands, FL provides an alternative solution to mitigate the energy demands of several learning tasks while enabling new Artificial Intelligence of Things (AIoT) applications. This paper proposes a framework for real-time monitoring of the energy and carbon footprint impacts of FL systems. The carbon tracking tool is evaluated for consensus (fully decentralized) and classical FL policies. For the first time, we present a quantitative evaluation of different computationally and communication efficient FL methods from the perspectives of energy consumption and carbon equivalent emissions, suggesting also general guidelines for energy-efficient design. Results indicate that consensus-driven FL implementations should be preferred for limiting carbon emissions when the energy efficiency of the communication is low (i.e., < 25 Kbit/Joule). Besides, quantization and sparsification operations are shown to strike a balance between learning performances and energy consumption, leading to sustainable FL designs.


title: Dealing with zero-inflated data: achieving SOTA with a two-fold machine learning approach

abstract: In many cases, a machine learning model must learn to correctly predict a few data points with particular values of interest in a broader range of data where many target values are zero. Zero-inflated data can be found in diverse scenarios, such as lumpy and intermittent demands, power consumption for home appliances being turned on and off, impurities measurement in distillation processes, and even airport shuttle demand prediction. The presence of zeroes affects the models' learning and may result in poor performance. Furthermore, zeroes also distort the metrics used to compute the model's prediction quality. This paper showcases two real-world use cases (home appliances classification and airport shuttle demand prediction) where a hierarchical model applied in the context of zero-inflated data leads to excellent results. In particular, for home appliances classification, the weighted average of Precision, Recall, F1, and AUC ROC was increased by 27%, 34%, 49%, and 27%, respectively. Furthermore, it is estimated that the proposed approach is also four times more energy efficient than the SOTA approach against which it was compared to. Two-fold models performed best in all cases when predicting airport shuttle demand, and the difference against other models has been proven to be statistically significant.


title: Learning Regularized Monotone Graphon Mean-Field Games

abstract: This paper studies two fundamental problems in regularized Graphon Mean-Field Games (GMFGs). First, we establish the existence of a Nash Equilibrium (NE) of any $\lambda$-regularized GMFG (for $\lambda\geq 0$). This result relies on weaker conditions than those in previous works for analyzing both unregularized GMFGs ($\lambda=0$) and $\lambda$-regularized MFGs, which are special cases of GMFGs. Second, we propose provably efficient algorithms to learn the NE in weakly monotone GMFGs, motivated by Lasry and Lions [2007]. Previous literature either only analyzed continuous-time algorithms or required extra conditions to analyze discrete-time algorithms. In contrast, we design a discrete-time algorithm and derive its convergence rate solely under weakly monotone conditions. Furthermore, we develop and analyze the action-value function estimation procedure during the online learning process, which is absent from algorithms for monotone GMFGs. This serves as a sub-module in our optimization algorithm. The efficiency of the designed algorithm is corroborated by empirical evaluations.


title: Representations and binomial coefficients

abstract: For a root system R, a field K and a "choice of coefficients in K" we define a category of graded spaces with operators and study some of its properties. Then we assume that the coefficients are given by quantum binomials. We use basic arithmetic properties of binomial coefficients (such as q-versions of Lucas' theorem and the Pfaff-Saalsch\"utz identity) to construct a Frobenius pull back functor and prove a Steinberg's tensor product formula. Then we show that these results imply the corresponding results for reductive algebraic groups in positive characteristics and for quantum groups at roots of unity.


title: Discerning Temporal Difference Learning

abstract: Temporal difference learning (TD) is a foundational concept in reinforcement learning (RL), aimed at efficiently assessing a policy's value function. TD($\lambda$), a potent variant, incorporates a memory trace to distribute the prediction error into the historical context. However, this approach often neglects the significance of historical states and the relative importance of propagating the TD error, influenced by challenges such as visitation imbalance or outcome noise. To address this, we propose a novel TD algorithm named discerning TD learning (DTD), which allows flexible emphasis functions$-$predetermined or adapted during training$-$to allocate efforts effectively across states. We establish the convergence properties of our method within a specific class of emphasis functions and showcase its promising potential for adaptation to deep RL contexts. Empirical results underscore that employing a judicious emphasis function not only improves value estimation but also expedites learning across diverse scenarios.


title: Consistent123: Improve Consistency for One Image to 3D Object Synthesis

abstract: Large image diffusion models enable novel view synthesis with high quality and excellent zero-shot capability. However, such models based on image-to-image translation have no guarantee of view consistency, limiting the performance for downstream tasks like 3D reconstruction and image-to-3D generation. To empower consistency, we propose Consistent123 to synthesize novel views simultaneously by incorporating additional cross-view attention layers and the shared self-attention mechanism. The proposed attention mechanism improves the interaction across all synthesized views, as well as the alignment between the condition view and novel views. In the sampling stage, such architecture supports simultaneously generating an arbitrary number of views while training at a fixed length. We also introduce a progressive classifier-free guidance strategy to achieve the trade-off between texture and geometry for synthesized object views. Qualitative and quantitative experiments show that Consistent123 outperforms baselines in view consistency by a large margin. Furthermore, we demonstrate a significant improvement of Consistent123 on varying downstream tasks, showing its great potential in the 3D generation field. The project page is available at consistent-123.github.io.


title: Regularity from $p$-harmonic potentials to $\infty$-harmonic potentials in convex rings

abstract: The exploration of shape metamorphism, surface reconstruction, and image interpolation raises fundamental inquiries concerning the $C^1$ and higher-order regularity of $\infty$-harmonic potentials -- a specialized category of $\infty$-harmonic functions. Additionally, it prompts questions regarding their corresponding approximations using $p$-harmonic potentials. It is worth noting that establishing $C^1$ and higher-order regularity for $\infty$-harmonic functions remains a central concern within the realm of $\infty$-Laplace equations and $L^\infty$-variational problems. In this study, we investigate the regularity properties from $p$-harmonic potentials to $\infty$-harmonic potentials within arbitrary convex ring domains $\Omega=\Omega_0\backslash \overline \Omega_1$ in $\mathbb R^n$. Here $\Omega_0$ is a bounded convex domain in $\mathbb R^n$ and $\overline\Omega_1\subset \Omega_0$ is a compact convex set. We prove the interior $C^1$ and some Sobolev regularity for $\infty$-harmonic potentials.


title: SingleInsert: Inserting New Concepts from a Single Image into Text-to-Image Models for Flexible Editing

abstract: Recent progress in text-to-image (T2I) models enables high-quality image generation with flexible textual control. To utilize the abundant visual priors in the off-the-shelf T2I models, a series of methods try to invert an image to proper embedding that aligns with the semantic space of the T2I model. However, these image-to-text (I2T) inversion methods typically need multiple source images containing the same concept or struggle with the imbalance between editing flexibility and visual fidelity. In this work, we point out that the critical problem lies in the foreground-background entanglement when learning an intended concept, and propose a simple and effective baseline for single-image I2T inversion, named SingleInsert. SingleInsert adopts a two-stage scheme. In the first stage, we regulate the learned embedding to concentrate on the foreground area without being associated with the irrelevant background. In the second stage, we finetune the T2I model for better visual resemblance and devise a semantic loss to prevent the language drift problem. With the proposed techniques, SingleInsert excels in single concept generation with high visual fidelity while allowing flexible editing. Additionally, SingleInsert can perform single-image novel view synthesis and multiple concepts composition without requiring joint training. To facilitate evaluation, we design an editing prompt list and introduce a metric named Editing Success Rate (ESR) for quantitative assessment of editing flexibility. Our project page is: https://jarrentwu1031.github.io/SingleInsert-web/


title: Multi-Satellite Cooperative Networks: Joint Hybrid Beamforming and User Scheduling Design

abstract: In this paper, we consider a cooperative communication network where multiple low-Earth-orbit (LEO) satellites provide services to multiple ground users (GUs) cooperatively at the same time and on the same frequency. The multi-satellite cooperation has great potential in extending communication coverage and increasing spectral efficiency. Considering that the on-board radio-frequency circuit resources and computation resources on each satellite are restricted, we aim to propose a low-complexity yet efficient multi-satellite cooperative transmission framework. Specifically, we first propose a hybrid beamforming method consisting of analog beamforming for beam alignment and digital beamforming for interference mitigation. Then, to establish appropriate connections between the satellites and GUs, we propose a heuristic user scheduling algorithm which determines the connections according to the total spectral efficiency increment of the multi-satellite cooperative network. Next, considering the intrinsic connection between beamforming and user scheduling, a joint hybrid beamforming and user scheduling (JHU) scheme is proposed to dramatically improve the performance of the multi-satellite cooperative network. In addition to the single-connection scenario, we also consider the multi-connection case using the JHU scheme. Extensive simulations conducted over different LEO satellite constellations and across various GU locations demonstrate the superiority of the proposed schemes in both overall and per-user spectral efficiencies.


title: ClimateBERT-NetZero: Detecting and Assessing Net Zero and Reduction Targets

abstract: Public and private actors struggle to assess the vast amounts of information about sustainability commitments made by various institutions. To address this problem, we create a novel tool for automatically detecting corporate, national, and regional net zero and reduction targets in three steps. First, we introduce an expert-annotated data set with 3.5K text samples. Second, we train and release ClimateBERT-NetZero, a natural language classifier to detect whether a text contains a net zero or reduction target. Third, we showcase its analysis potential with two use cases: We first demonstrate how ClimateBERT-NetZero can be combined with conventional question-answering (Q&A) models to analyze the ambitions displayed in net zero and reduction targets. Furthermore, we employ the ClimateBERT-NetZero model on quarterly earning call transcripts and outline how communication patterns evolve over time. Our experiments demonstrate promising pathways for extracting and analyzing net zero and emission reduction targets at scale.


title: Sentinel: An Aggregation Function to Secure Decentralized Federated Learning

abstract: The rapid integration of Federated Learning (FL) into networking encompasses various aspects such as network management, quality of service, and cybersecurity while preserving data privacy. In this context, Decentralized Federated Learning (DFL) emerges as an innovative paradigm to train collaborative models, addressing the single point of failure limitation. However, the security and trustworthiness of FL and DFL are compromised by poisoning attacks, negatively impacting its performance. Existing defense mechanisms have been designed for centralized FL and they do not adequately exploit the particularities of DFL. Thus, this work introduces Sentinel, a defense strategy to counteract poisoning attacks in DFL. Sentinel leverages the accessibility of local data and defines a three-step aggregation protocol consisting of similarity filtering, bootstrap validation, and normalization to safeguard against malicious model updates. Sentinel has been evaluated with diverse datasets and various poisoning attack types and threat levels, improving the state-of-the-art performance against both untargeted and targeted poisoning attacks.


title: Numerical study on the mechanism of drag modulation by dispersed drops in two-phase Taylor-Couette turbulence

abstract: The presence of a dispersed phase can significantly modulate the drag in turbulent systems. We derived a conserved quantity that characterizes the radial transport of azimuthal momentum in the fluid-fluid two-phase Taylor-Couette turbulence. This quantity consists of contributions from advection, diffusion, and two-phase interface, which are closely related to density, viscosity, and interfacial tension, respectively. We found that the presence of the two-phase interface consistently produces a positive contribution to the momentum transport and leads to drag enhancement, while decreasing the density and viscosity ratios of the dispersed phase to the continuous phase reduces the contribution of local advection and diffusion terms to the momentum transport, respectively, resulting in drag reduction. Therefore, we concluded that the decreased density ratio and the decreased viscosity ratio work together to compete with the presence of two-phase interface for achieving drag modulation in fluid-fluid two-phase turbulence.


title: ClimateNLP: Analyzing Public Sentiment Towards Climate Change Using Natural Language Processing

abstract: Climate change's impact on human health poses unprecedented and diverse challenges. Unless proactive measures based on solid evidence are implemented, these threats will likely escalate and continue to endanger human well-being. The escalating advancements in information and communication technologies have facilitated the widespread availability and utilization of social media platforms. Individuals utilize platforms such as Twitter and Facebook to express their opinions, thoughts, and critiques on diverse subjects, encompassing the pressing issue of climate change. The proliferation of climate change-related content on social media necessitates comprehensive analysis to glean meaningful insights. This paper employs natural language processing (NLP) techniques to analyze climate change discourse and quantify the sentiment of climate change-related tweets. We use ClimateBERT, a pretrained model fine-tuned specifically for the climate change domain. The objective is to discern the sentiment individuals express and uncover patterns in public opinion concerning climate change. Analyzing tweet sentiments allows a deeper comprehension of public perceptions, concerns, and emotions about this critical global challenge. The findings from this experiment unearth valuable insights into public sentiment and the entities associated with climate change discourse. Policymakers, researchers, and organizations can leverage such analyses to understand public perceptions, identify influential actors, and devise informed strategies to address climate change challenges.


title: Generative Intrinsic Optimization: Intrinsic Control with Model Learning

abstract: Future sequence represents the outcome after executing the action into the environment (i.e. the trajectory onwards). When driven by the information-theoretic concept of mutual information, it seeks maximally informative consequences. Explicit outcomes may vary across state, return, or trajectory serving different purposes such as credit assignment or imitation learning. However, the inherent nature of incorporating intrinsic motivation with reward maximization is often neglected. In this work, we propose a policy iteration scheme that seamlessly incorporates the mutual information, ensuring convergence to the optimal policy. Concurrently, a variational approach is introduced, which jointly learns the necessary quantity for estimating the mutual information and the dynamics model, providing a general framework for incorporating different forms of outcomes of interest. While we mainly focus on theoretical analysis, our approach opens the possibilities of leveraging intrinsic control with model learning to enhance sample efficiency and incorporate uncertainty of the environment into decision-making.


title: Promptor: A Conversational and Autonomous Prompt Generation Agent for Intelligent Text Entry Techniques

abstract: Text entry is an essential task in our day-to-day digital interactions. Numerous intelligent features have been developed to streamline this process, making text entry more effective, efficient, and fluid. These improvements include sentence prediction and user personalization. However, as deep learning-based language models become the norm for these advanced features, the necessity for data collection and model fine-tuning increases. These challenges can be mitigated by harnessing the in-context learning capability of large language models such as GPT-3.5. This unique feature allows the language model to acquire new skills through prompts, eliminating the need for data collection and fine-tuning. Consequently, large language models can learn various text prediction techniques. We initially showed that, for a sentence prediction task, merely prompting GPT-3.5 surpassed a GPT-2 backed system and is comparable with a fine-tuned GPT-3.5 model, with the latter two methods requiring costly data collection, fine-tuning and post-processing. However, the task of prompting large language models to specialize in specific text prediction tasks can be challenging, particularly for designers without expertise in prompt engineering. To address this, we introduce Promptor, a conversational prompt generation agent designed to engage proactively with designers. Promptor can automatically generate complex prompts tailored to meet specific needs, thus offering a solution to this challenge. We conducted a user study involving 24 participants creating prompts for three intelligent text entry tasks, half of the participants used Promptor while the other half designed prompts themselves. The results show that Promptor-designed prompts result in a 35% increase in similarity and 22% in coherence over those by designers.


title: QASiNa: Religious Domain Question Answering using Sirah Nabawiyah

abstract: Nowadays, Question Answering (QA) tasks receive significant research focus, particularly with the development of Large Language Model (LLM) such as Chat GPT [1]. LLM can be applied to various domains, but it contradicts the principles of information transmission when applied to the Islamic domain. In Islam we strictly regulates the sources of information and who can give interpretations or tafseer for that sources [2]. The approach used by LLM to generate answers based on its own interpretation is similar to the concept of tafseer, LLM is neither an Islamic expert nor a human which is not permitted in Islam. Indonesia is the country with the largest Islamic believer population in the world [3]. With the high influence of LLM, we need to make evaluation of LLM in religious domain. Currently, there is only few religious QA dataset available and none of them using Sirah Nabawiyah especially in Indonesian Language. In this paper, we propose the Question Answering Sirah Nabawiyah (QASiNa) dataset, a novel dataset compiled from Sirah Nabawiyah literatures in Indonesian language. We demonstrate our dataset by using mBERT [4], XLM-R [5], and IndoBERT [6] which fine-tuned with Indonesian translation of SQuAD v2.0 [7]. XLM-R model returned the best performance on QASiNa with EM of 61.20, F1-Score of 75.94, and Substring Match of 70.00. We compare XLM-R performance with Chat GPT-3.5 and GPT-4 [1]. Both Chat GPT version returned lower EM and F1-Score with higher Substring Match, the gap of EM and Substring Match get wider in GPT-4. The experiment indicate that Chat GPT tends to give excessive interpretations as evidenced by its higher Substring Match scores compared to EM and F1-Score, even after providing instruction and context. This concludes Chat GPT is unsuitable for question answering task in religious domain especially for Islamic religion.


title: Radio Galaxy Zoo: tagging radio subjects using text

abstract: RadioTalk is a communication platform that enabled members of the Radio Galaxy Zoo (RGZ) citizen science project to engage in discussion threads and provide further descriptions of the radio subjects they were observing in the form of tags and comments. It contains a wealth of auxiliary information which is useful for the morphology identification of complex and extended radio sources. In this paper, we present this new dataset, and for the first time in radio astronomy, we combine text and images to automatically classify radio galaxies using a multi-modal learning approach. We found incorporating text features improved classification performance which demonstrates that text annotations are rare but valuable sources of information for classifying astronomical sources, and suggests the importance of exploiting multi-modal information in future citizen science projects. We also discovered over 10,000 new radio sources beyond the RGZ-DR1 catalogue in this dataset.


title: Voice Conversion for Stuttered Speech, Instruments, Unseen Languages and Textually Described Voices

abstract: Voice conversion aims to convert source speech into a target voice using recordings of the target speaker as a reference. Newer models are producing increasingly realistic output. But what happens when models are fed with non-standard data, such as speech from a user with a speech impairment? We investigate how a recent voice conversion model performs on non-standard downstream voice conversion tasks. We use a simple but robust approach called k-nearest neighbors voice conversion (kNN-VC). We look at four non-standard applications: stuttered voice conversion, cross-lingual voice conversion, musical instrument conversion, and text-to-voice conversion. The latter involves converting to a target voice specified through a text description, e.g. "a young man with a high-pitched voice". Compared to an established baseline, we find that kNN-VC retains high performance in stuttered and cross-lingual voice conversion. Results are more mixed for the musical instrument and text-to-voice conversion tasks. E.g., kNN-VC works well on some instruments like drums but not on others. Nevertheless, this shows that voice conversion models - and kNN-VC in particular - are increasingly applicable in a range of non-standard downstream tasks. But there are still limitations when samples are very far from the training distribution. Code, samples, trained models: https://rf5.github.io/sacair2023-knnvc-demo/.


title: Gate-controlled suppression of light-driven proton transport through graphene electrodes

abstract: Recent experiments demonstrated that proton transport through graphene electrodes can be accelerated by over an order of magnitude with low intensity illumination. Here we show that this photo-effect can be suppressed for a tuneable fraction of the infrared spectrum by applying a voltage bias. Using photocurrent measurements and Raman spectroscopy, we show that such fraction can be selected by tuning the Fermi energy of electrons in graphene with a bias, a phenomenon controlled by Pauli blocking of photo-excited electrons. These findings demonstrate a dependence between graphene's electronic and proton transport properties and provide fundamental insights into molecularly thin electrode-electrolyte interfaces and their interaction with light.


title: Generalized Logit Adjustment: Calibrating Fine-tuned Models by Removing Label Bias in Foundation Models

abstract: Foundation models like CLIP allow zero-shot transfer on various tasks without additional training data. Yet, the zero-shot performance is less competitive than a fully supervised one. Thus, to enhance the performance, fine-tuning and ensembling are also commonly adopted to better fit the downstream tasks. However, we argue that such prior work has overlooked the inherent biases in foundation models. Due to the highly imbalanced Web-scale training set, these foundation models are inevitably skewed toward frequent semantics, and thus the subsequent fine-tuning or ensembling is still biased. In this study, we systematically examine the biases in foundation models and demonstrate the efficacy of our proposed Generalized Logit Adjustment (GLA) method. Note that bias estimation in foundation models is challenging, as most pre-train data cannot be explicitly accessed like in traditional long-tailed classification tasks. To this end, GLA has an optimization-based bias estimation approach for debiasing foundation models. As our work resolves a fundamental flaw in the pre-training, the proposed GLA demonstrates significant improvements across a diverse range of tasks: it achieves 1.5 pp accuracy gains on ImageNet, an large average improvement (1.4-4.6 pp) on 11 few-shot datasets, 2.4 pp gains on long-tailed classification. Codes are in \url{https://github.com/BeierZhu/GLA}.


title: Linearly polarized gluon density at low x

abstract: Based on a solution of DGLAP evolution equations at small values of Bjorken variable x, a simple analytic approximation for so-called linearly polarized gluon density \tilde{h}_1^{\perp g}(x,k_t^2, Q^2) is obtained at LO of perturbation theory.


title: Electrical and thermal control of Fabry-P\'{e}rot cavities mediated by Casimir forces

abstract: Dynamic tuning of optical cavities is highly desired in many photonic systems. Here, we show that Fabry-P\'{e}rot(FP) cavities can be actively controlled by the Casimir force. The optical FP cavities consist of a gold nanoplate confronted to an electrical-connecting multi-layer substrate in a liquid environment. The gold nanoplate can be stably suspended due to the balance of repulsive and attractive Casimir forces. Moreover, the suspension distance are modulated strongly by the electric gating or temperature of the system. As a result, we could shift the resonant wavelengthes of the cavities with tens of nanometers at optical frequencies. Finally, we analyze the influence of Brownian motion on the equilibrium distances. Due to the high Q-factor of the FP cavities, our proposed system offers a remarkable platform to experimentally investigate the thermal Casimir effect at sub-micrometer separations


title: Overview of Physics-Informed Machine Learning Inversion of Geophysical Data

abstract: We review four types of algorithms for physics-informed machine learning (PIML) inversion of geophysical data. The unifying equation is given by the joint objective function $\epsilon$: \begin{eqnarray} \epsilon^{||-PIML}&=&\lambda_1 \overbrace{||{\bf W}^{ML}({\bf H}_{{\bf w}} {\bf d}^{obs}-{\bf m})||^2}^{NN} + \lambda_2 \overbrace{{||{\bf W}^{FWI}({\bf L} {\bf m}-{\bf d}^{obs})||^2}}^{FWI} ~+ \nonumber\\ \nonumber\\ && + ~~Regularizer, \label{PIML.eq120} \end{eqnarray}where the optimal model ${\bf m}^*$ and weights $\bf w^*$ minimize $\epsilon$. Here, The matrix weights are given by the boldface symbol $\bf W$, and full waveform inversion (FWI) is typically computed using a finite-difference solution of the wave equation, where $\bf L$ represents the forward modeling operation of the wave equation as a function of the model $\bf m$. Also, a fully-connected neural network (NN) is used to compute the model ${\bf H_w}{\bf d}^{obs} \approx \bf m$ from the observed input data ${\bf d}^{obs}$. The selection of weights $\lambda_i$ and the NN operations determine one of four different PIML algorithms. PIML offers potential advantages over standard FWI through its enhanced ability to avoid local minima and the option to locally train the inversion operator, minimizing the requirement for extensive training data for global applicability. However, the effectiveness of PIML relies on the similarity between the test and trained data. Nevertheless, a possible strategy to overcome this limitation involves initial pretraining of a PIML architecture with data from a broader region, followed by fine-tuning for specific data-a method reminiscent of the way large language models are pretrained and adapted for various tasks.


title: Scale-Free Networks beyond Power-Law Degree Distribution

abstract: Complex networks across various fields are often considered to be scale free -- a statistical property usually solely characterized by a power-law distribution of the nodes' degree $k$. However, this characterization is incomplete. In real-world networks, the distribution of the degree-degree distance $\eta$, a simple link-based metric of network connectivity similar to $k$, appears to exhibit a stronger power-law distribution than $k$. While offering an alternative characterization of scale-freeness, the discovery of $\eta$ raises a fundamental question: do the power laws of $k$ and $\eta$ represent the same scale-freeness? To address this question, here we investigate the exact asymptotic {relationship} between the distributions of $k$ and $\eta$, proving that every network with a power-law distribution of $k$ also has a power-law distribution of $\eta$, but \emph{not} vice versa. This prompts us to introduce two network models as counterexamples that have a power-law distribution of $\eta$ but not $k$, constructed using the preferential attachment and fitness mechanisms, respectively. Both models show promising accuracy by fitting only one model parameter each when modeling real-world networks. Our findings suggest that $\eta$ is a more suitable indicator of scale-freeness and can provide a deeper understanding of the universality and underlying mechanisms of scale-free networks.


title: Homogenization of the distribution-dependent stochastic abstract fluid models

abstract: In this paper, we study the homogenization of the distribution-dependent stochastic abstract fluid models by combining the $two\!-\!scale$ convergence and martingale representative approach. A general framework of the homogenization research is established for stochastic abstract fluid models, which is the type of genuine-nonlinear partial differential equations including the (distribution-dependent) stochastic Navier-Stokes equations, stochastic magneto-hydrodynamic equations, stochastic Boussinesq equations, stochastic micropolar equations, stochastic Allen-Cahn equations.


title: Infinite Hex is arithmetic

abstract: Hex is a well known connection game in which two players attempt to connect opposite sides of the board by colored stones. In 2022, Hamkins and Leonessi introduced an infinite version, in which the goal is to construct a certain kind of two-way infinite path of adjacent stones. It was explicitly left open whether the winning condition is Borel. We prove that it is arithmetic, with complexity between $\Sigma^0_4$ and $\Delta^0_5$.


title: ${\it Fibrotaxis}$: gradient-free, spontaneous and controllable droplet motion on soft solids

abstract: Most passive droplet transport strategies rely on spatial variations of material properties to drive droplet motion, leading to gradient-based mechanisms with intrinsic length scales that limit the droplet velocity or the transport distance. Here, we propose droplet ${\it fibrotaxis}$, a novel mechanism that leverages an anisotropic fiber-reinforced deformable solid to achieve spontaneous and gradient-free droplet transport. Using high-fidelity simulations, we identify the fluid wettability and the fiber orientation as critical parameters that enable controllable droplet velocity and long-range droplet transport. Our results highlight the potential of fibrotaxis as a droplet transport mechanism that can have a strong impact on self-cleaning surfaces, water harvesting and medical diagnostics.


title: Multi-Modal Sensor Fusion and Object Tracking for Autonomous Racing

abstract: Reliable detection and tracking of surrounding objects are indispensable for comprehensive motion prediction and planning of autonomous vehicles. Due to the limitations of individual sensors, the fusion of multiple sensor modalities is required to improve the overall detection capabilities. Additionally, robust motion tracking is essential for reducing the effect of sensor noise and improving state estimation accuracy. The reliability of the autonomous vehicle software becomes even more relevant in complex, adversarial high-speed scenarios at the vehicle handling limits in autonomous racing. In this paper, we present a modular multi-modal sensor fusion and tracking method for high-speed applications. The method is based on the Extended Kalman Filter (EKF) and is capable of fusing heterogeneous detection inputs to track surrounding objects consistently. A novel delay compensation approach enables to reduce the influence of the perception software latency and to output an updated object list. It is the first fusion and tracking method validated in high-speed real-world scenarios at the Indy Autonomous Challenge 2021 and the Autonomous Challenge at CES (AC@CES) 2022, proving its robustness and computational efficiency on embedded systems. It does not require any labeled data and achieves position tracking residuals below 0.1 m. The related code is available as open-source software at https://github.com/TUMFTM/FusionTracking.


title: Model-Agnostic Covariate-Assisted Inference on Partially Identified Causal Effects

abstract: Many causal estimands are only partially identifiable since they depend on the unobservable joint distribution between potential outcomes. Stratification on pretreatment covariates can yield sharper partial identification bounds; however, unless the covariates are discrete with relatively small support, this approach typically requires consistent estimation of the conditional distributions of the potential outcomes given the covariates. Thus, existing approaches may fail under model misspecification or if consistency assumptions are violated. In this study, we propose a unified and model-agnostic inferential approach for a wide class of partially identified estimands, based on duality theory for optimal transport problems. In randomized experiments, our approach can wrap around any estimates of the conditional distributions and provide uniformly valid inference, even if the initial estimates are arbitrarily inaccurate. Also, our approach is doubly robust in observational studies. Notably, this property allows analysts to use the multiplier bootstrap to select covariates and models without sacrificing validity even if the true model is not included. Furthermore, if the conditional distributions are estimated at semiparametric rates, our approach matches the performance of an oracle with perfect knowledge of the outcome model. Finally, we propose an efficient computational framework, enabling implementation on many practical problems in causal inference.


title: Multimodal Active Measurement for Human Mesh Recovery in Close Proximity

abstract: For physical human-robot interactions (pHRI), a robot needs to estimate the accurate body pose of a target person. However, in these pHRI scenarios, the robot cannot fully observe the target person's body with equipped cameras because the target person must be close to the robot for physical interaction. This closeness leads to severe truncation and occlusions and thus results in poor accuracy of human pose estimation. For better accuracy in this challenging environment, we propose an active measurement and sensor fusion framework of the equipped cameras with touch and ranging sensors such as 2D LiDAR. Touch and ranging sensor measurements are sparse, but reliable and informative cues for localizing human body parts. In our active measurement process, camera viewpoints and sensor placements are dynamically optimized to measure body parts with higher estimation uncertainty, which is closely related to truncation or occlusion. In our sensor fusion process, assuming that the measurements of touch and ranging sensors are more reliable than the camera-based estimations, we fuse the sensor measurements to the camera-based estimated pose by aligning the estimated pose towards the measured points. Our proposed method outperformed previous methods on the standard occlusion benchmark with simulated active measurement. Furthermore, our method reliably estimated human poses using a real robot even with practical constraints such as occlusion by blankets.


title: DUSA: Decoupled Unsupervised Sim2Real Adaptation for Vehicle-to-Everything Collaborative Perception

abstract: Vehicle-to-Everything (V2X) collaborative perception is crucial for autonomous driving. However, achieving high-precision V2X perception requires a significant amount of annotated real-world data, which can always be expensive and hard to acquire. Simulated data have raised much attention since they can be massively produced at an extremely low cost. Nevertheless, the significant domain gap between simulated and real-world data, including differences in sensor type, reflectance patterns, and road surroundings, often leads to poor performance of models trained on simulated data when evaluated on real-world data. In addition, there remains a domain gap between real-world collaborative agents, e.g. different types of sensors may be installed on autonomous vehicles and roadside infrastructures with different extrinsics, further increasing the difficulty of sim2real generalization. To take full advantage of simulated data, we present a new unsupervised sim2real domain adaptation method for V2X collaborative detection named Decoupled Unsupervised Sim2Real Adaptation (DUSA). Our new method decouples the V2X collaborative sim2real domain adaptation problem into two sub-problems: sim2real adaptation and inter-agent adaptation. For sim2real adaptation, we design a Location-adaptive Sim2Real Adapter (LSA) module to adaptively aggregate features from critical locations of the feature map and align the features between simulated data and real-world data via a sim/real discriminator on the aggregated global feature. For inter-agent adaptation, we further devise a Confidence-aware Inter-agent Adapter (CIA) module to align the fine-grained features from heterogeneous agents under the guidance of agent-wise confidence maps. Experiments demonstrate the effectiveness of the proposed DUSA approach on unsupervised sim2real adaptation from the simulated V2XSet dataset to the real-world DAIR-V2X-C dataset.


title: Can Large Language Models Really Improve by Self-critiquing Their Own Plans?

abstract: There have been widespread claims about Large Language Models (LLMs) being able to successfully verify or self-critique their candidate solutions in reasoning problems in an iterative mode. Intrigued by those claims, in this paper we set out to investigate the verification/self-critiquing abilities of large language models in the context of planning. We evaluate a planning system that employs LLMs for both plan generation and verification. We assess the verifier LLM's performance against ground-truth verification, the impact of self-critiquing on plan generation, and the influence of varying feedback levels on system performance. Using GPT-4, a state-of-the-art LLM, for both generation and verification, our findings reveal that self-critiquing appears to diminish plan generation performance, especially when compared to systems with external, sound verifiers and the LLM verifiers in that system produce a notable number of false positives, compromising the system's reliability. Additionally, the nature of feedback, whether binary or detailed, showed minimal impact on plan generation. Collectively, our results cast doubt on the effectiveness of LLMs in a self-critiquing, iterative framework for planning tasks.


title: The existence of ground state solutions for nonlinear p-Laplacian equations on lattice graphs

abstract: In this paper, we study the nonlinear $p$-Laplacian equation $$-\Delta_{p} u+V(x)|u|^{p-2}u=f(x,u) $$ with positive and periodic potential $V$ on the lattice graph $\mathbb{Z}^{N}$, where $\Delta_{p}$ is the discrete $p$-Laplacian, $p \in (1,\infty)$. The nonlinearity $f$ is also periodic in $x$ and satisfies the growth condition $|f(x,u)| \leq a(1+|u|^{q-1})$ for some $ q>p$. We first prove the equivalence of three function spaces on $\mathbb{Z}^{N}$, which is quite different from the continuous case and allows us to remove the restriction $q>p^{*}$ in [SW10], where $p^{*}$ is the critical exponent for $ W^{1,p}(\Omega) \hookrightarrow L^{q}(\Omega)$ with $\Omega \subset \mathbb{R}^{N}$ bounded. Then, using the method of Nehari [Neh60, Neh61], we prove the existence of ground state solutions to the above equation.


title: 3D terrain mapping and filtering from coarse resolution data cubes extracted from real-aperture 94 GHz radar

abstract: Accurate, high-resolution 3D mapping of environmental terrain is critical in a range of disciplines. In this study, we develop a new technique, called the PCFilt-94 algorithm, to extract 3D point clouds from coarse resolution millimetre-wave radar data cubes and quantify their associated uncertainties. A technique to non-coherently average neighbouring waveforms surrounding each AVTIS2 range profile was developed in order to reduce speckle and was found to reduce point cloud uncertainty by 13% at long range and 20% at short range. Further, a Voronoi-based point cloud outlier removal algorithm was implemented which iteratively removes outliers in a point cloud until the process converges to the removal of 0 points. Taken together, the new processing methodology produces a stable point cloud, which means that: 1) it is repeatable even when using different point cloud extraction and filtering parameter values during pre-processing, and 2) is less sensitive to over-filtering through the point cloud processing workflow. Using an optimal number of Ground Control Points (GCPs) for georeferencing, which was determined to be 3 at close range (<1.5 km) and 5 at long range (>3 km), point cloud uncertainty was estimated to be approximately 1.5 m at 1.5 km to 3 m at 3 km and followed a Lorentzian distribution. These uncertainties are smaller than those reported for other close-range radar systems used for terrain mapping. The results of this study should be used as a benchmark for future application of millimetre-wave radar systems for 3D terrain mapping.


title: Thomas--Wigner rotation as a holonomy for spin-$1/2$ particles

abstract: The Thomas--Wigner rotation (TWR) results from the fact that a combination of boosts leads to a non-trivial rotation of a physical system. Its origin lies in the structure of the Lorentz group. In this article we discuss the idea that the TWR can be understood in the geometric manner, being caused by the non-trivially curved relativistic momentum space, i.e. the mass shell, seen as a Riemannian manifold. We show explicitly how the TWR for a massive spin-$1/2$ particle can be calculated as a holonomy of the mass shell. To reach this conclusion we recall how to construct the spin bundle over the mass shell manifold.


title: Core-sets for Fair and Diverse Data Summarization

abstract: We study core-set construction algorithms for the task of Diversity Maximization under fairness/partition constraint. Given a set of points $P$ in a metric space partitioned into $m$ groups, and given $k_1,\ldots,k_m$, the goal of this problem is to pick $k_i$ points from each group $i$ such that the overall diversity of the $k=\sum_i k_i$ picked points is maximized. We consider two natural diversity measures: sum-of-pairwise distances and sum-of-nearest-neighbor distances, and show improved core-set construction algorithms with respect to these measures. More precisely, we show the first constant factor core-set w.r.t. sum-of-pairwise distances whose size is independent of the size of the dataset and the aspect ratio. Second, we show the first core-set w.r.t. the sum-of-nearest-neighbor distances. Finally, we run several experiments showing the effectiveness of our core-set approach. In particular, we apply constrained diversity maximization to summarize a set of timed messages that takes into account the messages' recency. Specifically, the summary should include more recent messages compared to older ones. This is a real task in one of the largest communication platforms, affecting the experience of hundreds of millions daily active users. By utilizing our core-set method for this task, we achieve a 100x speed-up while losing the diversity by only a few percent. Moreover, our approach allows us to improve the space usage of the algorithm in the streaming setting.


title: Who Wrote it and Why? Prompting Large-Language Models for Authorship Verification

abstract: Authorship verification (AV) is a fundamental task in natural language processing (NLP) and computational linguistics, with applications in forensic analysis, plagiarism detection, and identification of deceptive content. Existing AV techniques, including traditional stylometric and deep learning approaches, face limitations in terms of data requirements and lack of explainability. To address these limitations, this paper proposes PromptAV, a novel technique that leverages Large-Language Models (LLMs) for AV by providing step-by-step stylometric explanation prompts. PromptAV outperforms state-of-the-art baselines, operates effectively with limited training data, and enhances interpretability through intuitive explanations, showcasing its potential as an effective and interpretable solution for the AV task.


title: Boundary driven turbulence on string worldsheet

abstract: We study the origin of turbulence on the string worldsheet with boundaries laid in anti de Sitter (AdS) spacetime. While the classical motion of a single closed string in AdS is integrable, it has recently been recognized that weak turbulence arises in the case of an open string suspended from the AdS boundary. In the open string case, it is necessary to impose boundary conditions on the worldsheet boundaries. We classify which boundary conditions preserve integrability. Based on this classification, we anticipate that turbulence may occur on the string worldsheet if integrability is not guaranteed by the boundary conditions. Numerical investigations of the classical open-string dynamics support that turbulence occurs when the boundary conditions are not integrable.


title: A C_2-equivariant Gabber presentation lemma

abstract: We establish a version of Gabber's presentation lemma in the setting of varieties with an action by the finite group of order 2.


title: A novel Newton method for inverse elastic scattering problems

abstract: This work is concerned with an inverse elastic scattering problem of identifying the unknown rigid obstacle embedded in an open space filled with a homogeneous and isotropic elastic medium. A Newton-type iteration method relying on the boundary condition is designed to identify the boundary curve of the obstacle. Based on the Helmholtz decomposition and the Fourier-Bessel expansion, we explicitly derive the approximate scattered field and its derivative on each iterative curve. Rigorous mathematical justifications for the proposed method are provided. Numerical examples are presented to verify the effectiveness of the proposed method.


title: Dynamical de Sitter black holes in a quasi-stationary expansion

abstract: We revisit and improve the analytic study arXiv:1804.03462 of spherically symmetric but dynamical black holes in Einstein's gravity coupled to a real scalar field. We introduce a series expansion in a small parameter $\epsilon$ that implements slow time dependence. At the leading order, the generic solution is a quasi-stationary Schwarzschild-de Sitter (SdS) metric, i.e. one where time-dependence enters only through the mass and cosmological constant parameters of SdS. The two coupled ODEs describing the leading order time dependence are solved up to quadrature for an arbitrary scalar potential. Higher order corrections can be consistently computed, as we show by explicitly solving the Einstein equations at the next to leading order as well. We comment on how the quasi-stationary expansion we introduce here is equivalent to the non-relativistic $1/c$ expansion.


title: Quintessence in the Weyl-Gauss-Bonnet model

abstract: Quintessence models have been widely examined in the context of scalar-Gauss-Bonnet gravity, a subclass of Horndeski's theory, and were proposed as viable candidates for Dark Energy. However, the relatively recent observational constraints on the speed of gravitational waves $c_{\textrm{GW}}$ have resulted in many of those models being ruled out because they predict $c_{\textrm{GW}} \neq c$ generally. While these were formulated in the metric formalism of gravity, we put forward a new quintessence model with the scalar-Gauss-Bonnet action but in Weyl geometry, where the connection is not metric compatible. We find the fixed points of the dynamical system under some assumptions and determine their stability via linear analysis. The past evolution of the Universe can be reproduced correctly, but the late Universe constraints on $c_{\textrm{GW}}$ are grossly violated. Moreover, at these later stages tensor modes suffer from the gradient instabilities. We also consider the implications of imposing an additional constraint $c_{\textrm{GW}} = c$, but this does not lead to evolution that is consistent with cosmological observations


title: Tailored Visions: Enhancing Text-to-Image Generation with Personalized Prompt Rewriting

abstract: Despite significant progress in the field, it is still challenging to create personalized visual representations that align closely with the desires and preferences of individual users. This process requires users to articulate their ideas in words that are both comprehensible to the models and accurately capture their vision, posing difficulties for many users. In this paper, we tackle this challenge by leveraging historical user interactions with the system to enhance user prompts. We propose a novel approach that involves rewriting user prompts based on a newly collected large-scale text-to-image dataset with over 300k prompts from 3115 users. Our rewriting model enhances the expressiveness and alignment of user prompts with their intended visual outputs. Experimental results demonstrate the superiority of our methods over baseline approaches, as evidenced in our new offline evaluation method and online tests. Our code and dataset are available at https://github.com/zzjchen/Tailored-Visions.


title: Fine-grained Conversational Decoding via Isotropic and Proximal Search

abstract: General-purpose text decoding approaches are usually adopted for dialogue response generation. Although the quality of the generated responses can be improved with dialogue-specific encoding methods, conversational decoding methods are still under-explored. Inspired by \citet{wu2023learning} that a good dialogue feature space should follow the rules of locality and isotropy, we present a fine-grained conversational decoding method, termed \textit{isotropic and proximal search (IPS)}. Our method is designed to generate the semantic-concentrated response, while still maintaining informativeness and discrimination against the context. Experiments show that our approach outperforms existing decoding strategies in the dialogue field across both automatic and human evaluation metrics. More in-depth analyses further confirm the effectiveness of our approach.


title: Invariant Differential Operators and the Radon Transform on the Horocycle Spaces

abstract: We present the range theorem for the Radon transform for double fibrations of the horocycle spaces for the semisimple symmetric spaces by the invariant differential operators or the invariant system of differential operators constructed from the action of the transformation group. This theorem also implies the range theorem for the Radon transform for double fibrations of non-symmetric compact homogeneous spaces.


title: On the Relevance of Phoneme Duration Variability of Synthesized Training Data for Automatic Speech Recognition

abstract: Synthetic data generated by text-to-speech (TTS) systems can be used to improve automatic speech recognition (ASR) systems in low-resource or domain mismatch tasks. It has been shown that TTS-generated outputs still do not have the same qualities as real data. In this work we focus on the temporal structure of synthetic data and its relation to ASR training. By using a novel oracle setup we show how much the degradation of synthetic data quality is influenced by duration modeling in non-autoregressive (NAR) TTS. To get reference phoneme durations we use two common alignment methods, a hidden Markov Gaussian-mixture model (HMM-GMM) aligner and a neural connectionist temporal classification (CTC) aligner. Using a simple algorithm based on random walks we shift phoneme duration distributions of the TTS system closer to real durations, resulting in an improvement of an ASR system using synthetic data in a semi-supervised setting.


title: Multi Level Dense Layer Neural Network Model for Housing Price Prediction

abstract: Predicting the price of a house remains a challenging issue that needs to be addressed. Research has attempted to establish a model with different methods and algorithms to predict the housing price, from the traditional hedonic model to a neural network algorithm. However, many existing algorithms in the literature are proposed without any finetuning and customization in the model. In this paper, the author attempted to propose a novel neural network-based model to improve the performance of housing price prediction. Inspired by the modular neural network, the proposed model consists of a three-level neural network that is capable to process information in parallel. The author compared several state-of-the-art algorithms available in the literature on the Boston housing dataset to evaluate the effectiveness of the proposed model. The results show that the proposed model provides better accuracy and outperforms existing algorithms in different evaluation metrics. The code for the implementation is available https://github.com/wijayarobert/MultiLevelDenseLayerNN


title: Sensing-assisted Accurate and Fast Beam Management for Cellular-connected mmWave UAV Network

abstract: Beam management, including initial access (IA) and beam tracking, is essential to the millimeter-wave Unmanned Aerial Vehicle (UAV) network. However, conventional communication-only and feedback-based schemes suffer a high delay and low accuracy of beam alignment since they only enable the receiver to passively hear the information of the transmitter from the radio domain. This paper presents a novel sensing-assisted beam management approach, the first solution that fully utilizes the information from the visual domain to improve communication performance. We employ both integrated sensing and communication and computer vision techniques and design an extended Kalman filtering method for beam tracking and prediction. Besides, we also propose a novel dual identity association solution to distinguish multiple UAVs in dynamic environments. Real-world experiments and numerical results show that the proposed solution outperforms the conventional methods in IA delay, association accuracy, tracking error, and communication performance.


title: Time-Variable Diffuse $\gamma$-ray Foreground

abstract: While the data analysis of $\gamma$-ray telescopes has now become more robust, some signals may be misinterpretations of a time-variable foreground emission from the Solar System, induced by low-energy cosmic-ray interactions with asteroids. Our goal is to provide emission templates for this time-variable diffuse $\gamma$-ray foreground by considering the populations of Main Belt Asteroids, Jovian and Neptunian Trojans, Kuiper Belt Objects, and the Oort Cloud. We model the spatial distribution of all known asteroids by performing 3D-fits to determine their density profiles and calculate their appearances by line-of-sight integrations. Because Earth and the asteroids are moving with respect to each other, we obtain diffuse emission templates varying on timescales of days to decades. We find that the temporal variability can lead to flux enhancements which may mimic emission features unless properly taken into account. This variation is further enhanced by the Solar cycle as the cosmic-ray spectrum is attenuated by the Solar modulation potential, leading to a relative flux increase of the outer asteroids. The cumulative effect of the time-dependent emission is illustrated for the case of the 511 keV OSSE fountain, and for emission features near the Galactic Centre, both being possible misinterpretations of the Solar System albedo. We recommend that $\gamma$-ray data analyses should always take into account the possibility of a time-variable foreground. Due to the ecliptic overlap with the Galactic plane, the Galactic emission is expected to be weaker by 0.1-20%, depending on time (relative planetary motion), energy, and Solar cycle, which has immense consequences for the interpretation of dark matter annihilation cross sections, cosmic-ray spectra and amplitudes, as well as nucleosynthesis yields and related parameters.


title: Real chaos and complex time

abstract: Real vector fields $\dot{z} = f(z)$ in $\mathbb{R}^N$ extend to $\mathbb{C}^N$, for complex entire $f$. One known consequence are exponentially small upper bounds \begin{equation*} \label{*} C_\eta \exp(-\eta/\varepsilon) \tag{*} \end{equation*} on homoclinic splittings under discretizations of step size $\varepsilon>0$, or under rapid forcings of that period. Here the complex time extension of $\Gamma(t)$ is assumed to be analytic in the complex horizontal strip $|\mathrm{Im}\, t|\leq \eta$. The phenomenon relates to adiabatic elimination, infinite order averaging, invisible chaos, and backward error analysis. However, what if $\Gamma(t)$ itself were complex entire? Then $\eta$ could be chosen arbitrarily large. We consider connecting orbits $\Gamma(t)$ between limiting hyperbolic equilibria $f(v_\pm)=0$, for real $t\rightarrow\pm\infty$. For the linearizations $f'(v_\pm)$, we assume real eigenvalues which are nonresonant, separately at $v_\pm$. We then show the existence of singularities of $\Gamma(t)$ in complex time $t$. In that sense, real connecting orbits are accompanied by finite time blow-up, in imaginary time. Moreover, the singularities bound admissible $\eta$ in exponential estimates \eqref{*}. The cases of complex or resonant eigenvalues are completely open. We therefore offer a 1,000 Euro reward to any mathematician, up to and including non-permanent PostDoc level, who first comes up with a complex entire homoclinic orbit $\Gamma(t)$, in the above setting. Such an example would exhibit ultra-exponentially small separatrix splittings, and ultra-invisible chaos, under discretization. We also provide a time-reversible example of an entire periodic orbit with ultra-sharp Arnold tongues, alias ultra-invisible phaselocking, under discretization.


title: Counterfactual Explanations for Time Series Forecasting

abstract: Among recent developments in time series forecasting methods, deep forecasting models have gained popularity as they can utilize hidden feature patterns in time series to improve forecasting performance. Nevertheless, the majority of current deep forecasting models are opaque, hence making it challenging to interpret the results. While counterfactual explanations have been extensively employed as a post-hoc approach for explaining classification models, their application to forecasting models still remains underexplored. In this paper, we formulate the novel problem of counterfactual generation for time series forecasting, and propose an algorithm, called ForecastCF, that solves the problem by applying gradient-based perturbations to the original time series. ForecastCF guides the perturbations by applying constraints to the forecasted values to obtain desired prediction outcomes. We experimentally evaluate ForecastCF using four state-of-the-art deep model architectures and compare to two baselines. Our results show that ForecastCF outperforms the baseline in terms of counterfactual validity and data manifold closeness. Overall, our findings suggest that ForecastCF can generate meaningful and relevant counterfactual explanations for various forecasting tasks.


title: Multi-Scale Spatial-Temporal Recurrent Networks for Traffic Flow Prediction

abstract: Traffic flow prediction is one of the most fundamental tasks of intelligent transportation systems. The complex and dynamic spatial-temporal dependencies make the traffic flow prediction quite challenging. Although existing spatial-temporal graph neural networks hold prominent, they often encounter challenges such as (1) ignoring the fixed graph that limits the predictive performance of the model, (2) insufficiently capturing complex spatial-temporal dependencies simultaneously, and (3) lacking attention to spatial-temporal information at different time lengths. In this paper, we propose a Multi-Scale Spatial-Temporal Recurrent Network for traffic flow prediction, namely MSSTRN, which consists of two different recurrent neural networks: the single-step gate recurrent unit and the multi-step gate recurrent unit to fully capture the complex spatial-temporal information in the traffic data under different time windows. Moreover, we propose a spatial-temporal synchronous attention mechanism that integrates adaptive position graph convolutions into the self-attention mechanism to achieve synchronous capture of spatial-temporal dependencies. We conducted extensive experiments on four real traffic datasets and demonstrated that our model achieves the best prediction accuracy with non-trivial margins compared to all the twenty baseline methods.


title: DualAug: Exploiting Additional Heavy Augmentation with OOD Data Rejection

abstract: Data augmentation is a dominant method for reducing model overfitting and improving generalization. Most existing data augmentation methods tend to find a compromise in augmenting the data, \textit{i.e.}, increasing the amplitude of augmentation carefully to avoid degrading some data too much and doing harm to the model performance. We delve into the relationship between data augmentation and model performance, revealing that the performance drop with heavy augmentation comes from the presence of out-of-distribution (OOD) data. Nonetheless, as the same data transformation has different effects for different training samples, even for heavy augmentation, there remains part of in-distribution data which is beneficial to model training. Based on the observation, we propose a novel data augmentation method, named \textbf{DualAug}, to keep the augmentation in distribution as much as possible at a reasonable time and computational cost. We design a data mixing strategy to fuse augmented data from both the basic- and the heavy-augmentation branches. Extensive experiments on supervised image classification benchmarks show that DualAug improve various automated data augmentation method. Moreover, the experiments on semi-supervised learning and contrastive self-supervised learning demonstrate that our DualAug can also improve related method. Code is available at \href{https://github.com/shuguang99/DualAug}{https://github.com/shuguang99/DualAug}.


title: CODY: A graph-based framework for the analysis of COnversation DYnamics in online social networks

abstract: Conversations are an integral part of online social media, and gaining insights into these conversations is of significant value for many commercial as well as academic use cases. From a computational perspective, however, analyzing conversation data is complex, and numerous aspects must be considered. Next to the structure of conversations, the discussed content - as well as their dynamics - have to be taken into account. Still, most existing modelling and analysis approaches focus only on one of these aspects and, in particular, lack the capability to investigate the temporal evolution of a conversation. To address these shortcomings, in this work, we present CODY, a content-aware, graph-based framework to study the dynamics of online conversations along multiple dimensions. Its capabilities are extensively demonstrated by conducting three experiments based on a large conversation dataset from the German political Twittersphere. First, the posting activity across the lifetime of conversations is examined. We find that posting activity follows an exponential saturation pattern. Based on this activity model, we develop a volume-based sampling method to study conversation dynamics using temporal network snapshots. In a second experiment, we focus on the evolution of a conversation's structure and leverage a novel metric, the temporal Wiener index, for that. Results indicate that as conversations progress, a conversation's structure tends to be less sprawling and more centered around the original seed post. Furthermore, focusing on the dynamics of content in conversations, the evolution of hashtag usage within conversations is studied. Initially used hashtags do not necessarily keep their dominant prevalence throughout the lifetime of a conversation. Instead, various "hashtag hijacking" scenarios are found.


title: Horizons that Gyre and Gimble: A Differential Characterization of Null Hypersurfaces

abstract: Motivated by the thermodynamics of black hole solutions conformal to stationary solutions, we study the geometric invariant theory of null hypersurfaces. It is well-known that a null hypersurface in a Lorentzian manifold can be treated as a Carrollian geometry. Additional structure can be added to this geometry by choosing a connection which yields a Carrollian manifold. In the literature various authors have introduced Koszul connections to study the study the physics on these hypersurfaces. In this paper we examine the various Carrollian geometries and their relationship to null hypersurface embeddings. We specify the geometric data required to construct a rigid Carrollian geometry, and we argue that a connection with torsion is the most natural object to study Carrollian manifolds. We then use this connection to develop a hypersurface calculus suitable for a study of intrinsic and extrinsic differential invariants on embedded null hypersurfaces; motivating examples are given, including geometric invariants preserved under conformal transformations.


title: Fine-Grained Annotation for Face Anti-Spoofing

abstract: Face anti-spoofing plays a critical role in safeguarding facial recognition systems against presentation attacks. While existing deep learning methods show promising results, they still suffer from the lack of fine-grained annotations, which lead models to learn task-irrelevant or unfaithful features. In this paper, we propose a fine-grained annotation method for face anti-spoofing. Specifically, we first leverage the Segment Anything Model (SAM) to obtain pixel-wise segmentation masks by utilizing face landmarks as point prompts. The face landmarks provide segmentation semantics, which segments the face into regions. We then adopt these regions as masks and assemble them into three separate annotation maps: spoof, living, and background maps. Finally, we combine three separate maps into a three-channel map as annotations for model training. Furthermore, we introduce the Multi-Channel Region Exchange Augmentation (MCREA) to diversify training data and reduce overfitting. Experimental results demonstrate that our method outperforms existing state-of-the-art approaches in both intra-dataset and cross-dataset evaluations.


title: A Deep Learning Framework for Spatiotemporal Ultrasound Localization Microscopy

abstract: Ultrasound Localization Microscopy can resolve the microvascular bed down to a few micrometers. To achieve such performance microbubble contrast agents must perfuse the entire microvascular network. Microbubbles are then located individually and tracked over time to sample individual vessels, typically over hundreds of thousands of images. To overcome the fundamental limit of diffraction and achieve a dense reconstruction of the network, low microbubble concentrations must be used, which lead to acquisitions lasting several minutes. Conventional processing pipelines are currently unable to deal with interference from multiple nearby microbubbles, further reducing achievable concentrations. This work overcomes this problem by proposing a Deep Learning approach to recover dense vascular networks from ultrasound acquisitions with high microbubble concentrations. A realistic mouse brain microvascular network, segmented from 2-photon microscopy, was used to train a three-dimensional convolutional neural network based on a V-net architecture. Ultrasound data sets from multiple microbubbles flowing through the microvascular network were simulated and used as ground truth to train the 3D CNN to track microbubbles. The 3D-CNN approach was validated in silico using a subset of the data and in vivo on a rat brain acquisition. In silico, the CNN reconstructed vascular networks with higher precision (81%) than a conventional ULM framework (70%). In vivo, the CNN could resolve micro vessels as small as 10 $\mu$m with an increase in resolution when compared against a conventional approach.


title: Improving the error term in the sieve of Eratosthenes

abstract: We have devised an alternative approach to sifting integers in the sieve of Eratosthenes that helps refine the error term. Instead of eliminating all multiples of a prime number $p<z$ in the traditional sieve method, our approach solely eliminates multiples of $p$ that have the minimum prime factor of $p$. By leveraging the density of integers with the least prime factor $p$ in this sieve technique, we obtain a reduced error term and an upper bound of $\pi(x)$ that accurately reflects the prime number theorem.


title: Coupling of hole double quantum dot in planar germanium to a microwave cavity

abstract: In recent years, notable progress has been made in the study of hole qubits in planar germanium, and circuit quantum electrodynamics (circuit QED) has emerged as a promising approach for achieving long-range coupling and scaling up of qubits. Here, we demonstrate the coupling between holes in a planar germanium double quantum dot (DQD) and photons in a microwave cavity. Specifically, a real-time calibrated virtual gate method is developed to characterize this hybrid system, which in turn allows us to determine the typical parameters sequentially through single-parameter fitting instead of conventional multi-parameter fitting with additional uncertainty, and gives the hole-photon coupling rate of $g_0/2\pi$ = 21.7 MHz. This work is a step toward further research on hole-photon interactions and long-range qubit coupling in planar germanium. The experimental method developed in this work contributes to the more accurate and efficient characterization of hybrid cavity-QED systems.


title: Moving doubly heavy baryon in a strongly coupled plasma from holography

abstract: Gauge/gravity duality is used to study properties of the doubly heavy baryon $(\mathrm{QQq})$ at finite rapidity and temperature in the heavy-ion collision. We investigate the impact of rapidity on string breaking and screening of $\mathrm{QQq}$, and compare these effects with the results for $\rm Q\bar{Q}$ in detail. Computations reveal that the string-breaking distances of $\mathrm{QQq}$ and $\rm Q\bar{Q}$ are close in the confined state and the effects of rapidity and temperature on the string breaking are not significant. An interesting result shows that $\mathrm{QQq}$ cannot be found at high enough temperatures and rapidities; however, $\rm Q\bar{Q}$ can exist under any conditions as long as the separation distance is small enough. Besides, the screening distances of $\mathrm{QQq}$ and $\rm Q\bar{Q}$ are also compared at finite rapidity and temperature. Based on the above analysis, we infer that $\rm Q\bar{Q}$ is more stable than $\mathrm{QQq}$ at finite rapidity and temperature.


title: Optimization of Federated Learning's Client Selection for Non-IID Data Based on Grey Relational Analysis

abstract: Federated learning (FL) is a novel distributed learning framework designed for applications with privacy-sensitive data. Without sharing data, FL trains local models on individual devices and constructs the global model on the server by performing model aggregation. However, to reduce the communication cost, the participants in each training round are randomly selected, which significantly decreases the training efficiency under data and device heterogeneity. To address this issue, in this paper, we introduce a novel approach that considers the data distribution and computational resources of devices to select the clients for each training round. Our proposed method performs client selection based on the Grey Relational Analysis (GRA) theory by considering available computational resources for each client, the training loss, and weight divergence. To examine the usability of our proposed method, we implement our contribution on Amazon Web Services (AWS) by using the TensorFlow library of Python. We evaluate our algorithm's performance in different setups by varying the learning rate, network size, the number of selected clients, and the client selection round. The evaluation results show that our proposed algorithm enhances the performance significantly in terms of test accuracy and the average client's waiting time compared to state-of-the-art methods, federated averaging and Pow-d.


title: Open-Set Knowledge-Based Visual Question Answering with Inference Paths

abstract: Given an image and an associated textual question, the purpose of Knowledge-Based Visual Question Answering (KB-VQA) is to provide a correct answer to the question with the aid of external knowledge bases. Prior KB-VQA models are usually formulated as a retriever-classifier framework, where a pre-trained retriever extracts textual or visual information from knowledge graphs and then makes a prediction among the candidates. Despite promising progress, there are two drawbacks with existing models. Firstly, modeling question-answering as multi-class classification limits the answer space to a preset corpus and lacks the ability of flexible reasoning. Secondly, the classifier merely consider "what is the answer" without "how to get the answer", which cannot ground the answer to explicit reasoning paths. In this paper, we confront the challenge of \emph{explainable open-set} KB-VQA, where the system is required to answer questions with entities at wild and retain an explainable reasoning path. To resolve the aforementioned issues, we propose a new retriever-ranker paradigm of KB-VQA, Graph pATH rankER (GATHER for brevity). Specifically, it contains graph constructing, pruning, and path-level ranking, which not only retrieves accurate answers but also provides inference paths that explain the reasoning process. To comprehensively evaluate our model, we reformulate the benchmark dataset OK-VQA with manually corrected entity-level annotations and release it as ConceptVQA. Extensive experiments on real-world questions demonstrate that our framework is not only able to perform open-set question answering across the whole knowledge base but provide explicit reasoning path.


title: Semi-relativistic antisymmetrized molecular dynamics for energetic neutron production in intermediate energy heavy-ion reactions

abstract: Relativistic corrections have been made in the non-relativistic antisymmetrized molecular dynamics (AMD) simulations to apply to the high energy neutron production in the $^{12}$C+$^{12}$C and $^{16}$O+$^{12}$C collisions at incident energies of 290 and 400 MeV/nucleon. The corrections are made in kinematics alone and no nucleon-nucleon inelastic scatterings nor meson productions are taken into account, and AMD with the relativistic corrections is called semi-relativistic AMD. The three-nucleon collision (3NC) and Fermi boost in the collision processes are taken into account in the non-relativistic AMD. Since the relativistic corrections tend to compensate in each other, the difference between the semi-relativistic and non-relativistic results become small. High energy tails of the available experimental neutron double differential cross sections, especially at larger angles, are well reproduced by AMD with the 3NC term both with non-relativistic and semi-relativistic simulations. These results indicate that the high energy neutrons are dominantly produced by the 3NC process in this incident energy range.


title: On Extreme Value Asymptotics of Projected Sample Covariances in High Dimensions with Applications in Finance and Convolutional Networks

abstract: Maximum-type statistics of certain functions of the sample covariance matrix of high-dimensional vector time series are studied to statistically confirm or reject the null hypothesis that a data set has been collected under normal conditions. The approach generalizes the case of the maximal deviation of the sample autocovariances function from its assumed values. Within a linear time series framework it is shown that Gumbel-type extreme value asymptotics holds true. As applications we discuss long-only mimimal-variance portfolio optimization and subportfolio analysis with respect to idiosyncratic risks, ETF index tracking by sparse tracking portfolios, convolutional deep learners for image analysis and the analysis of array-of-sensors data.