title: Robust Principal Component Analysis using Density Power Divergence

abstract: Principal component analysis (PCA) is a widely employed statistical tool used primarily for dimensionality reduction. However, it is known to be adversely affected by the presence of outlying observations in the sample, which is quite common. Robust PCA methods using M-estimators have theoretical benefits, but their robustness drop substantially for high dimensional data. On the other end of the spectrum, robust PCA algorithms solving principal component pursuit or similar optimization problems have high breakdown, but lack theoretical richness and demand high computational power compared to the M-estimators. We introduce a novel robust PCA estimator based on the minimum density power divergence estimator. This combines the theoretical strength of the M-estimators and the minimum divergence estimators with a high breakdown guarantee regardless of data dimension. We present a computationally efficient algorithm for this estimate. Our theoretical findings are supported by extensive simulations and comparisons with existing robust PCA methods. We also showcase the proposed algorithm's applicability on two benchmark datasets and a credit card transactions dataset for fraud detection.


title: Anisotropic body compliance facilitates robotic sidewinding in complex environments

abstract: Sidewinding, a locomotion strategy characterized by the coordination of lateral and vertical body undulations, is frequently observed in rattlesnakes and has been successfully reconstructed by limbless robotic systems for effective movement across diverse terrestrial terrains. However, the integration of compliant mechanisms into sidewinding limbless robots remains less explored, posing challenges for navigation in complex, rheologically diverse environments. Inspired by a notable control simplification via mechanical intelligence in lateral undulation, which offloads feedback control to passive body mechanics and interactions with the environment, we present an innovative design of a mechanically intelligent limbless robot for sidewinding. This robot features a decentralized bilateral cable actuation system that resembles organismal muscle actuation mechanisms. We develop a feedforward controller that incorporates programmable body compliance into the sidewinding gait template. Our experimental results highlight the emergence of mechanical intelligence when the robot is equipped with an appropriate level of body compliance. This allows the robot to 1) locomote more energetically efficiently, as evidenced by a reduced cost of transport, and 2) navigate through terrain heterogeneities, all achieved in an open-loop manner, without the need for environmental awareness.


title: On CAT($\kappa$) surfaces

abstract: We study the properties of CAT($\kappa$) surfaces: length metric spaces homeomorphic to a surface having curvature bounded above in the sense of satisfying the CAT($\kappa$) condition locally. The main facts about CAT($\kappa$) surfaces seem to be largely a part of mathematical folklore, and this paper is intended to rectify the situation. We provide three distinct proofs of the fact that CAT($\kappa$}) surfaces have bounded integral curvature. This fact allows us to use the established theory of surfaces of bounded curvature to derive further properties of CAT($\kappa$) surfaces. Among other results, we show that such surfaces can be approximated by smooth Riemannian surfaces of Gaussian curvature at most $\kappa$. We do this by giving explicit formulas for smoothing the vertices of model polyhedral surfaces.


title: Comparison of Random Forest and Neural Network Framework for Prediction of Fatigue Crack Growth Rate in Nickel Superalloys

abstract: The rate of fatigue crack growth in Nickle superalloys is a critical factor of safety in the aerospace industry. A machine learning approach is chosen to predict the fatigue crack growth rate as a function of the material composition, material properties and environmental conditions. Random forests and neural network frameworks are used to develop two different models and compare the two results. Both the frameworks give good predictions with $r^2$ of 0.9687 for random forest and 0.9831 for neural network.


title: Left absorption in products of countable orders

abstract: We classify the countable linear orders $X$ for which there is an order $A$ with at least two points such that the lexicographic product $AX$ is isomorphic to $X$. Given such an $X$, we determine every corresponding order $A$, and identify when $X$ is isomorphic to its square. More generally, we characterize the countable orders that embed at least two disjoint convex copies of themselves.


title: Tackling the Unlimited Staleness in Federated Learning with Intertwined Data and Device Heterogeneities

abstract: The efficiency of Federated Learning (FL) is often affected by both data and device heterogeneities. Data heterogeneity is defined as the heterogeneity of data distributions on different clients. Device heterogeneity is defined as the clients' variant latencies in uploading their local model updates due to heterogeneous conditions of local hardware resources, and causes the problem of staleness when being addressed by asynchronous FL. Traditional schemes of tackling the impact of staleness consider data and device heterogeneities as two separate and independent aspects in FL, but this assumption is unrealistic in many practical FL scenarios where data and device heterogeneities are intertwined. In these cases, traditional schemes of weighted aggregation in FL have been proved to be ineffective, and a better approach is to convert a stale model update into a non-stale one. In this paper, we present a new FL framework that leverages the gradient inversion technique for such conversion, hence efficiently tackling unlimited staleness in clients' model updates. Our basic idea is to use gradient inversion to get estimations of clients' local training data from their uploaded stale model updates, and use these estimations to compute non-stale client model updates. In this way, we address the problem of possible data quality drop when using gradient inversion, while still preserving the clients' local data privacy. We compared our approach with the existing FL strategies on mainstream datasets and models, and experiment results demonstrate that when tackling unlimited staleness, our approach can significantly improve the trained model accuracy by up to 20% and speed up the FL training progress by up to 35%.


title: Speech enhancement with frequency domain auto-regressive modeling

abstract: Speech applications in far-field real world settings often deal with signals that are corrupted by reverberation. The task of dereverberation constitutes an important step to improve the audible quality and to reduce the error rates in applications like automatic speech recognition (ASR). We propose a unified framework of speech dereverberation for improving the speech quality and the ASR performance using the approach of envelope-carrier decomposition provided by an autoregressive (AR) model. The AR model is applied in the frequency domain of the sub-band speech signals to separate the envelope and carrier parts. A novel neural architecture based on dual path long short term memory (DPLSTM) model is proposed, which jointly enhances the sub-band envelope and carrier components. The dereverberated envelope-carrier signals are modulated and the sub-band signals are synthesized to reconstruct the audio signal back. The DPLSTM model for dereverberation of envelope and carrier components also allows the joint learning of the network weights for the down stream ASR task. In the ASR tasks on the REVERB challenge dataset as well as on the VOiCES dataset, we illustrate that the joint learning of speech dereverberation network and the E2E ASR model yields significant performance improvements over the baseline ASR system trained on log-mel spectrogram as well as other benchmarks for dereverberation (average relative improvements of 10-24% over the baseline system). The speech quality improvements, evaluated using subjective listening tests, further highlight the improved quality of the reconstructed audio.


title: Relative abundances of CO2, CO, and CH4 in atmospheres of Earth-like lifeless planets

abstract: Carbon is an essential element for life on Earth, and the relative abundances of major carbon species (CO2, CO, and CH4) in the atmosphere exert fundamental controls on planetary climate and biogeochemistry. Here, we employed a theoretical model of atmospheric chemistry to investigate diversity in the atmospheric abundances of CO2, CO, and CH4 on Earth-like lifeless planets orbiting Sun-like (F-, G-, and K-type) stars. We focused on the conditions for the formation of a CO-rich atmosphere, which would be favorable for the origin of life. Results demonstrated that elevated atmospheric CO2 levels trigger photochemical instability of the CO budget in the atmosphere (i.e., CO runaway) owing to enhanced CO2 photolysis relative to H2O photolysis. Higher volcanic outgassing fluxes of reduced C (CO and CH4) also tend to initiate CO runaway. Our systematic examinations revealed that anoxic atmospheres of Earth-like lifeless planets could be classified in the phase space of CH4/CO2 versus CO/CO2, where a distinct gap in atmospheric carbon chemistry is expected to be observed. Our findings indicate that the gap structure is a general feature of Earth-like lifeless planets with reducing atmospheres orbiting Sun-like (F-, G-, and K-type) stars.


title: MediViSTA-SAM: Zero-shot Medical Video Analysis with Spatio-temporal SAM Adaptation for Echocardiography

abstract: The Segmentation Anything Model (SAM) has gained significant attention for its robust generalization capabilities across diverse downstream tasks. However, the performance of SAM is noticeably diminished in medical images due to the substantial disparity between natural and medical image domain. In this paper, we present a zero-shot generalization model specifically designed for echocardiography analysis, called MediViSTA-SAM. Our key components include (i) the introduction of frame-level self-attention, which leverages cross-frame attention across each frame and its neighboring frames to guarantee consistent segmentation outcomes, and (ii) we utilize CNN backbone for feature embedding for the subsequent Transformer for efficient fine-tuning while keeping most of the SAM's parameter reusable. Experiments were conducted using zero-shot segmentation on multi-vendor in-house echocardiography datasets, indicating evaluation without prior exposure to the in-house dataset during training. MediViSTA-SAM effectively overcomes SAM's limitations and can be deployed across various hospital settings without the necessity of re-training models on their respective datasets. Our code is open sourced at: \url{https://github.com/kimsekeun/MediViSTA-SAM}


title: Classification of aut-fixed subgroups in free-abelian times surface groups

abstract: In this paper, we are concerned with free-abelian times surface groups, and show that they contain, up to isomorphism, infinitely many fixed subgroups of automorphisms. Moreover, we give a complete classification of their aut-fixed subgroups.


title: Efficient All-to-All Collective Communication Schedules for Direct-Connect Topologies

abstract: The all-to-all collective communications primitive is widely used in machine learning (ML) and high performance computing (HPC) workloads, and optimizing its performance is of interest to both ML and HPC communities. All-to-all is a particularly challenging workload that can severely strain the underlying interconnect bandwidth at scale. This paper takes a holistic approach to optimize the performance of all-to-all collective communications on supercomputer-scale direct-connect interconnects. We address several algorithmic and practical challenges in developing efficient and bandwidth-optimal all-to-all schedules for any topology and lowering the schedules to various runtimes and interconnect technologies. We also propose a novel topology that delivers near-optimal all-to-all performance.


title: Integrated Sensing and Communications for IoT: Synergies with Key 6G Technology Enablers

abstract: The Internet of Things (IoT) and wireless generations have been evolving simultaneously for the past few decades. Built upon wireless communication and sensing technologies, IoT networks are usually evaluated based on metrics that measure the device ability to sense information and effectively share it with the network, which makes Integrated Sensing and Communication (ISAC) a pivotal candidate for the sixth-generation (6G) IoT standards. This paper reveals several innovative aspects of ISAC from an IoT perspective in 6G, empowering various modern IoT use cases and key technology enablers. Moreover, we address the challenges and future potential of ISAC-enabled IoT, including synergies with Reconfigurable Intelligent Surfaces (RIS), Artificial Intelligence (AI), and key updates of ISAC-IoT in 6G standardization. Furthermore, several evolutionary concepts are introduced to open future research in 6G ISAC-IoT, including the interplay with Non-Terrestrial Networks (NTN) and Orthogonal Time-Frequency Space (OTFS) modulation.


title: Substituting Data Annotation with Balanced Updates and Collective Loss in Multi-label Text Classification

abstract: Multi-label text classification (MLTC) is the task of assigning multiple labels to a given text, and has a wide range of application domains. Most existing approaches require an enormous amount of annotated data to learn a classifier and/or a set of well-defined constraints on the label space structure, such as hierarchical relations which may be complicated to provide as the number of labels increases. In this paper, we study the MLTC problem in annotation-free and scarce-annotation settings in which the magnitude of available supervision signals is linear to the number of labels. Our method follows three steps, (1) mapping input text into a set of preliminary label likelihoods by natural language inference using a pre-trained language model, (2) calculating a signed label dependency graph by label descriptions, and (3) updating the preliminary label likelihoods with message passing along the label dependency graph, driven with a collective loss function that injects the information of expected label frequency and average multi-label cardinality of predictions. The experiments show that the proposed framework achieves effective performance under low supervision settings with almost imperceptible computational and memory overheads added to the usage of pre-trained language model outperforming its initial performance by 70\% in terms of example-based F1 score.


title: Related Rhythms: Recommendation System To Discover Music You May Like

abstract: Machine Learning models are being utilized extensively to drive recommender systems, which is a widely explored topic today. This is especially true of the music industry, where we are witnessing a surge in growth. Besides a large chunk of active users, these systems are fueled by massive amounts of data. These large-scale systems yield applications that aim to provide a better user experience and to keep customers actively engaged. In this paper, a distributed Machine Learning (ML) pipeline is delineated, which is capable of taking a subset of songs as input and producing a new subset of songs identified as being similar to the inputted subset. The publicly accessible Million Songs Dataset (MSD) enables researchers to develop and explore reasonably efficient systems for audio track analysis and recommendations, without having to access a commercialized music platform. The objective of the proposed application is to leverage an ML system trained to optimally recommend songs that a user might like.


title: Sparsity-Based Channel Estimation Exploiting Deep Unrolling for Downlink Massive MIMO

abstract: Massive multiple-input multiple-output (MIMO) enjoys great advantage in 5G wireless communication systems owing to its spectrum and energy efficiency. However, hundreds of antennas require large volumes of pilot overhead to guarantee reliable channel estimation in FDD massive MIMO system. Compressive sensing (CS) has been applied for channel estimation by exploiting the inherent sparse structure of massive MIMO channel but suffer from high complexity. To overcome this challenge, this paper develops a hybrid channel estimation scheme by integrating the model-driven CS and data-driven deep unrolling technique. The proposed scheme consists of a coarse estimation part and a fine correction part to respectively exploit the inter- and intraframe sparsities of channels to greatly reduce the pilot overhead. Theoretical result is provided to indicate the convergence of the fine correction and coarse estimation net. Simulation results are provided to verify that our scheme can estimate MIMO channels with low pilot overhead while guaranteeing estimation accuracy with relatively low complexity.


title: DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learning

abstract: Federated Learning (FL) is a privacy-constrained decentralized machine learning paradigm in which clients enable collaborative training without compromising private data. However, how to learn a robust global model in the data-heterogeneous and model-heterogeneous FL scenarios is challenging. To address it, we resort to data-free knowledge distillation to propose a new FL method (namely DFRD). DFRD equips a conditional generator on the server to approximate the training space of the local models uploaded by clients, and systematically investigates its training in terms of fidelity, transferability} and diversity. To overcome the catastrophic forgetting of the global model caused by the distribution shifts of the generator across communication rounds, we maintain an exponential moving average copy of the generator on the server. Additionally, we propose dynamic weighting and label sampling to accurately extract knowledge from local models. Finally, our extensive experiments on various image classification tasks illustrate that DFRD achieves significant performance gains compared to SOTA baselines.


title: Fully and Doubly-heavy four-quarks within QCD Laplace sum rule

abstract: We present a review of our results for the masses and couplings of the scalar fully heavy four-quarks and $T_{QQ\bar{q}\bar{q}'}\, (J^P=0^\pm , 1^\pm)$ tetraquarks states from QCD Laplace sum rule (LSR), their ratios ${\cal R}$ and double ratio of sum rules (DRSR) within stability criteria and including Factorized Next-to-Leading Order (FNLO) Perturbative (PT) corrections. As the Operator Product Expansion (OPE) usually converges for $d\leqslant 6-8$, we evaluated the QCD spectral functions at Lowest Order of PT QCD and up to $\langle G^3 \rangle$. Our results for the $0^{++}$ fully heavy four-quark states may explain the LHCb broad structure around (6.2-6.7)GeV which can be due to $\overline{\eta_c} \eta_c,~~ \overline{\chi_{c1}}\chi_{c1}$ and $\overline{J/\psi}J/\psi$ molecules or/and their analogue $S_c S_c,~~ A_cA_c$ and $V_cV_c$ tetraquarks. The peak at (6.8-6.9)GeV can be identified to the $\overline{\chi_{c0}}\chi_{c0}$ molecule or/and the $P_c P_c$ tetraquark state. Then, combining ${\cal R}$ and DRSR we focus on the analysis of the four-quark nature of $T_{cc\bar{q}\bar{q}'}$ $1^{\pm}$ and $0^{\pm}$ states. We show that combining ${\cal R}$ and DRSR can provide more precise results: $M_{T^{1^+}_{cc}}=3886(6)$MeV and $M_{T^{0^+}_{cc}}=3883(3)$MeV. From our estimates of the masses of the Pseudoscalar and Vector $T_{cc\bar{q}\bar{q}'}$ states, we observe that the interpolating currents lead to two classes: Class H (Heavy) states with masses around 6GeV and Class L (Light) states around (3.8-4.4)GeV where the pseudoscalar (resp. all vector states) are below the $\overline{D}D_0,~~ overline{D}_s D_{s0}$ (resp. $\overline{D}D_1,~~ \overline{D}_s D_{s1}$) open charm thresholds. Finally, we extend the whole study to the bottom sector and confront our results with the ones from different LSR predictions and some other approaches in the literature.


title: Quantum All-Subkeys-Recovery Attacks on 6-round Feistel-2* Structure Based on Multi-Equations Quantum Claw Finding

abstract: Exploiting quantum mechanisms, quantum attacks have the potential ability to break the cipher structure. Recently, Ito et al. proposed a quantum attack on Feistel-2* structure (Ito et al.'s attack) based onthe Q2 model. However, it is not realistic since the quantum oracle needs to be accessed by the adversary, and the data complexityis high. To solve this problem, a quantum all-subkeys-recovery (ASR) attack based on multi-equations quantum claw-finding is proposed, which takes a more realistic model, the Q1 model, as the scenario, and only requires 3 plain-ciphertext pairs to quickly crack the 6-round Feistel-2* structure. First, we proposed a multi-equations quantum claw-finding algorithm to solve the claw problem of finding multiple equations. In addition, Grover's algorithm is used to speedup the rest subkeys recovery. Compared with Ito et al.'s attack, the data complexity of our attack is reduced from O(2^n) to O(1), while the time complexity and memory complexity are also significantly reduced.


title: Towards Robust Robot 3D Perception in Urban Environments: The UT Campus Object Dataset

abstract: We introduce the UT Campus Object Dataset (CODa), a mobile robot egocentric perception dataset collected on the University of Texas Austin Campus. Our dataset contains 8.5 hours of multimodal sensor data: synchronized 3D point clouds and stereo RGB video from a 128-channel 3D LiDAR and two 1.25MP RGB cameras at 10 fps; RGB-D videos from an additional 0.5MP sensor at 7 fps, and a 9-DOF IMU sensor at 40 Hz. We provide 58 minutes of ground-truth annotations containing 1.3 million 3D bounding boxes with instance IDs for 53 semantic classes, 5000 frames of 3D semantic annotations for urban terrain, and pseudo-ground truth localization. We repeatedly traverse identical geographic locations for a wide range of indoor and outdoor areas, weather conditions, and times of the day. Using CODa, we empirically demonstrate that: 1) 3D object detection performance in urban settings is significantly higher when trained using CODa compared to existing datasets even when employing state-of-the-art domain adaptation approaches, 2) sensor-specific fine-tuning improves 3D object detection accuracy and 3) pretraining on CODa improves cross-dataset 3D object detection performance in urban settings compared to pretraining on AV datasets. Using our dataset and annotations, we release benchmarks for 3D object detection and 3D semantic segmentation using established metrics. In the future, the CODa benchmark will include additional tasks like unsupervised object discovery and re-identification. We publicly release CODa on the Texas Data Repository, pre-trained models, dataset development package, and interactive dataset viewer on our website at https://amrl.cs.utexas.edu/coda. We expect CODa to be a valuable dataset for research in egocentric 3D perception and planning for autonomous navigation in urban environments.


title: I-AI: A Controllable & Interpretable AI System for Decoding Radiologists' Intense Focus for Accurate CXR Diagnoses

abstract: In the field of chest X-ray (CXR) diagnosis, existing works often focus solely on determining where a radiologist looks, typically through tasks such as detection, segmentation, or classification. However, these approaches are often designed as black-box models, lacking interpretability. In this paper, we introduce Interpretable Artificial Intelligence (I-AI) a novel and unified controllable interpretable pipeline for decoding the intense focus of radiologists in CXR diagnosis. Our I-AI addresses three key questions: where a radiologist looks, how long they focus on specific areas, and what findings they diagnose. By capturing the intensity of the radiologist's gaze, we provide a unified solution that offers insights into the cognitive process underlying radiological interpretation. Unlike current methods that rely on black-box machine learning models, which can be prone to extracting erroneous information from the entire input image during the diagnosis process, we tackle this issue by effectively masking out irrelevant information. Our proposed I-AI leverages a vision-language model, allowing for precise control over the interpretation process while ensuring the exclusion of irrelevant features. To train our I-AI model, we utilize an eye gaze dataset to extract anatomical gaze information and generate ground truth heatmaps. Through extensive experimentation, we demonstrate the efficacy of our method. We showcase that the attention heatmaps, designed to mimic radiologists' focus, encode sufficient and relevant information, enabling accurate classification tasks using only a portion of CXR. The code, checkpoints, and data are at https://github.com/UARK-AICV/IAI


title: Following in Yiu's Footsteps but on the Eisenstein Lattice

abstract: Paul Yiu proved that all Heron triangles are realizable on the integer lattice. We give an analogous result for triangles with vertices on the Eisenstein lattice.


title: Iterative Layerwise Training for Quantum Approximate Optimization Algorithm

abstract: The capability of the quantum approximate optimization algorithm (QAOA) in solving the combinatorial optimization problems has been intensively studied in recent years due to its application in the quantum-classical hybrid regime. Despite having difficulties that are innate in the variational quantum algorithms (VQA), such as barren plateaus and the local minima problem, QAOA remains one of the applications that is suitable for the recent noisy intermediate scale quantum (NISQ) devices. Recent works have shown that the performance of QAOA largely depends on the initial parameters, which motivate parameter initialization strategies to obtain good initial points for the optimization of QAOA. On the other hand, optimization strategies focus on the optimization part of QAOA instead of the parameter initialization. Instead of having absolute advantages, these strategies usually impose trade-offs to the performance of the optimization problems. One of such examples is the layerwise optimization strategy, in which the QAOA parameters are optimized layer-by-layer instead of the full optimization. The layerwise strategy costs less in total compared to the full optimization, in exchange of lower approximation ratio. In this work, we propose the iterative layerwise optimization strategy and explore the possibility for the reduction of optimization cost in solving problems with QAOA. Using numerical simulations, we found out that by combining the iterative layerwise with proper initialization strategies, the optimization cost can be significantly reduced in exchange for a minor reduction in the approximation ratio. We also show that in some cases, the approximation ratio given by the iterative layerwise strategy is even higher than that given by the full optimization.


title: Generalized Dice Focal Loss trained 3D Residual UNet for Automated Lesion Segmentation in Whole-Body FDG PET/CT Images

abstract: Automated segmentation of cancerous lesions in PET/CT images is a vital initial task for quantitative analysis. However, it is often challenging to train deep learning-based segmentation methods to high degree of accuracy due to the diversity of lesions in terms of their shapes, sizes, and radiotracer uptake levels. These lesions can be found in various parts of the body, often close to healthy organs that also show significant uptake. Consequently, developing a comprehensive PET/CT lesion segmentation model is a demanding endeavor for routine quantitative image analysis. In this work, we train a 3D Residual UNet using Generalized Dice Focal Loss function on the AutoPET challenge 2023 training dataset. We develop our models in a 5-fold cross-validation setting and ensemble the five models via average and weighted-average ensembling. On the preliminary test phase, the average ensemble achieved a Dice similarity coefficient (DSC), false-positive volume (FPV) and false negative volume (FNV) of 0.5417, 0.8261 ml, and 0.2538 ml, respectively, while the weighted-average ensemble achieved 0.5417, 0.8186 ml, and 0.2538 ml, respectively. Our algorithm can be accessed via this link: https://github.com/ahxmeds/autosegnet.


title: A Novel Stochastic Interacting Particle-Field Algorithm for 3D Parabolic-Parabolic Keller-Segel Chemotaxis System

abstract: We introduce an efficient stochastic interacting particle-field (SIPF) algorithm with no history dependence for computing aggregation patterns and near singular solutions of parabolic-parabolic Keller-Segel (KS) chemotaxis system in three space dimensions (3D). The KS solutions are approximated as empirical measures of particles coupled with a smoother field (concentration of chemo-attractant) variable computed by the spectral method. Instead of using heat kernels causing history dependence and high memory cost, we leverage the implicit Euler discretization to derive a one-step recursion in time for stochastic particle positions and the field variable based on the explicit Green's function of an elliptic operator of the form Laplacian minus a positive constant. In numerical experiments, we observe that the resulting SIPF algorithm is convergent and self-adaptive to the high gradient part of solutions. Despite the lack of analytical knowledge (e.g. a self-similar ansatz) of the blowup, the SIPF algorithm provides a low-cost approach to study the emergence of finite time blowup in 3D by only dozens of Fourier modes and through varying the amount of initial mass and tracking the evolution of the field variable. Notably, the algorithm can handle at ease multi-modal initial data and the subsequent complex evolution involving the merging of particle clusters and formation of a finite time singularity.


title: Sensitivity analysis of wall-modeled large-eddy simulation for separated turbulent flow

abstract: In this study, we conduct a parametric analysis to evaluate the sensitivities of wall-modeled large-eddy simulation (LES) with respect to subgrid-scale (SGS) models, mesh resolution, wall boundary conditions and mesh anisotropy. While such investigations have been conducted for attached/flat-plate flow configurations, systematic studies specifically targeting turbulent flows with separation are notably sparse. To bridge this gap, our study focuses on the flow over a two-dimensional Gaussian-shaped bump at a moderately high Reynolds number, which involves smooth-body separation of a turbulent boundary layer under pressure-gradient and surface-curvature effects. In the simulations, the no-slip condition at the wall is replaced by three different forms of boundary condition based on the thin boundary layer equations and the mean wall-shear stress from high-fidelity numerical simulation to avoid the additional complexity of modeling the wall-shear stress. Various statistics, including the mean separation bubble size, mean velocity profile, and dissipation from SGS model, are compared and analyzed. The results reveal that capturing the separation bubble strongly depends on the choice of SGS model. While simulations approach grid convergence with resolutions nearing those of wall-resolved LES meshes, above this limit, the LES predictions exhibit intricate sensitivities to mesh resolution. Furthermore, both wall boundary conditions and the anisotropy of mesh cells exert discernible impacts on the turbulent flow predictions, yet the magnitudes of these impacts vary based on the specific SGS model chosen for the simulation.


title: LOGICSEG: Parsing Visual Semantics with Neural Logic Learning and Reasoning

abstract: Current high-performance semantic segmentation models are purely data-driven sub-symbolic approaches and blind to the structured nature of the visual world. This is in stark contrast to human cognition which abstracts visual perceptions at multiple levels and conducts symbolic reasoning with such structured abstraction. To fill these fundamental gaps, we devise LOGICSEG, a holistic visual semantic parser that integrates neural inductive learning and logic reasoning with both rich data and symbolic knowledge. In particular, the semantic concepts of interest are structured as a hierarchy, from which a set of constraints are derived for describing the symbolic relations and formalized as first-order logic rules. After fuzzy logic-based continuous relaxation, logical formulae are grounded onto data and neural computational graphs, hence enabling logic-induced network training. During inference, logical constraints are packaged into an iterative process and injected into the network in a form of several matrix multiplications, so as to achieve hierarchy-coherent prediction with logic reasoning. These designs together make LOGICSEG a general and compact neural-logic machine that is readily integrated into existing segmentation models. Extensive experiments over four datasets with various segmentation models and backbones verify the effectiveness and generality of LOGICSEG. We believe this study opens a new avenue for visual semantic parsing.


title: Bayesian Parameter Inference for Partially Observed Diffusions using Multilevel Stochastic Runge-Kutta Methods

abstract: We consider the problem of Bayesian estimation of static parameters associated to a partially and discretely observed diffusion process. We assume that the exact transition dynamics of the diffusion process are unavailable, even up-to an unbiased estimator and that one must time-discretize the diffusion process. In such scenarios it has been shown how one can introduce the multilevel Monte Carlo method to reduce the cost to compute posterior expected values of the parameters for a pre-specified mean square error (MSE). These afore-mentioned methods rely on upon the Euler-Maruyama discretization scheme which is well-known in numerical analysis to have slow convergence properties. We adapt stochastic Runge-Kutta (SRK) methods for Bayesian parameter estimation of static parameters for diffusions. This can be implemented in high-dimensions of the diffusion and seemingly under-appreciated in the uncertainty quantification and statistics fields. For a class of diffusions and SRK methods, we consider the estimation of the posterior expectation of the parameters. We prove that to achieve a MSE of $\mathcal{O}(\epsilon^2)$, for $\epsilon>0$ given, the associated work is $\mathcal{O}(\epsilon^{-2})$. Whilst the latter is achievable for the Milstein scheme, this method is often not applicable for diffusions in dimension larger than two. We also illustrate our methodology in several numerical examples.


title: Simulation of optoelectronic oscillator injection locking, pulling and spiking phenomena

abstract: Complex envelope and reduced phase simulation models describing the dynamical behavior of an optoelectronic oscillator (OEO) under injection by an external source are described. The models are built on the foundations of a previously reported delay integral differential equation (DDE) theory of injection locking of time delay oscillators (TDO) such as the OEO. The DDE formulation is particularly amenable to high precision simulation using the Simulink block diagram environment. The correspondence between the blocks and the oscillator components offers intuition and considerable freedom to explore different circuit architectures and design variations with minimal coding effort. The simulations facilitate the study of the profound effect the multimode nature of a TDO has on its dynamical behavior. The reduced phase models that make use of the Leeson approximation are generally successful in reproducing the results of complex envelope models for established oscillations except for spiking phenomena for which the Leeson approximation fails. Simulation results demonstrating phenomena not captured by classical injection theory are presented, including multimode oscillation, the appearance of sidemodes in the RF and phase noise spectrum, and persistent spike trains redolent of recent experimental observations of 2pi phase pulse trains in a broadband OEO under injection.


title: Swashplateless-elevon Actuation for a Dual-rotor Tail-sitter VTOL UAV

abstract: In this paper, we propose a novel swashplateless-elevon actuation (SEA) for dual-rotor tail-sitter vertical takeoff and landing (VTOL) unmanned aerial vehicles (UAVs). In contrast to the conventional elevon actuation (CEA) which controls both pitch and yaw using elevons, the SEA adopts swashplateless mechanisms to generate an extra moment through motor speed modulation to control pitch and uses elevons solely for controlling yaw, without requiring additional actuators. This decoupled control strategy mitigates the saturation of elevons' deflection needed for large pitch and yaw control actions, thus improving the UAV's control performance on trajectory tracking and disturbance rejection performance in the presence of large external disturbances. Furthermore, the SEA overcomes the actuation degradation issues experienced by the CEA when the UAV is in close proximity to the ground, leading to a smoother and more stable take-off process. We validate and compare the performances of the SEA and the CEA in various real-world flight conditions, including take-off, trajectory tracking, and hover flight and position steps under external disturbance. Experimental results demonstrate that the SEA has better performances than the CEA. Moreover, we verify the SEA's feasibility in the attitude transition process and fixed-wing-mode flight of the VTOL UAV. The results indicate that the SEA can accurately control pitch in the presence of high-speed incoming airflow and maintain a stable attitude during fixed-wing mode flight. Video of all experiments can be found in youtube.com/watch?v=Sx9Rk4Zf7sQ


title: Multi-stream radial structure of cold dark matter haloes from particle trajectories: deep inside splashback radius

abstract: By tracking trajectories of dark matter (DM) particles accreting onto haloes in cosmological $N$-body simulations, we investigate the radial phase-space distribution of cold dark matter (CDM) haloes, paying attention to their inner regions deep inside the halo boundary called the splashback radius, where the particles undergo multi-stream flows. Improving the analysis by Sugiura et al., we classify DM particles by the number of apocenter passages, $p$, and count it up to $p=40$ for each halo over a wide mass range. Quantifying the radial density profile for particles having the same value of $p$, we find that it generally exhibits a double-power law feature, whose indices of inner and outer slopes are well-described by $-1$ and $-8$, respectively. Its characteristic scale and density are given as a simple fitting function of $p$, with a weak halo mass dependence. Interestingly, summing up these double-power law profiles beyond $p=40$ reproduces well the total density profile of simulated haloes. The double-power law nature is persistent and generic not only in mass-selected haloes but also in haloes selected in different criteria. Our results are compared with self-similar solutions that describe the stationary and spherical accretion of DM. We find that even when introducing a non-zero angular momentum, none of them explain the radial multi-stream structure. The analysis with particle trajectories tracing back to higher redshifts suggests that the double-power law nature has been established during an early accretion phase and remains stable.


title: Cordyceps@LT-EDI: Patching Language-Specific Homophobia/Transphobia Classifiers with a Multilingual Understanding

abstract: Detecting transphobia, homophobia, and various other forms of hate speech is difficult. Signals can vary depending on factors such as language, culture, geographical region, and the particular online platform. Here, we present a joint multilingual (M-L) and language-specific (L-S) approach to homophobia and transphobic hate speech detection (HSD). M-L models are needed to catch words, phrases, and concepts that are less common or missing in a particular language and subsequently overlooked by L-S models. Nonetheless, L-S models are better situated to understand the cultural and linguistic context of the users who typically write in a particular language. Here we construct a simple and successful way to merge the M-L and L-S approaches through simple weight interpolation in such a way that is interpretable and data-driven. We demonstrate our system on task A of the 'Shared Task on Homophobia/Transphobia Detection in social media comments' dataset for homophobia and transphobic HSD. Our system achieves the best results in three of five languages and achieves a 0.997 macro average F1-score on Malayalam texts.


title: Keeping in Time: Adding Temporal Context to Sentiment Analysis Models

abstract: This paper presents a state-of-the-art solution to the LongEval CLEF 2023 Lab Task 2: LongEval-Classification. The goal of this task is to improve and preserve the performance of sentiment analysis models across shorter and longer time periods. Our framework feeds date-prefixed textual inputs to a pre-trained language model, where the timestamp is included in the text. We show date-prefixed samples better conditions model outputs on the temporal context of the respective texts. Moreover, we further boost performance by performing self-labeling on unlabeled data to train a student model. We augment the self-labeling process using a novel augmentation strategy leveraging the date-prefixed formatting of our samples. We demonstrate concrete performance gains on the LongEval-Classification evaluation set over non-augmented self-labeling. Our framework achieves a 2nd place ranking with an overall score of 0.6923 and reports the best Relative Performance Drop (RPD) of -0.0656 over the short evaluation set.


title: Multivariate Prototype Representation for Domain-Generalized Incremental Learning

abstract: Deep learning models suffer from catastrophic forgetting when being fine-tuned with samples of new classes. This issue becomes even more pronounced when faced with the domain shift between training and testing data. In this paper, we study the critical and less explored Domain-Generalized Class-Incremental Learning (DGCIL). We design a DGCIL approach that remembers old classes, adapts to new classes, and can classify reliably objects from unseen domains. Specifically, our loss formulation maintains classification boundaries and suppresses the domain-specific information of each class. With no old exemplars stored, we use knowledge distillation and estimate old class prototype drift as incremental training advances. Our prototype representations are based on multivariate Normal distributions whose means and covariances are constantly adapted to changing model features to represent old classes well by adapting to the feature space drift. For old classes, we sample pseudo-features from the adapted Normal distributions with the help of Cholesky decomposition. In contrast to previous pseudo-feature sampling strategies that rely solely on average mean prototypes, our method excels at capturing varying semantic information. Experiments on several benchmarks validate our claims.


title: Upper branch thermal Hall effect in quantum paramagnets

abstract: Inspired by the persistent thermal Hall effects at finite temperatures in various quantum paramagnets, we explore the origin of the thermal Hall effects from the perspective of the upper branch parts by invoking the dispersive and twisted crystal field excitations. It is shown that the upper branches of the local energy levels could hybridize and form the dispersive bands. The observation is that, upon the time-reversal symmetry breaking by the magnetic fields, these upper branch bands could acquire a Berry curvature distribution and contribute to the thermal Hall effect in the paramagnetic regime. As a proof of principle, we consider the setting on the kagom\'e lattice with one ground state singlet and an excited doublet, and show this is indeed possible. We expect this effect to be universal and has no strong connection with the underlying lattice. Although the thermal Hall signal can be contributed from other sources such as phonons and their scattering in the actual materials, we discuss the application to the Mott systems with the large local Hilbert spaces.


title: Nutritional composition and bioactive compounds of mini watermelon genotypes in Bangladesh

abstract: Given the present rising trends in changing lifestyle and consumption patterns, watermelon production has shifted from big to small-sized fruits having desirable quality attributes. Hence, analyses of fruit quality traits of mini watermelon are crucial to develop improved cultivars with enhanced nutritional compositions, consumer-preferred traits and extended storage life. In this context, fruit morphological and nutritional attributes of five mini watermelon genotypes namely BARI watermelon 1 (W1), BARI watermelon 2 (W2), L-32468 (W3), L-32236 (W4) and L-32394 (W5) were evaluated to appraise promising genotypes with better fruit quality. The evaluated genotypes expressed different levels of diversity for fruit physical qualitative traits including differences in shape, rind and flesh color and texture. The study also revealed significant variability among the genotypes regarding all observed fruit morphological and nutritional aspects as well as bioactive compounds. Among the studied genotypes, W1 stood out with the highest TSS as well as rind vitamin C and total phenolic content accompanied by higher fruit weight and thick rind. On the other hand, W3 genotype was featured with higher amount of \b{eta} carotene, total phenolic and flavonoid content in its flesh along with rind enriched with \b{eta} carotene and minerals. However, comparatively higher amount of sugar and total flavonoid content was recorded in the rind of W5 genotype. Therefore, W1 and W3 could be exploited for table purpose and using in breeding program to develop mini watermelon cultivars with more attractive fruits in terms of quality acceptance and nutritional value in Bangladesh. Furthermore, rind of BARI watermelon 1 and L-32394 could be considered as the potential cheap source of bioactive compounds to be used for dietary and industrial purpose which would decrease the solid waste in the environment.


title: Probing the non-Abelian fusion of a pair of Majorana zero modes

abstract: In this work, we perform real time simulations for probing the non-Abelian fusion of a pair of Majorana zero modes (MZMs). The nontrivial fusion outcomes can be either a vacuum, or an unpaired fermion, which reflect the underlying non-Abelian statistics. The two possible outcomes can cause different charge variations in the nearby probing quantum dot (QD), while the charge occupation in the dot is detected by a quantum point contact. In particular, we find that gradual fusion and gradual coupling of the MZMs to the QD (in nearly adiabatic switching-on limit) provide a simpler detection scheme than sudden coupling after fusion to infer the coexistence of two fusion outcomes, by measuring the occupation probability of the QD. For the scheme of sudden coupling (after fusion), we propose and analyze continuous weak measurement for the quantum oscillations of the QD occupancy. From the power spectrum of the measurement currents, one can identify the characteristic frequencies and infer thus the coexistence of the fusion outcomes.


title: MentaLLaMA: Interpretable Mental Health Analysis on Social Media with Large Language Models

abstract: With the development of web technology, social media texts are becoming a rich source for automatic mental health analysis. As traditional discriminative methods bear the problem of low interpretability, the recent large language models have been explored for interpretable mental health analysis on social media, which aims to provide detailed explanations along with predictions. The results show that ChatGPT can generate approaching-human explanations for its correct classifications. However, LLMs still achieve unsatisfactory classification performance in a zero-shot/few-shot manner. Domain-specific finetuning is an effective solution, but faces 2 challenges: 1) lack of high-quality training data. 2) no open-source LLMs for interpretable mental health analysis were released to lower the finetuning cost. To alleviate these problems, we build the first multi-task and multi-source interpretable mental health instruction (IMHI) dataset on social media, with 105K data samples. The raw social media data are collected from 10 existing sources covering 8 mental health analysis tasks. We use expert-written few-shot prompts and collected labels to prompt ChatGPT and obtain explanations from its responses. To ensure the reliability of the explanations, we perform strict automatic and human evaluations on the correctness, consistency, and quality of generated data. Based on the IMHI dataset and LLaMA2 foundation models, we train MentalLLaMA, the first open-source LLM series for interpretable mental health analysis with instruction-following capability. We also evaluate the performance of MentalLLaMA on the IMHI evaluation benchmark with 10 test sets, where their correctness for making predictions and the quality of explanations are examined. The results show that MentalLLaMA approaches state-of-the-art discriminative methods in correctness and generates high-quality explanations.


title: The $\circ$ operation and $*$ operation of Cohen-Macaulay bipartite graphs

abstract: Let $G$ be a finite simple graph with the vertex set $V$ and let $I_G$ be its edge ideal in the polynomial ring $S=\mathbb{K}[x_V]$. In this paper, we compute the depth and the Castelnuovo--Mumford regularity of $S/I_G$ when $G=G_1\circ G_2$ or $G=G_1* G_2$ is a graph obtained from Cohen-Macaulay bipartite graphs $G_1$, $G_2$ by $\circ$ operation or $*$ operation, respectively.


title: On the automorphism group of parabolic structures and closed aspherical manifolds

abstract: In this expository paper we discuss several properties on closed aspherical parabolic ${\sfG}$-manifolds $X/\Gamma$. These are manifolds $X/\Gamma$, where $X$ is a smooth contractible manifold with a parabolic ${\sfG}$-structure for which $\Gamma\leq \Aut_{\sfG}(X)$ is a discrete subgroup acting properly discontinuously on $X$ with compact quotient. By a parabolic $\sfG$-structure on $X$ we have in mind a Cartan structure which is modeled on one of the classical parabolic geometries arising from simple Lie groups $\sfG$ of rank one. Our results concern in particular the properties of the automorphism groups $\Aut_{\sfG}(X/\Gamma)$. Our main results show that the existence of certain parabolic ${\sfG}$-structures can pose strong restrictions on the topology of compact aspherical manifolds $X/\Gamma$ and their parabolic automorphism groups. In this realm we prove that any compact aspherical standard $CR$-manifold with virtually solvable fundamental group is diffeomorphic to a quotient of a Heisenberg manifold of complex type with its standard $CR$-structure. Furthermore we discuss the analogue properties of standard quaternionic contact manifolds in relation to the quaternionic Heisenberg group.


title: Robust 6DoF Pose Estimation Against Depth Noise and a Comprehensive Evaluation on a Mobile Dataset

abstract: Robust 6DoF pose estimation with mobile devices is the foundation for applications in robotics, augmented reality, and digital twin localization. In this paper, we extensively investigate the robustness of existing RGBD-based 6DoF pose estimation methods against varying levels of depth sensor noise. We highlight that existing 6DoF pose estimation methods suffer significant performance discrepancies due to depth measurement inaccuracies. In response to the robustness issue, we present a simple and effective transformer-based 6DoF pose estimation approach called DTTDNet, featuring a novel geometric feature filtering module and a Chamfer distance loss for training. Moreover, we advance the field of robust 6DoF pose estimation and introduce a new dataset -- Digital Twin Tracking Dataset Mobile (DTTD-Mobile), tailored for digital twin object tracking with noisy depth data from the mobile RGBD sensor suite of the Apple iPhone 14 Pro. Extensive experiments demonstrate that DTTDNet significantly outperforms state-of-the-art methods at least 4.32, up to 60.74 points in ADD metrics on the DTTD-Mobile. More importantly, our approach exhibits superior robustness to varying levels of measurement noise, setting a new benchmark for the robustness to noise measurements. Code and dataset are made publicly available at: https://github.com/augcog/DTTD2


title: Matrix Completion-Informed Deep Unfolded Equilibrium Models for Self-Supervised k-Space Interpolation in MRI

abstract: Recently, regularization model-driven deep learning (DL) has gained significant attention due to its ability to leverage the potent representational capabilities of DL while retaining the theoretical guarantees of regularization models. However, most of these methods are tailored for supervised learning scenarios that necessitate fully sampled labels, which can pose challenges in practical MRI applications. To tackle this challenge, we propose a self-supervised DL approach for accelerated MRI that is theoretically guaranteed and does not rely on fully sampled labels. Specifically, we achieve neural network structure regularization by exploiting the inherent structural low-rankness of the $k$-space data. Simultaneously, we constrain the network structure to resemble a nonexpansive mapping, ensuring the network's convergence to a fixed point. Thanks to this well-defined network structure, this fixed point can completely reconstruct the missing $k$-space data based on matrix completion theory, even in situations where full-sampled labels are unavailable. Experiments validate the effectiveness of our proposed method and demonstrate its superiority over existing self-supervised approaches and traditional regularization methods, achieving performance comparable to that of supervised learning methods in certain scenarios.


title: Causal Asymmetry of Classical and Quantum Autonomous Agents

abstract: Why is it that a ticking clock typically becomes less accurate when subject to outside noise but rarely the reverse? Here, we formalize this phenomenon by introducing process causal asymmetry - a fundamental difference in the amount of past information an autonomous agent must track to transform one stochastic process to another over an agent that transforms in the opposite direction. We then illustrate that this asymmetry can paradoxically be reversed when agents possess a quantum memory. Thus, the spontaneous direction in which processes get 'simpler' may be different, depending on whether quantum information processing is allowed or not.


title: The second multi-channel multi-party meeting transcription challenge (M2MeT) 2.0): A benchmark for speaker-attributed ASR

abstract: With the success of the first Multi-channel Multi-party Meeting Transcription challenge (M2MeT), the second M2MeT challenge (M2MeT 2.0) held in ASRU2023 particularly aims to tackle the complex task of \emph{speaker-attributed ASR (SA-ASR)}, which directly addresses the practical and challenging problem of ``who spoke what at when" at typical meeting scenario. We particularly established two sub-tracks. The fixed training condition sub-track, where the training data is constrained to predetermined datasets, but participants can use any open-source pre-trained model. The open training condition sub-track, which allows for the use of all available data and models without limitation. In addition, we release a new 10-hour test set for challenge ranking. This paper provides an overview of the dataset, track settings, results, and analysis of submitted systems, as a benchmark to show the current state of speaker-attributed ASR.


title: LLM for Test Script Generation and Migration: Challenges, Capabilities, and Opportunities

abstract: This paper investigates the application of large language models (LLM) in the domain of mobile application test script generation. Test script generation is a vital component of software testing, enabling efficient and reliable automation of repetitive test tasks. However, existing generation approaches often encounter limitations, such as difficulties in accurately capturing and reproducing test scripts across diverse devices, platforms, and applications. These challenges arise due to differences in screen sizes, input modalities, platform behaviors, API inconsistencies, and application architectures. Overcoming these limitations is crucial for achieving robust and comprehensive test automation. By leveraging the capabilities of LLMs, we aim to address these challenges and explore its potential as a versatile tool for test automation. We investigate how well LLMs can adapt to diverse devices and systems while accurately capturing and generating test scripts. Additionally, we evaluate its cross-platform generation capabilities by assessing its ability to handle operating system variations and platform-specific behaviors. Furthermore, we explore the application of LLMs in cross-app migration, where it generates test scripts across different applications and software environments based on existing scripts. Throughout the investigation, we analyze its adaptability to various user interfaces, app architectures, and interaction patterns, ensuring accurate script generation and compatibility. The findings of this research contribute to the understanding of LLMs' capabilities in test automation. Ultimately, this research aims to enhance software testing practices, empowering app developers to achieve higher levels of software quality and development efficiency.


title: Probabilistic Weight Fixing: Large-scale training of neural network weight uncertainties for quantization

abstract: Weight-sharing quantization has emerged as a technique to reduce energy expenditure during inference in large neural networks by constraining their weights to a limited set of values. However, existing methods for weight-sharing quantization often make assumptions about the treatment of weights based on value alone that neglect the unique role weight position plays. This paper proposes a probabilistic framework based on Bayesian neural networks (BNNs) and a variational relaxation to identify which weights can be moved to which cluster centre and to what degree based on their individual position-specific learned uncertainty distributions. We introduce a new initialisation setting and a regularisation term which allow for the training of BNNs under complex dataset-model combinations. By leveraging the flexibility of weight values captured through a probability distribution, we enhance noise resilience and downstream compressibility. Our iterative clustering procedure demonstrates superior compressibility and higher accuracy compared to state-of-the-art methods on both ResNet models and the more complex transformer-based architectures. In particular, our method outperforms the state-of-the-art quantization method top-1 accuracy by 1.6% on ImageNet using DeiT-Tiny, with its 5 million+ weights now represented by only 296 unique values.


title: Unmotivated ergodic averages

abstract: We consider weighted ergodic averages indexed by primes, where the weight depends on the prime, and is a "trace function" coming from algebraic geometry. We obtain extensions the classical mean-ergodic and pointwise ergodic theorems, as well as some result in the topological setting, and raise some further problems.


title: Aryabhata and the Construction of the First Trigonometric Table

abstract: Few among us would know that the first mention of the sine and the enumeration of the first sine table are to be credited to Aryabhata. The method to generate this relies on the sine difference formula which is derived using ingenious arguments based on similar triangles. We describe how this was done. In order to make our presentation pedagogical we take a unit circle and radians instead of the (now) archaic notation in the Aryabhatiya and its commentators. We suggest a couple of exercise problems and invite the enterprising student to try their hands. We also point out that his sine and the second sine difference identities are related to the finite difference calculus we now routinely use to calculate derivatives and second derivatives. An understanding of these trigonometric identities and preparation of the sine table will enable a student to get an appreciation of the path breaking work of Aryabhata.


title: A SAM-based Solution for Hierarchical Panoptic Segmentation of Crops and Weeds Competition

abstract: Panoptic segmentation in agriculture is an advanced computer vision technique that provides a comprehensive understanding of field composition. It facilitates various tasks such as crop and weed segmentation, plant panoptic segmentation, and leaf instance segmentation, all aimed at addressing challenges in agriculture. Exploring the application of panoptic segmentation in agriculture, the 8th Workshop on Computer Vision in Plant Phenotyping and Agriculture (CVPPA) hosted the challenge of hierarchical panoptic segmentation of crops and weeds using the PhenoBench dataset. To tackle the tasks presented in this competition, we propose an approach that combines the effectiveness of the Segment AnyThing Model (SAM) for instance segmentation with prompt input from object detection models. Specifically, we integrated two notable approaches in object detection, namely DINO and YOLO-v8. Our best-performing model achieved a PQ+ score of 81.33 based on the evaluation metrics of the competition.


title: Seeing Is Not Always Believing: Invisible Collision Attack and Defence on Pre-Trained Models

abstract: Large-scale pre-trained models (PTMs) such as BERT and GPT have achieved great success in diverse fields. The typical paradigm is to pre-train a big deep learning model on large-scale data sets, and then fine-tune the model on small task-specific data sets for downstream tasks. Although PTMs have rapidly progressed with wide real-world applications, they also pose significant risks of potential attacks. Existing backdoor attacks or data poisoning methods often build up the assumption that the attacker invades the computers of victims or accesses the target data, which is challenging in real-world scenarios. In this paper, we propose a novel framework for an invisible attack on PTMs with enhanced MD5 collision. The key idea is to generate two equal-size models with the same MD5 checksum by leveraging the MD5 chosen-prefix collision. Afterwards, the two ``same" models will be deployed on public websites to induce victims to download the poisoned model. Unlike conventional attacks on deep learning models, this new attack is flexible, covert, and model-independent. Additionally, we propose a simple defensive strategy for recognizing the MD5 chosen-prefix collision and provide a theoretical justification for its feasibility. We extensively validate the effectiveness and stealthiness of our proposed attack and defensive method on different models and data sets.


title: Thermodynamics of Markovian Open Quantum Systems with Application to Lasers

abstract: Goran Lindblad was one of the pioneers of what is called now Quantum Thermodynamics. From this vast and rapidly developing field we have selected a sample of results concerning quantum open systems described by Markovian Master Equations of the Lindblad (Gorini-Kossakowski-Sudarshan) type, which are applied to models of lasers. One can study their thermodynamics using the properties of quantum relative entropy, also introduced by Lindblad.


title: CDF II W-mass anomaly and SO(10) GUT

abstract: The W-mass anomaly has yet to be established, but a huge proliferation of articles on the subject established the rich potential of such event. We investigate the SO(10) GUT constraints from the recently reported W-mass anomaly. We consider both Supersymmetric (SUSY) and non-supersymmetric (non-SUSY) grand unified theories by studying renormalization group equations (RGEs) for gauge coupling unification and their predictions on proton decay. In the non-SUSY models, single-stage unification is possible if one include a light (around TeV) real triplet Higgs scalar. However, these models predict speedy proton decay, inconsistent with the present experimental bound on the proton decay. This situation may be improved by including newer scalars and new intermediate-mass scales, which are present in the $SO(10)$ GUTs. The standard model is extended to a left-right symmetric model (LR), and the scale of LR breaking naturally introduces the intermediate scale in the model. A single-stage unification is possible even without including any triplet Higgs scalar in a minimal supersymmetric standard model.


title: Solvable difference equations similar to the Newton-Raphson iteration for algebraic equations

abstract: It is known that difference equations generated as the Newton-Raphson iteration for quadratic equations are solvable in closed form, and the solution can be constructed from linear three-term recurrence relations with constant coefficients. We show that the same construction for four-term recurrence relations gives the solution to the initial value problem of difference equations similar to the Newton-Raphson iteration for cubic equations. In many cases, the solution converges to a root of the cubic equation and the convergence rate is quadratic.


title: Strangelets formation in high energy heavy-ion collisions

abstract: The properties of phase diagram of strange quark matter in equilibrium with hadronic matter at finite temperature are studied, where the quark phase and hadron phase are treated by baryon density-dependent quark mass model and hadron resonance gas model with hard core repulsion factor, respectively. The thermodynamic conditions for the formation of metastable strange quark droplets ("strangelets") in relativistic nuclear collisions are discussed. We obtained a rich structure of the phase diagram at finite temperature, and study the dynamical trajectories of an expanding strange fireball. Our results indicate that the strangeness fraction fs, perturbation parameter C, and confinement parameter D have strong influence on the properties of phase diagram and the formation of strangelets. Consider the isentropic expansion process, we found that the initial entropy per baryon is less than or equal to 5, which gives a large probability for the formation of strangelets. Furthermore, a sufficiently large strangeness fraction fs and one-gluon-exchange interaction and sufficiently small confinement interaction create possibilities for the formation of strangelets. On the contrary, the fireball will always complete the hadronization process when fs=0 or C>=0 or D^{1/2}>=170 MeV.


title: Solving Low-Dose CT Reconstruction via GAN with Local Coherence

abstract: The Computed Tomography (CT) for diagnosis of lesions in human internal organs is one of the most fundamental topics in medical imaging. Low-dose CT, which offers reduced radiation exposure, is preferred over standard-dose CT, and therefore its reconstruction approaches have been extensively studied. However, current low-dose CT reconstruction techniques mainly rely on model-based methods or deep-learning-based techniques, which often ignore the coherence and smoothness for sequential CT slices. To address this issue, we propose a novel approach using generative adversarial networks (GANs) with enhanced local coherence. The proposed method can capture the local coherence of adjacent images by optical flow, which yields significant improvements in the precision and stability of the constructed images. We evaluate our proposed method on real datasets and the experimental results suggest that it can outperform existing state-of-the-art reconstruction approaches significantly.


title: Identification of Ghost Targets for Automotive Radar in the Presence of Multipath

abstract: Colocated multiple-input multiple-output (MIMO) technology has been widely used in automotive radars as it provides accurate angular estimation of the objects with relatively small number of transmitting and receiving antennas. Since the Direction Of Departure (DOD) and the Direction Of Arrival (DOA) of line-of-sight targets coincide, MIMO signal processing allows forming a larger virtual array for angle finding. However, multiple paths impinging the receiver is a major limiting factor, in that radar signals may bounce off obstacles, creating echoes for which the DOD does not equal the DOA. Thus, in complex scenarios with multiple scatterers, the direct paths of the intended targets may be corrupted by indirect paths from other objects, which leads to inaccurate angle estimation or ghost targets. In this paper, we focus on detecting the presence of ghosts due to multipath by regarding it as the problem of deciding between a composite hypothesis, ${\cal H}_0$ say, that the observations only contain an unknown number of direct paths sharing the same (unknown) DOD's and DOA's, and a composite alternative, ${\cal H}_1$ say, that the observations also contain an unknown number of indirect paths, for which DOD's and DOA's do not coincide. We exploit the Generalized Likelihood Ratio Test (GLRT) philosophy to determine the detector structure, wherein the unknown parameters are replaced by carefully designed estimators. The angles of both the active direct paths and of the multi-paths are indeed estimated through a sparsity-enforced Compressed Sensing (CS) approach with Levenberg-Marquardt (LM) optimization to estimate the angular parameters in the continuous domain. An extensive performance analysis is finally offered in order to validate the proposed solution.


title: Task-Oriented Dexterous Hand Pose Synthesis Using Differentiable Grasp Wrench Boundary Estimator

abstract: This work tackles the problem of task-oriented dexterous hand pose synthesis, which involves generating a static hand pose capable of applying a task-specific set of wrenches to manipulate objects. Unlike previous approaches that focus solely on force-closure grasps, which are unsuitable for non-prehensile manipulation tasks (\textit{e.g.}, turning a knob or pressing a button), we introduce a unified framework covering force-closure grasps, non-force-closure grasps, and a variety of non-prehensile poses. Our key idea is a novel optimization objective quantifying the disparity between the Task Wrench Space (TWS, the desired wrenches predefined as a task prior) and the Grasp Wrench Space (GWS, the achievable wrenches computed from the current hand pose). By minimizing this objective, gradient-based optimization algorithms can synthesize task-oriented hand poses without additional human demonstrations. Our specific contributions include 1) a fast, accurate, and differentiable technique for estimating the GWS boundary; 2) a task-oriented objective function based on the disparity between the estimated GWS boundary and the provided TWS boundary; and 3) an efficient implementation of the synthesis pipeline that leverages CUDA accelerations and supports large-scale paralleling. Experimental results on 10 diverse tasks demonstrate a 72.6\% success rate in simulation. Furthermore, real-world validation for 4 tasks confirms the effectiveness of synthesized poses for manipulation. Notably, despite being primarily tailored for task-oriented hand pose synthesis, our pipeline can generate force-closure grasps 50 times faster than DexGraspNet while maintaining comparable grasp quality. Project page: https://pku-epic.github.io/TaskDexGrasp/.


title: Benchmarking Encoder-Decoder Architectures for Biplanar X-ray to 3D Shape Reconstruction

abstract: Various deep learning models have been proposed for 3D bone shape reconstruction from two orthogonal (biplanar) X-ray images. However, it is unclear how these models compare against each other since they are evaluated on different anatomy, cohort and (often privately held) datasets. Moreover, the impact of the commonly optimized image-based segmentation metrics such as dice score on the estimation of clinical parameters relevant in 2D-3D bone shape reconstruction is not well known. To move closer toward clinical translation, we propose a benchmarking framework that evaluates tasks relevant to real-world clinical scenarios, including reconstruction of fractured bones, bones with implants, robustness to population shift, and error in estimating clinical parameters. Our open-source platform provides reference implementations of 8 models (many of whose implementations were not publicly available), APIs to easily collect and preprocess 6 public datasets, and the implementation of automatic clinical parameter and landmark extraction methods. We present an extensive evaluation of 8 2D-3D models on equal footing using 6 public datasets comprising images for four different anatomies. Our results show that attention-based methods that capture global spatial relationships tend to perform better across all anatomies and datasets; performance on clinically relevant subgroups may be overestimated without disaggregated reporting; ribs are substantially more difficult to reconstruct compared to femur, hip and spine; and the dice score improvement does not always bring a corresponding improvement in the automatic estimation of clinically relevant parameters.


title: A new class of partial orders

abstract: Let $R$ be a unital $*$-ring. For any $a,w,b\in R$, we apply the defined $w$-core inverse to define a new class of partial orders in $R$, called the $w$-core partial order. Suppose $a,b\in R$ are $w$-core invertible. We say that $a$ is below $b$ under the $w$-core partial order, denoted by $a\overset{\tiny{\textcircled{\#}}}\leq_w b$, if $a_w^{\tiny{\textcircled{\#}}} a=a_w^{\tiny{\textcircled{\#}}} b$ and $awa_w^{\tiny{\textcircled{\#}}} =bwa_w^{\tiny{\textcircled{\#}}}$, where $a_w^{\tiny{\textcircled{\#}}}$ denotes the $w$-core inverse of $a$. Characterizations of the $w$-core partial order are given. Also, the relationships with several types of partial orders are considered. In particular, we show that the core partial order coincides with the $a$-core partial order, and the star partial order coincides with the $a^*$-core partial order.


title: Planets around evolved intermediate-mass stars III. Planet candidates and long-term activity signals in six open clusters

abstract: [abridged]The aim of this work is to search for planets around evolved stars, with a special focus on stars more massive than 2\,M$_\odot$ in light of previous findings that show a drop in planet occurrence around stars above this mass. We used \texttt{kima} to find the Keplerian orbits most capable of explaining the periodic signals observed in RV data. We also studied the variation of stellar activity indicators and photometry in order to discard stellar signals mimicking the presence of planets. We present a planet candidate in the open cluster NGC3680 that orbits the 1.64\,M$_\odot$ star No. 41. The planet has a minimum mass of 5.13M\,$_{J}$ and a period of 1155 days. We also present periodic and large-amplitude RV signals of probable stellar origin in two more massive stars (5.84 and 3.05\,M$_\odot$ in the clusters NGC2345 and NGC3532). Finally, using new data, we revise the RV signals of the three stars analysed in our previous paper. We confirm the stellar origin of the signals observed in NGC2423 No. 3 and NGC4349 No. 127. On the other hand, the new data collected for IC4651 No. 9122 (1.79\,M$_\odot$) seem to support the presence of a bona fide planet of 6.22M\,$_{J}$ at a period of 744 days, although more data will be needed to discard a possible correlation with the CCF-FWHM. The targets presented in this work showcase the difficulties in interpreting RV data for evolved massive stars. The use of several activity indicators (CCF-FWHM, CCF-BIS, \ha), photometry, and long-term observations (covering several orbital and stellar rotational periods) is required to discern the true nature of the signals. However, in some cases, all this information is insufficient, and the inclusion of additional data -- such as the determination of magnetic field variability or RV points in the near-infrared -- will be necessary to identify the nature of the discovered signals.


title: Rational approximation with chosen numerators

abstract: We consider the problem of approaching real numbers with rational numbers with prime denominator and with a single numerator allowed for each denominator. We then present a simple application, related to possible correlations between trace functions and dynamical sequences.


title: Robust Distributed Learning: Tight Error Bounds and Breakdown Point under Data Heterogeneity

abstract: The theory underlying robust distributed learning algorithms, designed to resist adversarial machines, matches empirical observations when data is homogeneous. Under data heterogeneity however, which is the norm in practical scenarios, established lower bounds on the learning error are essentially vacuous and greatly mismatch empirical observations. This is because the heterogeneity model considered is too restrictive and does not cover basic learning tasks such as least-squares regression. We consider in this paper a more realistic heterogeneity model, namely (G,B)-gradient dissimilarity, and show that it covers a larger class of learning problems than existing theory. Notably, we show that the breakdown point under heterogeneity is lower than the classical fraction 1/2. We also prove a new lower bound on the learning error of any distributed learning algorithm. We derive a matching upper bound for a robust variant of distributed gradient descent, and empirically show that our analysis reduces the gap between theory and practice.


title: Time-Optimal Control Studies for Additional Food provided Prey-Predator Systems involving Holling Type-III and Holling Type-IV Functional Responses

abstract: In recent years, time-optimal control studies on additional food provided prey-predator systems have gained significant attention from researchers in the field of mathematical biology. In this study, we initially consider an additional food provided prey-predator model exhibiting Holling type-III functional response and the intra-specific competition among predators. We prove the existence and uniqueness of global positive solutions for the proposed model. We do the time optimal control studies with respect quality and quantity of additional food as control variables by transforming the independent variable in the control system. Making use of the Pontraygin maximum principle, we characterize the optimal quality of additional food and optimal quantity of additional food. We show that the findings of these time-optimal control studies on additional food provided prey-predator systems involving Holling type III functional response have the potential to be applied to a variety of problems in pest management. In the later half of this study, we consider an additional food provided prey-predator model exhibiting Holling type-IV functional response and study the above aspects for this system.


title: Self-Tuning Hamiltonian Monte Carlo for Accelerated Sampling

abstract: The performance of Hamiltonian Monte Carlo simulations crucially depends on both the integration timestep and the number of integration steps. We present an adaptive general-purpose framework to automatically tune such parameters, based on a local loss function which promotes the fast exploration of phase-space. We show that a good correspondence between loss and autocorrelation time can be established, allowing for gradient-based optimization using a fully-differentiable set-up. The loss is constructed in such a way that it also allows for gradient-driven learning of a distribution over the number of integration steps. Our approach is demonstrated for the one-dimensional harmonic oscillator and alanine dipeptide, a small protein common as a test case for simulation methods. Through the application to the harmonic oscillator, we highlight the importance of not using a fixed timestep to avoid a rugged loss surface with many local minima, otherwise trapping the optimization. In the case of alanine dipeptide, by tuning the only free parameter of our loss definition, we find a good correspondence between it and the autocorrelation times, resulting in a $>100$ fold speed up in optimization of simulation parameters compared to a grid-search. For this system, we also extend the integrator to allow for atom-dependent timesteps, providing a further reduction of $25\%$ in autocorrelation times.

categories: physics.comp-ph cond-mat.soft cond-mat.stat-mech cs.LG stat.CO


title: Probing Schwarzschild-like Black Holes in Metric-Affine Bumblebee Gravity with Accretion Disk, Deflection Angle, Greybody Bounds, and Neutrino Propagation

abstract: In this paper, we investigate Schwarzschild-like black holes within the framework of metric-affine bumblebee gravity. We explore the implications of such a gravitational setup on various astrophysical phenomena, including the presence of an accretion disk, the deflection angle of light rays, the establishment of greybody bounds, and the propagation of neutrinos. The metric-affine bumblebee gravity theory offers a unique perspective on gravitational interactions by introducing a vector field that couples to spacetime curvature. We analyze the behavior of accretion disks around Schwarzschild-like black holes in this modified gravity scenario, considering the effects of the bumblebee field on the accretion process. Furthermore, we scrutinize the deflection angle of light rays as they traverse the gravitational field, highlighting potential deviations from standard predictions due to the underlying metric-affine structure. Investigating greybody bounds in this context sheds light on the thermal radiation emitted by black holes and how the modified gravity framework influences this phenomenon. Moreover, we explore neutrino propagation around Schwarzschild-like black holes within metric-affine bumblebee gravity, examining alterations in neutrino trajectories and interactions compared to conventional general relativity. By comprehensively probing these aspects, we aim to unravel the distinctive features and consequences of Schwarzschild-like black holes in the context of metric-affine bumblebee gravity, offering new insights into the nature of gravitational interactions and their observable signatures.


title: Shape Optimization by Constrained First-Order Least Mean Approximation

abstract: In this work, the problem of shape optimization, subject to PDE constraints, is reformulated as an $L^p$ best approximation problem under divergence constraints to the shape tensor introduced in Laurain and Sturm: ESAIM Math. Model. Numer. Anal. 50 (2016). More precisely, the main result of this paper states that the $L^p$ distance of the above approximation problem is equal to the dual norm of the shape derivative considered as a functional on $W^{1,p^\ast}$ (where $1/p + 1/p^\ast = 1$). This implies that for any given shape, one can evaluate its distance from being a stationary one with respect to the shape derivative by simply solving the associated $L^p$-type least mean approximation problem. Moreover, the Lagrange multiplier for the divergence constraint turns out to be the shape deformation of steepest descent. This provides a way, as an alternative to the approach by Deckelnick, Herbert and Hinze: ESAIM Control Optim. Calc. Var. 28 (2022), for computing shape gradients in $W^{1,p^\ast}$ for $p^\ast \in ( 2 , \infty )$. The discretization of the least mean approximation problem is done with (lowest-order) matrix-valued Raviart-Thomas finite element spaces leading to piecewise constant approximations of the shape deformation acting as Lagrange multiplier. Admissible deformations in $W^{1,p^\ast}$ to be used in a shape gradient iteration are reconstructed locally. Our computational results confirm that the $L^p$ distance of the best approximation does indeed measure the distance of the considered shape to optimality. Also confirmed by our computational tests are the observations that choosing $p^\ast$ (much) larger than 2 (which means that $p$ must be close to 1 in our best approximation problem) decreases the chance of encountering mesh degeneracy during the shape gradient iteration.


title: Advancements in 3D Lane Detection Using LiDAR Point Clouds: From Data Collection to Model Development

abstract: Advanced Driver-Assistance Systems (ADAS) have successfully integrated learning-based techniques into vehicle perception and decision-making. However, their application in 3D lane detection for effective driving environment perception is hindered by the lack of comprehensive LiDAR datasets. The sparse nature of LiDAR point cloud data prevents an efficient manual annotation process. To solve this problem, we present LiSV-3DLane, a large-scale 3D lane dataset that comprises 20k frames of surround-view LiDAR point clouds with enriched semantic annotation. Unlike existing datasets confined to a frontal perspective, LiSV-3DLane provides a full 360-degree spatial panorama around the ego vehicle, capturing complex lane patterns in both urban and highway environments. We leverage the geometric traits of lane lines and the intrinsic spatial attributes of LiDAR data to design a simple yet effective automatic annotation pipeline for generating finer lane labels. To propel future research, we propose a novel LiDAR-based 3D lane detection model, LiLaDet, incorporating the spatial geometry learning of the LiDAR point cloud into Bird's Eye View (BEV) based lane identification. Experimental results indicate that LiLaDet outperforms existing camera- and LiDAR-based approaches in the 3D lane detection task on the K-Lane dataset and our LiSV-3DLane.


title: On the Kolmogorov equation associated with Volterra equations and Fractional Brownian Motion

abstract: We consider a Volterra convolution equation in $\mathbb{R}^d$ perturbed with an additive fractional Brownian motion of Riemann-Liouville type with Hurst parameter $H\in (0,1)$. We show that its solution solves a stochastic partial differential equation (SPDE) in the Hilbert space of square-integrable functions. Such an equation motivates our study of an unconventional class of SPDEs requiring an original extension of the drift operator and its Fr\'echet differentials. We prove that these SPDEs generate a Markov stochastic flow which is twice Fr\'echet differentiable with respect to the initial data. This stochastic flow is then employed to solve, in the classical sense of infinite dimensional calculus, the path-dependent Kolmogorov equation corresponding to the SPDEs. In particular, we associate a time-dependent infinitesimal generator with the fractional Brownian motion. In the final section, we show some obstructions in the analysis of the mild formulation of the Kolmogorov equation for SPDEs driven by the same infinite dimensional noise. This problem, which is relevant to the theory of regularization-by-noise, remains open for future research.


title: On the Posterior Distribution in Denoising: Application to Uncertainty Quantification

abstract: Denoisers play a central role in many applications, from noise suppression in low-grade imaging sensors, to empowering score-based generative models. The latter category of methods makes use of Tweedie's formula, which links the posterior mean in Gaussian denoising (\ie the minimum MSE denoiser) with the score of the data distribution. Here, we derive a fundamental relation between the higher-order central moments of the posterior distribution, and the higher-order derivatives of the posterior mean. We harness this result for uncertainty quantification of pre-trained denoisers. Particularly, we show how to efficiently compute the principal components of the posterior distribution for any desired region of an image, as well as to approximate the full marginal distribution along those (or any other) one-dimensional directions. Our method is fast and memory-efficient, as it does not explicitly compute or store the high-order moment tensors and it requires no training or fine tuning of the denoiser. Code and examples are available on the project webpage in https://hilamanor.github.io/GaussianDenoisingPosterior/ .


title: From Cluster Assumption to Graph Convolution: Graph-based Semi-Supervised Learning Revisited

abstract: Graph-based semi-supervised learning (GSSL) has long been a hot research topic. Traditional methods are generally shallow learners, based on the cluster assumption. Recently, graph convolutional networks (GCNs) have become the predominant techniques for their promising performance. In this paper, we theoretically discuss the relationship between these two types of methods in a unified optimization framework. One of the most intriguing findings is that, unlike traditional ones, typical GCNs may not jointly consider the graph structure and label information at each layer. Motivated by this, we further propose three simple but powerful graph convolution methods. The first is a supervised method OGC which guides the graph convolution process with labels. The others are two unsupervised methods: GGC and its multi-scale version GGCM, both aiming to preserve the graph structure information during the convolution process. Finally, we conduct extensive experiments to show the effectiveness of our methods.


title: Multi-Dimensional Hyena for Spatial Inductive Bias

abstract: In recent years, Vision Transformers have attracted increasing interest from computer vision researchers. However, the advantage of these transformers over CNNs is only fully manifested when trained over a large dataset, mainly due to the reduced inductive bias towards spatial locality within the transformer's self-attention mechanism. In this work, we present a data-efficient vision transformer that does not rely on self-attention. Instead, it employs a novel generalization to multiple axes of the very recent Hyena layer. We propose several alternative approaches for obtaining this generalization and delve into their unique distinctions and considerations from both empirical and theoretical perspectives. Our empirical findings indicate that the proposed Hyena N-D layer boosts the performance of various Vision Transformer architectures, such as ViT, Swin, and DeiT across multiple datasets. Furthermore, in the small dataset regime, our Hyena-based ViT is favorable to ViT variants from the recent literature that are specifically designed for solving the same challenge, i.e., working with small datasets or incorporating image-specific inductive bias into the self-attention mechanism. Finally, we show that a hybrid approach that is based on Hyena N-D for the first layers in ViT, followed by layers that incorporate conventional attention, consistently boosts the performance of various vision transformer architectures.


title: FaceAtt: Enhancing Image Captioning with Facial Attributes for Portrait Images

abstract: Automated image caption generation is a critical area of research that enhances accessibility and understanding of visual content for diverse audiences. In this study, we propose the FaceAtt model, a novel approach to attribute-focused image captioning that emphasizes the accurate depiction of facial attributes within images. FaceAtt automatically detects and describes a wide range of attributes, including emotions, expressions, pointed noses, fair skin tones, hair textures, attractiveness, and approximate age ranges. Leveraging deep learning techniques, we explore the impact of different image feature extraction methods on caption quality and evaluate our model's performance using metrics such as BLEU and METEOR. Our FaceAtt model leverages annotated attributes of portraits as supplementary prior knowledge for our portrait images before captioning. This innovative addition yields a subtle yet discernible enhancement in the resulting scores, exemplifying the potency of incorporating additional attribute vectors during training. Furthermore, our research contributes to the broader discourse on ethical considerations in automated captioning. This study sets the stage for future research in refining attribute-focused captioning techniques, with a focus on enhancing linguistic coherence, addressing biases, and accommodating diverse user needs.


title: 6G Positioning and Sensing Through the Lens of Sustainability, Inclusiveness, and Trustworthiness

abstract: 6G promises a paradigm shift in which positioning and sensing are inherently integrated, enhancing not only the communication performance but also enabling location- and context-aware services. Historically, positioning and sensing have been viewed through the lens of cost and performance trade-offs, implying an escalated demand for resources, such as radio, physical, and computational resources, for improved performance. However, 6G goes beyond this traditional perspective to encompass a set of broader values, namely sustainability, inclusiveness, and trustworthiness. From a joint industrial/academic perspective, this paper aims to shed light on these important value indicators and their relationship with the conventional key performance indicators in the context of positioning and sensing.


title: The Eshelby problem in amorphous solids

abstract: The ``Eshelby problem" refers to the response of a 2-dimensional elastic sheet to cutting away a circle, deforming it into an ellipse, and pushing it back. The resulting response is dominated by the so-called ``Eshelby Kernel" which was derived for purely elastic (infinite) material, but has been employed extensively to model the redistribution of stress after plastic events in amorphous solids with finite boundaries. Here we discuss and solve the Eshelby problem directly for amorphous solids, taking into account possible screening effects and realistic boundary conditions. We find major modifications compared to the classical Eshelby solution. These modification are needed for modeling correctly the spatial responses to plastic events in amorphous solids.

categories: cond-mat.mtrl-sci cond-mat.dis-nn cond-mat.soft cond-mat.stat-mech


title: Distribution-Aware Continual Test-Time Adaptation for Semantic Segmentation

abstract: Since autonomous driving systems usually face dynamic and ever-changing environments, continual test-time adaptation (CTTA) has been proposed as a strategy for transferring deployed models to continually changing target domains. However, the pursuit of long-term adaptation often introduces catastrophic forgetting and error accumulation problems, which impede the practical implementation of CTTA in the real world. Recently, existing CTTA methods mainly focus on utilizing a majority of parameters to fit target domain knowledge through self-training. Unfortunately, these approaches often amplify the challenge of error accumulation due to noisy pseudo-labels, and pose practical limitations stemming from the heavy computational costs associated with entire model updates. In this paper, we propose a distribution-aware tuning (DAT) method to make the semantic segmentation CTTA efficient and practical in real-world applications. DAT adaptively selects and updates two small groups of trainable parameters based on data distribution during the continual adaptation process, including domain-specific parameters (DSP) and task-relevant parameters (TRP). Specifically, DSP exhibits sensitivity to outputs with substantial distribution shifts, effectively mitigating the problem of error accumulation. In contrast, TRP are allocated to positions that are responsive to outputs with minor distribution shifts, which are fine-tuned to avoid the catastrophic forgetting problem. In addition, since CTTA is a temporal task, we introduce the Parameter Accumulation Update (PAU) strategy to collect the updated DSP and TRP in target domain sequences. We conduct extensive experiments on two widely-used semantic segmentation CTTA benchmarks, achieving promising performance compared to previous state-of-the-art methods.


title: Efficient Black-Box Speaker Verification Model Adaptation with Reprogramming and Backend Learning

abstract: The development of deep neural networks (DNN) has significantly enhanced the performance of speaker verification (SV) systems in recent years. However, a critical issue that persists when applying DNN-based SV systems in practical applications is domain mismatch. To mitigate the performance degradation caused by the mismatch, domain adaptation becomes necessary. This paper introduces an approach to adapt DNN-based SV models by manipulating the learnable model inputs, inspired by the concept of adversarial reprogramming. The pre-trained SV model remains fixed and functions solely in the forward process, resembling a black-box model. A lightweight network is utilized to estimate the gradients for the learnable parameters at the input, which bypasses the gradient backpropagation through the black-box model. The reprogrammed output is processed by a two-layer backend learning module as the final adapted speaker embedding. The number of parameters involved in the gradient calculation is small in our design. With few additional parameters, the proposed method achieves both memory and parameter efficiency. The experiments are conducted in language mismatch scenarios. Using much less computation cost, the proposed method obtains close or superior performance to the fully finetuned models in our experiments, which demonstrates its effectiveness.