title: OpenObj: Open-Vocabulary Object-Level Neural Radiance Fields with Fine-Grained Understanding

abstract: In recent years, there has been a surge of interest in open-vocabulary 3D scene reconstruction facilitated by visual language models (VLMs), which showcase remarkable capabilities in open-set retrieval. However, existing methods face some limitations: they either focus on learning point-wise features, resulting in blurry semantic understanding, or solely tackle object-level reconstruction, thereby overlooking the intricate details of the object's interior. To address these challenges, we introduce OpenObj, an innovative approach to build open-vocabulary object-level Neural Radiance Fields (NeRF) with fine-grained understanding. In essence, OpenObj establishes a robust framework for efficient and watertight scene modeling and comprehension at the object-level. Moreover, we incorporate part-level features into the neural fields, enabling a nuanced representation of object interiors. This approach captures object-level instances while maintaining a fine-grained understanding. The results on multiple datasets demonstrate that OpenObj achieves superior performance in zero-shot semantic segmentation and retrieval tasks. Additionally, OpenObj supports real-world robotics tasks at multiple scales, including global movement and local manipulation.


title: A Self-boosted Framework for Calibrated Ranking

abstract: Scale-calibrated ranking systems are ubiquitous in real-world applications nowadays, which pursue accurate ranking quality and calibrated probabilistic predictions simultaneously. For instance, in the advertising ranking system, the predicted click-through rate (CTR) is utilized for ranking and required to be calibrated for the downstream cost-per-click ads bidding. Recently, multi-objective based methods have been wildly adopted as a standard approach for Calibrated Ranking, which incorporates the combination of two loss functions: a pointwise loss that focuses on calibrated absolute values and a ranking loss that emphasizes relative orderings. However, when applied to industrial online applications, existing multi-objective CR approaches still suffer from two crucial limitations. First, previous methods need to aggregate the full candidate list within a single mini-batch to compute the ranking loss. Such aggregation strategy violates extensive data shuffling which has long been proven beneficial for preventing overfitting, and thus degrades the training effectiveness. Second, existing multi-objective methods apply the two inherently conflicting loss functions on a single probabilistic prediction, which results in a sub-optimal trade-off between calibration and ranking. To tackle the two limitations, we propose a Self-Boosted framework for Calibrated Ranking (SBCR).


title: Growth of VO2-ZnS Thin Film Cavity for Adaptive Thermal Emission

abstract: Low-weight, passive, thermal-adaptive radiation technologies are needed to maintain an operable temperature for spacecraft while they experience various energy fluxes. In this study, we used a thin-film coating with the Fabry-Perot (FP) effect to enhance emissivity contrast ({\Delta}{\epsilon}) between VO2 phase-change states. This coating utilizes a novel hybrid material architecture that combines VO2 with a mid- and long-wave infrared transparent chalcogenide, zinc sulfide (ZnS), as a cavity spacer layer. We simulated the design parameter space to obtain a theoretical maximum {\Delta}{\epsilon} of 0.63 and grew prototype devices. Using X-ray diffraction, Raman spectroscopy, and Fourier Transform Infrared (FTIR) Spectroscopy, we determined that an intermediate buffer layer of TiO2 is necessary to execute the crystalline growth of monoclinic VO2 on ZnS. Through temperature-dependent FTIR spectroscopy measurements, our fabricated devices demonstrated FP-cavity enhanced adaptive thermal emittance.


title: Interaction of an outflow with surrounding gaseous clouds as the origin of the late-time radio flares in TDEs

abstract: Close encounter between a star and a supermassive black hole (SMBH) results in the tidal disruption of the star, known as a tidal disruption event (TDE). Recently, a few TDEs, e.g., ASASSN-15oi and AT2018hyz, have shown late-time (hundreds of days after their UV/optical peaks) radio flares with radio luminosities of $10^{38\sim39}$ erg/s. The super-Eddington fallback or accretion in a TDE may generate a mass outflow. Here we investigate a scenario that the late-time radio flares come from the interaction of the outflow with the circum-nuclear gaseous clouds, in addition to the slow-evolving emission component due to the outflow-diffuse medium interaction. We calculate the associated radio temporal and spectral signatures and find that they reproduce well the observations. The outflows have the inferred velocity of 0.2$\sim0.8$ c, the total mass of $10^{-3}\sim10^{-1}$ $\mathrm{M_{\odot}}$ and the ejection duration of a month to a year. The distances of the clouds to the SMBH are $0.1\sim1$ pc. This scenario has advantages in explaining the long delay, sharpness of the rise and the multiplicity of the late radio flares. Future observations may build up a much larger sample of late-time radio flares and enable their use as a probe of the TDE physics and the host circumnuclear environment.


title: Deep reinforcement learning with positional context for intraday trading

abstract: Deep reinforcement learning (DRL) is a well-suited approach to financial decision-making, where an agent makes decisions based on its trading strategy developed from market observations. Existing DRL intraday trading strategies mainly use price-based features to construct the state space. They neglect the contextual information related to the position of the strategy, which is an important aspect given the sequential nature of intraday trading. In this study, we propose a novel DRL model for intraday trading that introduces positional features encapsulating the contextual information into its sparse state space. The model is evaluated over an extended period of almost a decade and across various assets including commodities and foreign exchange securities, taking transaction costs into account. The results show a notable performance in terms of profitability and risk-adjusted metrics. The feature importance results show that each feature incorporating contextual information contributes to the overall performance of the model. Additionally, through an exploration of the agent's intraday trading activity, we unveil patterns that substantiate the effectiveness of our proposed model.


title: Robust intensification of global ocean Eddy Kinetic Energy from three decades of satellite altimetry observations

abstract: Ocean mesoscale variability, a key component of the climate system, influences ocean circulation and heat, gas, carbon and nutrient distribution. Trends on Eddy Kinetic Energy (EKE), a metric measuring its intensity, are investigated using two products constructed from 30 years of altimetric observations. Statistically significant positive trends in globally-averaged EKE reveal a strengthening of 1-3% per decade. Regions of intense mesoscale activity become more energetic than other areas. Robust positive EKE trends are observed in the Kuroshio Extension and the Gulf Stream, with remarkable EKE increases of ~50% and ~20%, respectively, over the last decade. Our study opens a new question into how the observed Gulf Stream strengthening impacts the AMOC, and challenges existing climate models emphasizing the necessity for improved small-scale ocean process representation.


title: Highly agile flat swimming robot

abstract: Exploring bodies of water on their surface allows robots to efficiently communicate and harvest energy from the sun. On the water surface, however, robots often face highly unstructured environments, cluttered with plant matter, animals, and debris. We report a fast (5.1 cm/s translation and 195 {\deg}/s rotation), centimeter-scale swimming robot with high maneuverability and autonomous untethered operation. Locomotion is enabled by a pair of soft, millimeter-thin, undulating pectoral fins, in which traveling waves are electrically excited to generate propulsion. The robots navigate through narrow spaces, through grassy plants, and push objects weighing over 16x their body weight. Such robots can allow distributed environmental monitoring as well as continuous measurement of plant and water parameters for aqua-farming.


title: Studying $\pi^+\pi^-$ photoproduction beyond Pomeron exchange

abstract: Forward photoproduction of $\pi^+\pi^-$ pairs with invariant mass of the order of $m_\rho\sim 770$ MeV is traditionally understood to be produced via Pomeron exchange. Based on a detailed analysis of the CLAS photoproduction data, it is shown that the dynamics of two-pion photoproduction for $|t|\gtrsim 0.5$ GeV$^2$ cannot be explained by Pomeron exchange alone. This motivates the development of a new theoretical model of two-pion photoproduction which incorporates both two-pion and pion-nucleon resonant contributions. After fitting free parameters, the model provides an excellent description of the low moments of the angular distribution measured at CLAS, and enables an assessment of the relative contributions of particular production mechanisms and an interpretation of the various features of the data in terms of these mechanisms.


title: The defect of weak approximation for a reductive group over a global field

abstract: Using ideas of Sansuc and of Colliot-Th\'el\`ene and a result of Tate, we compute the defect of weak approximation for a reductive group G over a global field K in terms of the algebraic fundamental group of G.


title: SHACL2FOL: An FOL Toolkit for SHACL Decision Problems

abstract: Recent studies on the Shapes Constraint Language (SHACL), a W3C specification for validating RDF graphs, rely on translating the language into first-order logic in order to provide formally-grounded solutions to the validation, containment and satisfiability decision problems. Continuing on this line of research, we introduce SHACL2FOL, the first automatic tool that (i) translates SHACL documents into FOL sentences and (ii) computes the answer to the two static analysis problems of satisfiability and containment; it also allow to test the validity of a graph with respect to a set of constraints. By integrating with existing theorem provers, such as E and Vampire, the tool computes the answer to the aforementioned decision problems and outputs the corresponding first-order logic theories in the standard TPTP format. We believe this tool can contribute to further theoretical studies of SHACL, by providing an automatic first-order logic interpretation of its semantics, while also benefiting SHACL practitioners, by supplying static analysis capabilities to help the creation and management of SHACL constraints.


title: Assessing Extreme Risk using Stochastic Simulation of Extremes

abstract: Risk management is particularly concerned with extreme events, but analysing these events is often hindered by the scarcity of data, especially in a multivariate context. This data scarcity complicates risk management efforts. Various tools can assess the risk posed by extreme events, even under extraordinary circumstances. This paper studies the evaluation of univariate risk for a given risk factor using metrics that account for its asymptotic dependence on other risk factors. Data availability is crucial, particularly for extreme events where it is often limited by the nature of the phenomenon itself, making estimation challenging. To address this issue, two non-parametric simulation algorithms based on multivariate extreme theory are developed. These algorithms aim to extend a sample of extremes jointly and conditionally for asymptotically dependent variables using stochastic simulation and multivariate Generalised Pareto Distributions. The approach is illustrated with numerical analyses of both simulated and real data to assess the accuracy of extreme risk metric estimations.


title: Generalizable Disaster Damage Assessment via Change Detection with Vision Foundation Model

abstract: The increasing frequency and intensity of natural disasters demand more sophisticated approaches for rapid and precise damage assessment. To tackle this issue, researchers have developed various methods on disaster benchmark datasets from satellite imagery to aid in detecting disaster damage. However, the diverse nature of geographical landscapes and disasters makes it challenging to apply existing methods to regions unseen during training. We present DAVI (Disaster Assessment with VIsion foundation model), which overcomes domain disparities and detects structural damage (e.g., building) without requiring ground-truth labels of the target region. DAVI integrates task-specific knowledge from a model trained on source regions with an image segmentation foundation model to generate pseudo labels of possible damage in the target region. It then employs a two-stage refinement process, targeting both the pixel and overall image, to more accurately pinpoint changes in disaster-struck areas based on before-and-after images. Comprehensive evaluations demonstrate that DAVI achieves exceptional performance across diverse terrains (e.g., USA and Mexico) and disaster types (e.g., wildfires, hurricanes, and earthquakes). This confirms its robustness in assessing disaster impact without dependence on ground-truth labels.


title: Vacancy-induced pseudo-gap formation in antiferromagnetic Cr$_{0.86}$ZnSb

abstract: Structural defects are important for both solid-state chemistry and physics, as they can have a significant impact on chemical stability and physical properties. Here, we identify a vacancyinduced pseudo-gap formation in antiferromagnetic Cr$_{0.86}$ZnSb. Cr$_{1-x}$ZnSb alloys were studied combining efforts of density functional theory (DFT) calculations and experimental methods to elucidate the effect of vacancies. Detailed analyses (X-ray powder and single crystal diffraction, transmission and secondary scanning electron microscopy) of Cr$_{1-x}$ZnSb, $0<x<0.20$, prompts Cr$_{0.86}$ZnSb as the only stable compound, crystallizing with the MnAlGe-type structure. From DFT calculations, an antiferromagnetic spin configuration of Cr local magnetic moments was found to be favorable for both, the perfectly stoichiometric compound CrZnSb, as well as for Cr$_{0.875}$ZnSb. Magnetic order is observed experimentally for Cr$_{0.86}$ZnSb by temperature- and field-dependent magnetization measurements, revealing a magnetic phase transition near 220 K, which is corroborated by zero-field muon spin relaxation studies. Thermoelectric transport properties exhibit distinct maxima in the temperature-dependent Seebeck coefficient and electrical resistivity at around 190 K. Analyzing the measured data on the basis of a triple parabolic band model and DFT simulations, their characteristic features are traced back to a pseudo-gap in the electronic structure arising from a particular vacancy arrangement.


title: Null hypothesis Bayes factor estimates can be biased in (some) common factorial designs: A simulation study

abstract: Bayes factor null hypothesis tests provide a viable alternative to frequentist measures of evidence quantification. Bayes factors for realistic interesting models cannot be calculated exactly, but have to be estimated, which involves approximations to complex integrals. Crucially, the accuracy of these estimates, i.e., whether an estimated Bayes factor corresponds to the true Bayes factor, is unknown, and may depend on data, prior, and likelihood. We have recently developed a novel statistical procedure, namely simulation-based calibration (SBC) for Bayes factors, to test for a given analysis, whether the computed Bayes factors are accurate. Here, we use SBC for Bayes factors to test for some common cognitive designs, whether Bayes factors are estimated accurately. We use the bridgesampling/brms packages as well as the BayesFactor package in R. We find that Bayes factor estimates are accurate and exhibit only little bias in Latin square designs with (a) random effects for subjects only and (b) for crossed random effects for subjects and items, but a single fixed-factor. However, Bayes factor estimates turn out biased and liberal in a 2x2 design with crossed random effects for subjects and items. These results suggest that researchers should test for their individual analysis, whether Bayes factor estimates are accurate. Moreover, future research is needed to determine the boundary conditions under which Bayes factor estimates are accurate or biased, as well as software development to improve estimation accuracy.


title: A fractional approach to strain-gradient plasticity: beyond core-radius of discrete dislocations

abstract: We derive a strain-gradient theory for plasticity as the $\Gamma$-limit of discrete dislocation fractional energies, without the introduction of a core-radius. By using the finite horizon fractional gradient introduced by Bellido, Cueto, and Mora-Corral of 2023, we consider a nonlocal model of semi-discrete dislocations, in which the stored elastic energy is computed via the fractional gradient of order $1-\alpha$. As $\alpha$ goes to $0$, we show that suitably rescaled energies $\Gamma$-converge to the macroscopic strain-gradient model of Garroni, Leoni, and Ponsiglione of 2010.


title: Fewer Tokens and Fewer Videos: Extending Video Understanding Abilities in Large Vision-Language Models

abstract: Amidst the advancements in image-based Large Vision-Language Models (image-LVLM), the transition to video-based models (video-LVLM) is hindered by the limited availability of quality video data. This paper addresses the challenge by leveraging the visual commonalities between images and videos to efficiently evolve image-LVLMs into video-LVLMs. We present a cost-effective video-LVLM that enhances model architecture, introduces innovative training strategies, and identifies the most effective types of video instruction data. Our innovative weighted token sampler significantly compresses the visual token numbers of each video frame, effectively cutting computational expenses. We also find that judiciously using just 10% of the video data, compared to prior video-LVLMs, yields impressive results during various training phases. Moreover, we delve into the influence of video instruction data in limited-resource settings, highlighting the significance of incorporating video training data that emphasizes temporal understanding to enhance model performance. The resulting Fewer Tokens and Fewer Videos LVLM (FTFV-LVLM) exhibits exceptional performance across video and image benchmarks, validating our model's design and training approaches.


title: Holstein polarons, Rashba-like spin splitting and Ising superconductivity in electron-doped MoSe2

abstract: Interaction between electrons and phonons in solids is a key effect defining physical properties of materials such as electrical and thermal conductivity. In transitional metal dichalcogenides (TMDCs) the electron-phonon coupling results in the creation of polarons, quasiparticles that manifest themselves as discrete features in the electronic spectral function. In this study, we report the formation of polarons at the alkali dosed MoSe2 surface, where Rashba-like spin splitting of the conduction band states is caused by an inversion-symmetry breaking electric field. In addition, we observe the crossover from phonon-like to plasmon-like polaronic spectral features at MoSe2 surface with increasing doping. Our findings support the concept of electron-phonon coupling mediated superconductivity in electron-doped layered TMDC materials, observed using ionic liquid gating technology. Furthermore, the discovered spin-splitting at the Fermi level could offer crucial experimental validation for theoretical models of Ising-type superconductivity in these materials.


title: Photoproduction in general-purpose event generators

abstract: We present a comparison of three different general-purpose Monte Carlo event generators, Herwig, Pythia, and Sherpa, with respect to the simulation of photoproduction. We outline the default inputs, implementation differences and compare the results at different stages of the event generation. We find that, despite a similar starting point, the final cross sections do have some differences related to different non-perturbative inputs. We compare the simulations with experimental data for jet production in LEP and HERA and find that all generators provide a decent desription of the data within the considered uncertainties. We also present predictions for the upcoming EIC for jet observables and event shapes and conclude that accurate simulations will require further phenomenological advances.


title: Real-time, chirped-pulse heterodyne detection at room-temperature with 100GHz 3dB-bandwidth mid-infrared quantum-well photodetectors

abstract: Thanks to intrinsically short electronic relaxation on the ps time scale, III-V semiconductor unipolar devices are ideal candidates for ultrahigh-speed operation at mid-infrared frequencies. In this work, antenna-coupled, GaAs-based multi quantum-well photodetectors operating in the 10-11um range are demonstrated, with a responsivity of 0.3A/W and a 3dB-cutoff bandwidth of 100GHz at room-temperature. The frequency response is measured up to 220GHz: beyond 100GHz we find a roll-off dominated by the 2.5 ps-long recombination time of the photo-excited electrons. The potential of the detectors is illustrated by setting up an experiment where the time dependent emission frequency of a quantum cascade laser operated in pulsed mode is measured electronically and in real-time, over a frequency range >60GHz. By exploiting broadband electronics, and thanks to its high signal-to-noise ratio, this technique allows the acquisition, in a single-shot, of frequency-calibrated, mid-infrared molecular spectra spanning up to 100GHz and beyond, which is particularly attractive for fast, active remote sensing applications in fields such as environmental or combustion monitoring.


title: Effective Polaron Dynamics of an Impurity Particle Interacting with a Fermi Gas

abstract: We study the quantum dynamics of a homogeneous ideal Fermi gas coupled to an impurity particle on a three-dimensional box with periodic boundary condition. For large Fermi momentum $k_\text{F}$, we prove that the effective dynamics is generated by a Fr\"ohlich-type polaron Hamiltonian, which linearly couples the impurity particle to an almost-bosonic excitation field. Moreover, we prove that the effective dynamics can be approximated by an explicit coupled coherent state. Our method is applicable to two relevant settings: first, an interaction coupling $\lambda=1$ and masses of order 1 for time scales of order $k_\text{F}^{-1}$; second to the case of $\lambda=k_\text{F}^{-1}$ and a heavy Fermi gas with masses of order $k_\text{F}$ for time scales of order 1.


title: Metaverse Identity: Core Principles and Critical Challenges

abstract: This paper explores the core principles that should guide the construction and governance of identity in the metaverse and identifies the critical challenges that need to be addressed. Drawing on multidisciplinary theories and perspectives, we propose two core principles for metaverse identity: \emph{Equivalence and Alignment}, and \emph{Fusion and Expansiveness}. The first principle contends that metaverse identities should be consistent with real-world identities in terms of norms and standards, which is crucial for establishing guidelines and safeguarding rights. The second principle emphasizes the necessity for seamless integration and boundless expansion of metaverse identities, transcending real-world limitations to accommodate diverse needs and foster inclusive participation. We argue that these two principles are vital for ensuring the accountability, inclusiveness, and consistency of identity in the metaverse. We also identify five critical challenges: Identity Interoperability, Legal Implications, Privacy and Identity Management, Deepfakes and Synthetic Identities, and Identity Fragmentation and Psychological Well-being. We discuss potential strategies to navigate these challenges. The paper concludes by underscoring the importance of a proactive and collaborative approach to shaping the future of metaverse identity. As the metaverse continues to evolve, it is imperative that we cultivate a thorough understanding of the principles and challenges surrounding identity in this uncharted territory and work collectively to build a metaverse that fosters responsible identity construction and expression.


title: Fault detection in propulsion motors in the presence of concept drift

abstract: Machine learning and statistical methods can be used to enhance monitoring and fault prediction in marine systems. These methods rely on a dataset with records of historical system behaviour, potentially containing periods of both fault-free and faulty operation. An unexpected change in the underlying system, called a concept drift, may impact the performance of these methods, triggering the need for model retraining or other adaptations. In this article, we present an approach for detecting overheating in stator windings of marine propulsion motors that is able to successfully operate during concept drift without the need for full model retraining. Two distinct approaches are presented and tested. All models are trained and verified using a dataset from operational propulsion motors, with known, sudden concept drifts.


title: Deep Learning for Slum Mapping in Remote Sensing Images: A Meta-analysis and Review

abstract: The major Sustainable Development Goals (SDG) 2030, set by the United Nations Development Program (UNDP), include sustainable cities and communities, no poverty, and reduced inequalities. However, millions of people live in slums or informal settlements with poor living conditions in many major cities around the world, especially in less developed countries. To emancipate these settlements and their inhabitants through government intervention, accurate data about slum location and extent is required. While ground survey data is the most reliable, such surveys are costly and time-consuming. An alternative is remotely sensed data obtained from very high-resolution (VHR) imagery. With the advancement of new technology, remote sensing based mapping of slums has emerged as a prominent research area. The parallel rise of Artificial Intelligence, especially Deep Learning has added a new dimension to this field as it allows automated analysis of satellite imagery to identify complex spatial patterns associated with slums. This article offers a detailed review and meta-analysis of research on slum mapping using remote sensing imagery from 2014 to 2024, with a special focus on deep learning approaches. Our analysis reveals a trend towards increasingly complex neural network architectures, with advancements in data preprocessing and model training techniques significantly enhancing slum identification accuracy. We have attempted to identify key methodologies that are effective across diverse geographic contexts. While acknowledging the transformative impact Convolutional Neural Networks (CNNs) in slum detection, our review underscores the absence of a universally optimal model, suggesting the need for context-specific adaptations. We also identify prevailing challenges in this field, such as data limitations and a lack of model explainability and suggest potential strategies for overcoming these.


title: Hardy spaces and Riesz transforms on a Lie group of exponential growth

abstract: Let $G$ be the Lie group ${\Bbb{R}}^2\rtimes {\Bbb{R}}^+$ endowed with the Riemannian symmetric space structure. Take a distinguished basis $X_0,\, X_1,\,X_2$ of left-invariant vector fields of the Lie algebra of $G$, and consider the Laplacian $\Delta=-\sum_{i=0}^2X_i^2$ and the first-order Riesz transforms $\mathcal R_i=X_i\Delta^{-1/2}$, \hskip3pt $i=0,1,2$. We first show that the atomic Hardy space $H^1$ in $G$ introduced by the authors in a previous paper does not admit a characterization in terms of the Riesz transforms $\mathcal R_i$. It is also proved that two of these Riesz transforms are bounded from $H^1$ to $H^1$.


title: A geometric application of Lagrange multipliers: extremal compatible linear connections

abstract: The L\'evi-Civita connection of a Riemannian manifold is a metric (compatible) linear connection, uniquely determined by its vanishing torsion. It is extremal in the sense that it has minimal torsion at each point. We can extend this idea to more general spaces with more general (not necessarily quadratic) indicatrix hypersurfaces in the tangent spaces. Here, the existence of compatible linear connections on the base manifold is not guaranteed anymore, which needs to be addressed along with the intrinsic characterization of the extremal one. The first step is to provide the Riemann metrizability of the compatible linear connections. This Riemannian environment establishes a one-to-one correspondence between linear connections and their torsion tensors, also giving a way of measuring the length of the latter. The second step is to solve a hybrid conditional extremum problem at each point of the base manifold, all of whose constraint equations (compatibility equations) involve functions defined on the indicatrix hypersurface. The objective function to be minimized is a quadratic squared norm function defined on the finite dimensional fiber (vector space) of the torsion tensor bundle. We express the solution by using the method of Lagrange multipliers on function spaces point by point, we present a necessary and sufficient condition of the solvability and the solution is also given in terms of intrinsic quantities affecting the uniform size of the linear isometry groups of the indicatrices. This completes the description of differential geometric spaces admitting compatible linear connections on the base manifold, called generalized Berwald spaces, in Finsler geometry.


title: Strong and Weak Random Walks on Signed Networks

abstract: Random walks play an important role in probing the structure of complex networks. On traditional networks, they can be used to extract community structure, understand node centrality, perform link prediction, or capture the similarity between nodes. On signed networks, where the edge weights can be either positive or negative, it is non-trivial to design a random walk which can be used to extract information about the signed structure of the network, in particular the ability to partition the graph into communities with positive edges inside and negative edges in between. Prior works on signed network random walks focus on the case where there are only two such communities (strong balance), which is rarely the case in empirical networks. In this paper, we propose a signed network random walk which can capture the structure of a network with more than two such communities (weak balance). The walk results in a similarity matrix which can be used to cluster the nodes into antagonistic communities. We compare the characteristics of the so-called strong and weak random walks, in terms of walk length and stationarity. We show through a series of experiments on synthetic and empirical networks that the similarity matrix based on weak walks can be used for both unsupervised and semi-supervised clustering, outperforming the same similarity matrix based on strong walks when the graph has more than two communities, or exhibits asymmetry in the density of links. These results suggest that other random-walk based algorithms for signed networks could be improved simply by running them with weak walks instead of strong walks.


title: LVBench: An Extreme Long Video Understanding Benchmark

abstract: Recent progress in multimodal large language models has markedly enhanced the understanding of short videos (typically under one minute), and several evaluation datasets have emerged accordingly. However, these advancements fall short of meeting the demands of real-world applications such as embodied intelligence for long-term decision-making, in-depth movie reviews and discussions, and live sports commentary, all of which require comprehension of long videos spanning several hours. To address this gap, we introduce LVBench, a benchmark specifically designed for long video understanding. Our dataset comprises publicly sourced videos and encompasses a diverse set of tasks aimed at long video comprehension and information extraction. LVBench is designed to challenge multimodal models to demonstrate long-term memory and extended comprehension capabilities. Our extensive evaluations reveal that current multimodal models still underperform on these demanding long video understanding tasks. Through LVBench, we aim to spur the development of more advanced models capable of tackling the complexities of long video comprehension. Our data and code are publicly available at: https://lvbench.github.io.


title: A Census of Sun's Ancestors and their Contributions to the Solar System Chemical Composition

abstract: In this work we compute the rates and numbers of different types of stars and phenomena (SNe, novae, white dwarfs, merging neutron stars, black holes) that contributed to the chemical composition of the Solar System. Stars die and restore the newly formed elements into the interstellar gas. This process is called "chemical evolution". In particular, we analyse the death rates of stars of all masses, dying either quiescently or explosively. These rates and total star numbers are computed in the context of a revised version of the two-infall model for the chemical evolution of the Milky Way, which reproduces fairly well the observed abundance patterns of several chemical species, as well as the global solar metallicity. We compute also the total number of stars ever born and still alive as well as the number of stars born up to the formation of the Solar System and with a mass and metallicity like the Sun. This latter number will account for all the possible existing Solar Systems which can host life in the solar vicinity. Among all the stars (from 0.8 to 100 M$_{\odot}$) born and died from the beginning up to the Solar System formation epoch, which contributed to its chemical composition, 93.00$\%$ are represented by stars dying as single white dwarfs (without interacting significantly with a companion star) and originating in the mass range 0.8-8 M$_{\odot}$, while 5.24$\%$ are neutron stars and 0.73$\%$ are black holes, both originating from SNe core-collapse (M>8 M$_{\odot}$); 0.64$\%$ are Type Ia SNe and 0.40$\%$ are nova systems, both originating from the same mass range as the white dwarfs. The number of stars similar to the Sun born from the beginning up to the Solar System formation, with metallicity in the range 12+log(Fe/H)= 7.50 $\pm$ 0.04 dex is 3.1732$\cdot$ 10$^{7}$, and in particular our Sun is the 2.6092$\cdot$ 10$^7$-th star of this kind, born in the solar vicinity.


title: Adaptively Bypassing Vision Transformer Blocks for Efficient Visual Tracking

abstract: Empowered by transformer-based models, visual tracking has advanced significantly. However, the slow speed of current trackers limits their applicability on devices with constrained computational resources. To address this challenge, we introduce ABTrack, an adaptive computation framework that adaptively bypassing transformer blocks for efficient visual tracking. The rationale behind ABTrack is rooted in the observation that semantic features or relations do not uniformly impact the tracking task across all abstraction levels. Instead, this impact varies based on the characteristics of the target and the scene it occupies. Consequently, disregarding insignificant semantic features or relations at certain abstraction levels may not significantly affect the tracking accuracy. We propose a Bypass Decision Module (BDM) to determine if a transformer block should be bypassed, which adaptively simplifies the architecture of ViTs and thus speeds up the inference process. To counteract the time cost incurred by the BDMs and further enhance the efficiency of ViTs, we innovatively adapt a pruning technique to reduce the dimension of the latent representation of tokens in each transformer block. Extensive experiments on multiple tracking benchmarks validate the effectiveness and generality of the proposed method and show that it achieves state-of-the-art performance. Code is released at: \href{https://github.com/1HykhqV3rU/ABTrack}


title: Interference Analysis for Coexistence of UAVs and Civil Aircrafts Based on Automatic Dependent Surveillance-Broadcast

abstract: Due to the advantages of high mobility and easy deployment, unmanned aerial vehicles (UAVs) are widely applied in both military and civilian fields. In order to strengthen the flight surveillance of UAVs and guarantee the airspace safety, UAVs can be equipped with the automatic dependent surveillance-broadcast (ADS-B) system, which periodically sends flight information to other aircrafts and ground stations (GSs). However, due to the limited resource of channel capacity, UAVs equipped with ADS-B results in the interference between UAVs and civil aircrafts (CAs), which further impacts the accuracy of received information at GSs. In detail, the channel capacity is mainly affected by the density of aircrafts and the transmitting power of ADS-B. Hence, based on the three-dimensional poisson point process, this work leverages the stochastic geometry theory to build a model of the coexistence of UAVs and CAs and analyze the interference performance of ADS-B monitoring system. From simulation results, we reveal the effects of transmitting power, density, threshold and pathloss on the performance of the ADS-B monitoring system. Besides, we provide the suggested transmitting power and density for the safe coexistence of UAVs and CAs.


title: Beyond the Mean: Differentially Private Prototypes for Private Transfer Learning

abstract: Machine learning (ML) models have been shown to leak private information from their training datasets. Differential Privacy (DP), typically implemented through the differential private stochastic gradient descent algorithm (DP-SGD), has become the standard solution to bound leakage from the models. Despite recent improvements, DP-SGD-based approaches for private learning still usually struggle in the high privacy ($\varepsilon\le1)$ and low data regimes, and when the private training datasets are imbalanced. To overcome these limitations, we propose Differentially Private Prototype Learning (DPPL) as a new paradigm for private transfer learning. DPPL leverages publicly pre-trained encoders to extract features from private data and generates DP prototypes that represent each private class in the embedding space and can be publicly released for inference. Since our DP prototypes can be obtained from only a few private training data points and without iterative noise addition, they offer high-utility predictions and strong privacy guarantees even under the notion of pure DP. We additionally show that privacy-utility trade-offs can be further improved when leveraging the public data beyond pre-training of the encoder: in particular, we can privately sample our DP prototypes from the publicly available data points used to train the encoder. Our experimental evaluation with four state-of-the-art encoders, four vision datasets, and under different data and imbalancedness regimes demonstrate DPPL's high performance under strong privacy guarantees in challenging private learning setups.


title: Emergence of non-uniform strain induced exciton species in homo- and heterobilayer transition metal dichalcogenides

abstract: Full control of excitons in 2D materials is an important step to exploit them for applications. Straintronics is one method that can be used to effectively control the movement of excitons. Unfortunately, the effects of non-uniform strain in 2D materials are not yet well understood theoretically, although these strain fields can be present in experiments in the form of wrinkles, bubbles, and folds, or even explicitly applied to 2D materials through pre-patterned surfaces. The effects of these non-uniform strain fields on multilayers are even less studied due to the sheer size of these systems. In the present investigation, we study wrinkles that form in homo- and heterobilayers of 2D transition metal dichalcogenides using density functional theory. We show that the non-uniform strain leads to the formation of interlayer excitons in homobilayers of $ \mathrm WSe_2 $ and to exciton localization in heterobilayers of $ \mathrm WSe_2$-$ \mathrm MoSe_2$. Our results also reveal that the spin angular momentum is changed due to the mixing of in- and out-of-plane states which can explain the brightening of the formerly dark excitonic states under strain. Our results will pave the way towards a full understanding of the strain-control of excitons in 2D materials.


title: HARd to Beat: The Overlooked Impact of Rolling Windows in the Era of Machine Learning

abstract: We investigate the predictive abilities of the heterogeneous autoregressive (HAR) model compared to machine learning (ML) techniques across an unprecedented dataset of 1,455 stocks. Our analysis focuses on the role of fitting schemes, particularly the training window and re-estimation frequency, in determining the HAR model's performance. Despite extensive hyperparameter tuning, ML models fail to surpass the linear benchmark set by HAR when utilizing a refined fitting approach for the latter. Moreover, the simplicity of HAR allows for an interpretable model with drastically lower computational costs. We assess performance using QLIKE, MSE, and realized utility metrics, finding that HAR consistently outperforms its ML counterparts when both rely solely on realized volatility and VIX as predictors. Our results underscore the importance of a correctly specified fitting scheme. They suggest that properly fitted HAR models provide superior forecasting accuracy, establishing robust guidelines for their practical application and use as a benchmark. This study not only reaffirms the efficacy of the HAR model but also provides a critical perspective on the practical limitations of ML approaches in realized volatility forecasting.


title: Efficient Network Traffic Feature Sets for IoT Intrusion Detection

abstract: The use of Machine Learning (ML) models in cybersecurity solutions requires high-quality data that is stripped of redundant, missing, and noisy information. By selecting the most relevant features, data integrity and model efficiency can be significantly improved. This work evaluates the feature sets provided by a combination of different feature selection methods, namely Information Gain, Chi-Squared Test, Recursive Feature Elimination, Mean Absolute Deviation, and Dispersion Ratio, in multiple IoT network datasets. The influence of the smaller feature sets on both the classification performance and the training time of ML models is compared, with the aim of increasing the computational efficiency of IoT intrusion detection. Overall, the most impactful features of each dataset were identified, and the ML models obtained higher computational efficiency while preserving a good generalization, showing little to no difference between the sets.


title: Some Properties of the Plaquette Random-Cluster Model

abstract: We show that the $i$-dimensional plaqutte random-cluster model with coefficients in $\mathbb{Z}_q$ is dual to a $(d-i)$-dimensional plaquette random cluster model. In addition, we explore boundary conditions, infinite volume limits, and uniqueness for these models. For previously known results, we provide new proofs that rely more on the tools of algebraic topology.


title: Hofstadter spectrum in a semiconductor moir\'e lattice

abstract: Recently, the Hofstadter spectrum of a twisted $\mathrm{WSe_2/MoSe_2}$ heterobilayer has been observed in experiment [C. R. Kometter, et al. Nat.Phys.19, 1861 (2023)], but the origin of Hofstadter states remains unclear. Here, we present a comprehensive theoretical interpretation of the observed Hofstadter states by calculating its accurate Hofstadter spectrum. We point out that the valley Zeeman effect, a unique feature of the transition metal dichalcogenide (TMD) materials, plays a crucial role in determining the shape of the Hofstadter spectrum, due to the narrow bandwidth of the moir\'e bands. This is distinct from the graphene-based moir\'e systems. We further predict that the Hofstadter spectrum of the moir\'e flat band, which was not observed in experiment, can be observed in the same system with a larger twist angle $2^\circ\lesssim\theta \lesssim 3^\circ$. Our theory paves the way for further studies of the interplay between the Hofstadter states and correlated insulting states in such moir\'e lattice systems.


title: A novel approach to graph distinction through GENEOs and permutants

abstract: The theory of Group Equivariant Non-Expansive Operators (GENEOs) was initially developed in Topological Data Analysis for the geometric approximation of data observers, including their invariances and symmetries. This paper departs from that line of research and explores the use of GENEOs for distinguishing $r$-regular graphs up to isomorphisms. In doing so, we aim to test the capabilities and flexibility of these operators. Our experiments show that GENEOs offer a good compromise between efficiency and computational cost in comparing $r$-regular graphs, while their actions on data are easily interpretable. This supports the idea that GENEOs could be a general-purpose approach to discriminative problems in Machine Learning when some structural information about data and observers is explicitly given.


title: A Robust Pipeline for Classification and Detection of Bleeding Frames in Wireless Capsule Endoscopy using Swin Transformer and RT-DETR

abstract: In this paper, we present our approach to the Auto WCEBleedGen Challenge V2 2024. Our solution combines the Swin Transformer for the initial classification of bleeding frames and RT-DETR for further detection of bleeding in Wireless Capsule Endoscopy (WCE), enhanced by a series of image preprocessing steps. These steps include converting images to Lab colour space, applying Contrast Limited Adaptive Histogram Equalization (CLAHE) for better contrast, and using Gaussian blur to suppress artefacts. The Swin Transformer utilizes a tiered architecture with shifted windows to efficiently manage self-attention calculations, focusing on local windows while enabling cross-window interactions. RT-DETR features an efficient hybrid encoder for fast processing of multi-scale features and an uncertainty-minimal query selection for enhanced accuracy. The class activation maps by Ablation-CAM are plausible to the model's decisions. On the validation set, this approach achieves a classification accuracy of 98.5% (best among the other state-of-the-art models) compared to 91.7% without any pre-processing and an $\text{AP}_{50}$ of 66.7% compared to 65.0% with state-of-the-art YOLOv8. On the test set, this approach achieves a classification accuracy and F1 score of 87.0% and 89.0% respectively.


title: Dispersion Interaction Between Thin Conducting Cylinders

abstract: The ground state and excited state resonance dipole-dipole interaction energy between two elongated conducting molecules are explored. We review the current status for ground state interactions. This interaction is found to be of a much longer range than in the case when the molecules are pointlike and nonconducting. These are well known results found earlier by Davies, Ninham, and Richmond, and later, using a different formalism, by Rubio and co-workers. We show how the theory can be extended to excited state interactions. A characteristic property following from our calculation is that the interaction energy dependence with separation ($R$) goes like $f(R)/R^2$ both for resonance and for the van der Waals case in the long range limit. In some limits $f(R)$ has a logarithmic dependency and in others it takes constant values. We predict an unusual slow decay rate for the energy transfer between conducting molecules.


title: 3D CBCT Challenge 2024: Improved Cone Beam CT Reconstruction using SwinIR-Based Sinogram and Image Enhancement

abstract: In this paper, we present our approach to the 3D CBCT Challenge 2024, a part of ICASSP SP Grand Challenges 2024. Improvement in Cone Beam Computed Tomography (CBCT) reconstruction has been achieved by integrating Swin Image Restoration (SwinIR) based sinogram and image enhancement modules. The proposed methodology uses Nesterov Accelerated Gradient Descent (NAG) to solve the least squares (NAG-LS) problem in CT image reconstruction. The integration of sinogram and image enhancement modules aims to enhance image clarity and preserve fine details, offering a promising solution for both low dose and clinical dose CBCT reconstruction. The averaged mean squared error (MSE) over the validation dataset has decreased significantly, in the case of low dose by one-fifth and clinical dose by one-tenth. Our solution is one of the top 5 approaches in this challenge.


title: Balanced Coupling in Electromagnetic Circuits

abstract: The rotating wave approximation (RWA) is ubiquitous in the analysis of driven and coupled resonators. However, the limitations of the RWA seem to be poorly understood and in some cases the RWA disposes of essential physics. We investigate the RWA in the context of electrical resonant circuits. Using a classical Hamiltonian approach, we find that by balancing electrical and magnetic components of the resonator drive or resonator-resonator coupling, the RWA can be made exact. This type of balance, in which the RWA is exact, has applications in superconducting qubits where it suppresses nutation normally associated with strong Rabi driving. In the context of dispersive readout, balancing the qubit-resonator coupling changes the qubit leakage induced by the resonator drive (MIST), but does not remove it in the case of the transmon qubit.


title: Adversarial Evasion Attack Efficiency against Large Language Models

abstract: Large Language Models (LLMs) are valuable for text classification, but their vulnerabilities must not be disregarded. They lack robustness against adversarial examples, so it is pertinent to understand the impacts of different types of perturbations, and assess if those attacks could be replicated by common users with a small amount of perturbations and a small number of queries to a deployed LLM. This work presents an analysis of the effectiveness, efficiency, and practicality of three different types of adversarial attacks against five different LLMs in a sentiment classification task. The obtained results demonstrated the very distinct impacts of the word-level and character-level attacks. The word attacks were more effective, but the character and more constrained attacks were more practical and required a reduced number of perturbations and queries. These differences need to be considered during the development of adversarial defense strategies to train more robust LLMs for intelligent text classification applications.


title: ONNXim: A Fast, Cycle-level Multi-core NPU Simulator

abstract: As DNNs are widely adopted in various application domains while demanding increasingly higher compute and memory requirements, designing efficient and performant NPUs (Neural Processing Units) is becoming more important. However, existing architectural NPU simulators lack support for high-speed simulation, multi-core modeling, multi-tenant scenarios, detailed DRAM/NoC modeling, and/or different deep learning frameworks. To address these limitations, this work proposes ONNXim, a fast cycle-level simulator for multi-core NPUs in DNN serving systems. It takes DNN models represented in the ONNX graph format generated from various deep learning frameworks for ease of simulation. In addition, based on the observation that typical NPU cores process tensor tiles from on-chip scratchpad memory with deterministic compute latency, we forgo a detailed modeling for the computation while still preserving simulation accuracy. ONNXim also preserves dependencies between compute and tile DMAs. Meanwhile, the DRAM and NoC are modeled in cycle-level to properly model contention among multiple cores that can execute different DNN models for multi-tenancy. Consequently, ONNXim is significantly faster than existing simulators (e.g., by up to 384x over Accel-sim) and enables various case studies, such as multi-tenant NPUs, that were previously impractical due to slow speed and/or lack of functionalities. ONNXim is publicly available at https://github.com/PSAL-POSTECH/ONNXim.


title: FakeSound: Deepfake General Audio Detection

abstract: With the advancement of audio generation, generative models can produce highly realistic audios. However, the proliferation of deepfake general audio can pose negative consequences. Therefore, we propose a new task, deepfake general audio detection, which aims to identify whether audio content is manipulated and to locate deepfake regions. Leveraging an automated manipulation pipeline, a dataset named FakeSound for deepfake general audio detection is proposed, and samples can be viewed on website https://FakeSoundData.github.io. The average binary accuracy of humans on all test sets is consistently below 0.6, which indicates the difficulty humans face in discerning deepfake audio and affirms the efficacy of the FakeSound dataset. A deepfake detection model utilizing a general audio pre-trained model is proposed as a benchmark system. Experimental results demonstrate that the performance of the proposed model surpasses the state-of-the-art in deepfake speech detection and human testers.


title: A note for W^{1,p}(V) and W_0^{1,p}(V) on a locally finite graph

abstract: In this paper, we investigate the Sobolev spaces W^{1,p}(V) and W_0^{1,p}(V) on a locally finite graph G=(V,E), which are fundamental tools when we apply the variational methods to partial differential equations on graphs. As a key contribution of this note, we show that in general, W^{1,p}(V) is not equivalent to W_0^{1,p}(V) on locally finite graphs, which is different from the situation on Euclidean space R^N.


title: Quantum harvester enables energy transfer without randomness transfer or dissipation

abstract: We consider a foundational question in energy harvesting: given a partly random energy source, is it possible to extract the energy without also transferring randomness or accepting another thermodynamical cost? We answer this in the positive, describing scenarios and protocols where in principle energy is extracted from a field with randomness but without any randomness being transferred, and without energy dissipation. Such protocols fundamentally outperform existing methods of rectification which dissipate power, or feedback demon-like protocols which transfer randomness to the feedback system. The protocols exploit the possibility of the harvesting system taking several trajectories that lead to the same final state at a given time. We explain why these protocols do not violate basic physical principles. A key example involves the experimentally well-established phenomenon of Rabi oscillations between energy levels, exploiting the multitude of rotation axes in the state space that take the lower energy state to the excited state. The quantum system is deterministically excited to the highest energy level after interacting with the source for a fixed amount of time, irrespective of the random initial phase of the external potential.


title: Learning Job Title Representation from Job Description Aggregation Network

abstract: Learning job title representation is a vital process for developing automatic human resource tools. To do so, existing methods primarily rely on learning the title representation through skills extracted from the job description, neglecting the rich and diverse content within. Thus, we propose an alternative framework for learning job titles through their respective job description (JD) and utilize a Job Description Aggregator component to handle the lengthy description and bidirectional contrastive loss to account for the bidirectional relationship between the job title and its description. We evaluated the performance of our method on both in-domain and out-of-domain settings, achieving a superior performance over the skill-based approach.


title: DCASE 2024 Task 4: Sound Event Detection with Heterogeneous Data and Missing Labels

abstract: The Detection and Classification of Acoustic Scenes and Events Challenge Task 4 aims to advance sound event detection (SED) systems in domestic environments by leveraging training data with different supervision uncertainty. Participants are challenged in exploring how to best use training data from different domains and with varying annotation granularity (strong/weak temporal resolution, soft/hard labels), to obtain a robust SED system that can generalize across different scenarios. Crucially, annotation across available training datasets can be inconsistent and hence sound labels of one dataset may be present but not annotated in the other one and vice-versa. As such, systems will have to cope with potentially missing target labels during training. Moreover, as an additional novelty, systems will also be evaluated on labels with different granularity in order to assess their robustness for different applications. To lower the entry barrier for participants, we developed an updated baseline system with several caveats to address these aforementioned problems. Results with our baseline system indicate that this research direction is promising and is possible to obtain a stronger SED system by using diverse domain training data with missing labels compared to training a SED system for each domain separately.


title: Bright electrically contacted circular Bragg grating resonators with deterministically integrated quantum dots

abstract: Cavity-enhanced emission of electrically controlled semiconductor quantum dots is essential in developing bright quantum devices for real-world quantum photonic applications. Combining the circular Bragg grating (CBG) approach with a PIN-diode structure, we propose and implement an innovative concept for ridge-based electrically-contacted CBG resonators. Through fine-tuning of device parameters in numerical simulations and deterministic nanoprocessing, we produced electrically controlled single quantum dot CBG resonators with excellent electro-optical emission properties. These include multiple wavelength-tunable emission lines and a photon extraction efficiency (PEE) of up to (30.4$\pm$3.4)%, where refined numerical optimization based on experimental findings suggests a substantial improvement, promising PEE >50%. Additionally, the developed quantum light sources yield single-photon purity reaching (98.8$\pm$0.2)% [post-selected: (99.5$\pm$0.3)%] and a photon indistinguishability of (25.8$\pm$2.1)% [post-selected: (92.8$\pm$4.8)%]. Our results pave the way for high-performance quantum devices with combined cavity enhancement and deterministic charge-environment controls, advancing the development of photonic quantum information systems such as complex quantum repeater networks.


title: Beyond Attraction: A Novel Approach to Repulsive Casimir-Lifshitz Forces using Controllable Offstoichiometry in Gapped Metals

abstract: We uncover a novel physical mechanism that enables a switch between attractive and repulsive Casimir forces when a Teflon surface interacts with a new form of quantum material (i.e., gapped metal) surface across different liquid media. We demonstrate the discovery of a zero-frequency Casimir effect, which, for the first time, reveals the potential for quantum switching within nanometer distances-a scale previously thought to be unattainable. Hence, our results introduce a new method to induce phase (stoichiometry)-controlled attraction-repulsion transitions and achieving quantum levitation in a liquid medium by tuning the liquid environment. This study thus not only advances our understanding of quantum forces at the nanoscale via their correlation to dielectric properties of involved materials but also opens up exciting possibilities for their manipulation in novel ways, forming the basis towards innovative advancements in nanoscale technology.


title: MOCCA: Global properties of tidally filling and underfilling globular star clusters with multiple stellar populations

abstract: We explore the evolution of various properties of multiple-population globular clusters (GCs) for a broad range of initial conditions. We simulated over 200 GC models using the MOCCA Monte Carlo code and find that present-day properties (core and half-light radii, ratio of the number of second-generation (SG) stars to the total number of stars, NSG/NTOT) of these models cover the observed values of these quantities for Milky Way GCs. Starting with a relatively small value of the SG fraction (NSG/NTOT ~ 0.25) and a SG system concentrated in the inner regions of the cluster, we find, in agreement with previous studies, that systems in which the first-generation (FG) is initially tidally filling or slightly tidally underfilling best reproduce the observed ratios of NSG/NTOT and have values of the core and half-light radii typical of those of many Galactic globular clusters. Models in which the FG is initially tidally underfilling retain values of NSG/NTOT close to their initial values. These simulations expand previous investigations and serve to further constrain the viable range of initial parameters and better understand their influence on present-day GC properties. The results of this investigation also provide the basis for our future survey aimed at building specific models to reproduce the observed trends (or lack thereof) between the properties of multiple stellar populations and other clusters properties.


title: Iterative method for real-time Hybrid testing: application to a cantilever beam with two interface degrees of freedom

abstract: In this paper, an iterative method for real-time hybrid testing (RTHT) is proposed. The method seeks to iteratively balance the interface conditions between the physical and numerical substructures by controlling the periodic demand of the actuators. It is then suitable for RTHT of structures undergoing a periodic response, e.g. structures excited at resonance. We demonstrate the capabilities of the method on a cantilever beam in bending motion with two degrees of freedom at the interface, which we use as a prototype for future testing of aircraft wings. We show that a number of challenges arise in these settings, such as the difficulty in measuring interface forces while controlling a continuous structure and the instability of the hybrid test for small time delays. Classical RTHT strategies could produce inaccurate or unstable outcomes, whereas the proposed method is able to attain very good interface synchronisation in a wide range of tested scenarios.


title: Functional approach to the normality of mappings

abstract: In the article a technique of the usage of $f$-continuous functions (on mappings) and their families is developed. A proof of the Urysohn's Lemma for mappings is presented and a variant of the Brouwer-Tietze-Urysohn Extension Theorem for mappings is proven. Characterizations of the normality properties of mappings are given and the notion of a perfect normality of a mapping is introduced. It seems to be the most optimal in this approach.


title: On Constructions of Fractal Spaces Using Replacement and the Combinatorial Loewner Property

abstract: The combinatorial Loewner property was introduced by Bourdon and Kleiner as a quasismmetrically invariant substitute for the Loewner property for general fractals and boundaries of hyperbolic groups. While the Loewner property is somewhat restrictive, the combinatorial Loewner property is very generic -- Bourdon and Kleiner showed that many familiar fractals and group boundaries satisfy it. If $X$ is quasisymmetric to a Loewner space, it has the combinatorial Loewner property. Kleiner conjectured in 2006 that the converse to this holds for self-similar fractals -- the hope being that this would lead to the existence of many exotic Loewner spaces. We disprove this conjecture and give the first examples of spaces which are self-similar and combinatorially Loewner and which are not quasisymmetric to Loewner spaces. In the process we introduce a self-similar replacement rule, called a linear replacement rule, which is inspired by the work of Laakso. This produces a new rich class of fractal spaces, where closed form computations of potentials and their conformal dimensions are possible. These spaces exhibit a rich class of behaviors from analysis on fractals in regards to diffusions, Sobolev spaces, energy measures and conformal dimensions. These behaviors expand on the known examples of Cantor sets, gaskets, Vicsek sets, and the often too difficult carpet-like spaces. Especially the counter examples to Kleiner's conjecture that arise from this construction are interesting, since they open up the possibility to study the new realm of combinatorially Loewner spaces that are not quasisymmetric to Loewner spaces.


title: MWIRSTD: A MWIR Small Target Detection Dataset

abstract: This paper presents a novel mid-wave infrared (MWIR) small target detection dataset (MWIRSTD) comprising 14 video sequences containing approximately 1053 images with annotated targets of three distinct classes of small objects. Captured using cooled MWIR imagers, the dataset offers a unique opportunity for researchers to develop and evaluate state-of-the-art methods for small object detection in realistic MWIR scenes. Unlike existing datasets, which primarily consist of uncooled thermal images or synthetic data with targets superimposed onto the background or vice versa, MWIRSTD provides authentic MWIR data with diverse targets and environments. Extensive experiments on various traditional methods and deep learning-based techniques for small target detection are performed on the proposed dataset, providing valuable insights into their efficacy. The dataset and code are available at https://github.com/avinres/MWIRSTD.


title: Gate-based counterdiabatic driving with complexity guarantees

abstract: We propose a general, fully gate-based quantum algorithm for counterdiabatic driving. The algorithm does not depend on heuristics as in previous variational methods, and exploits regularisation of the adiabatic gauge potential to suppress only the transitions from the eigenstate of interest. This allows for a rigorous quantum gate complexity upper bound in terms of the minimum gap $\Delta$ around this target eigenstate. We find that the algorithm requires at most $\tilde O(\Delta^{-(3 + o(1))} \epsilon^{-(1 + o(1))})$ quantum gates to achieve a target state fidelity of at least $1 - \epsilon^2$, which is nearly equivalent to the gate complexity of gate-based adiabatic state preparation. This calls into question the perception of counterdiabatic driving as a general shortcut to adiabaticity.


title: Gauge-invariant renormalization of four-quark operators in lattice QCD

abstract: We study the renormalization of four-quark operators in one-loop perturbation theory. We employ a coordinate-space Gauge-Invariant Renormalization Scheme (GIRS), which can be advantageous compared to other schemes, especially in nonperturbative lattice investigations. From our perturbative calculations, we extract the conversion factors between GIRS and the modified Minimal Subtraction scheme ($\overline{\rm MS}$) at the next-to-leading order. A formidable issue in the study of the four-quark operators is that operators with different Dirac matrices mix among themselves upon renormalization. We focus on both parity-conserving and parity-violating four-quark operators, which change flavor numbers by two units ($\Delta F = 2$). The extraction of the conversion factors entails the calculation of two-point Green's functions involving products of two four-quark operators, as well as three-point Green's functions with one four-quark and two bilinear operators. The significance of our results lies in their potential to refine our understanding of QCD phenomena, offering insights into the precision of Cabibbo-Kobayashi-Maskawa (CKM) matrix elements and shedding light on the nonperturbative treatment of complex mixing patterns associated with four-quark operators.


title: Two-tone spectroscopy of high-frequency quantum circuits with a Josephson emitter

abstract: We perform two-tone spectroscopy on quantum circuits, where high-frequency radiation is generated by a voltage-biased superconductor-normal-superconductor Josephson junction and detection is carried out by an ancillary microwave resonator. We implement this protocol on two different systems, a transmon qubit and a $\lambda/4$ resonator. We demonstrate that this two-tone Josephson spectroscopy operates well into the millimeter-wave band, reaching frequencies larger than 80 GHz, and is well-suited for probing highly coherent quantum systems.

categories: cond-mat.mes-hall cond-mat.supr-con physics.app-ph quant-ph


title: Synchronous and Asynchronous Updates of Active Ising Spins in One Dimension

abstract: How do update rules affect the dynamical and steady state properties of a flock? In this study, we have explored the active Ising spins (s = +-1) in one dimension, where spin updates its orientation according to the Metropolis algorithm (based on the neighbors) via two different update rules. (i) Parallel, and (ii) Random-sequential. We explore the effect of Parallel and Random-sequential updates on the dynamical properties of flocks in one dimension. Due to the inherent asynchronous nature of the Random-sequential update, the directional switching of the flock is increased compared to the Parallel one. The nature of phase transition is affected by the difference in the updating mechanism: discontinuous for Parallel and continuous for Random-sequential updates.


title: Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey

abstract: Compared to traditional sentiment analysis, which only considers text, multimodal sentiment analysis needs to consider emotional signals from multimodal sources simultaneously and is therefore more consistent with the way how humans process sentiment in real-world scenarios. It involves processing emotional information from various sources such as natural language, images, videos, audio, physiological signals, etc. However, although other modalities also contain diverse emotional cues, natural language usually contains richer contextual information and therefore always occupies a crucial position in multimodal sentiment analysis. The emergence of ChatGPT has opened up immense potential for applying large language models (LLMs) to text-centric multimodal tasks. However, it is still unclear how existing LLMs can adapt better to text-centric multimodal sentiment analysis tasks. This survey aims to (1) present a comprehensive review of recent research in text-centric multimodal sentiment analysis tasks, (2) examine the potential of LLMs for text-centric multimodal sentiment analysis, outlining their approaches, advantages, and limitations, (3) summarize the application scenarios of LLM-based multimodal sentiment analysis technology, and (4) explore the challenges and potential research directions for multimodal sentiment analysis in the future.


title: Explore-Go: Leveraging Exploration for Generalisation in Deep Reinforcement Learning

abstract: One of the remaining challenges in reinforcement learning is to develop agents that can generalise to novel scenarios they might encounter once deployed. This challenge is often framed in a multi-task setting where agents train on a fixed set of tasks and have to generalise to new tasks. Recent work has shown that in this setting increased exploration during training can be leveraged to increase the generalisation performance of the agent. This makes sense when the states encountered during testing can actually be explored during training. In this paper, we provide intuition why exploration can also benefit generalisation to states that cannot be explicitly encountered during training. Additionally, we propose a novel method Explore-Go that exploits this intuition by increasing the number of states on which the agent trains. Explore-Go effectively increases the starting state distribution of the agent and as a result can be used in conjunction with most existing on-policy or off-policy reinforcement learning algorithms. We show empirically that our method can increase generalisation performance in an illustrative environment and on the Procgen benchmark.


title: CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Models

abstract: Classifier-free guidance (CFG) is a fundamental tool in modern diffusion models for text-guided generation. Although effective, CFG has notable drawbacks. For instance, DDIM with CFG lacks invertibility, complicating image editing; furthermore, high guidance scales, essential for high-quality outputs, frequently result in issues like mode collapse. Contrary to the widespread belief that these are inherent limitations of diffusion models, this paper reveals that the problems actually stem from the off-manifold phenomenon associated with CFG, rather than the diffusion models themselves. More specifically, inspired by the recent advancements of diffusion model-based inverse problem solvers (DIS), we reformulate text-guidance as an inverse problem with a text-conditioned score matching loss, and develop CFG++, a novel approach that tackles the off-manifold challenges inherent in traditional CFG. CFG++ features a surprisingly simple fix to CFG, yet it offers significant improvements, including better sample quality for text-to-image generation, invertibility, smaller guidance scales, reduced mode collapse, etc. Furthermore, CFG++ enables seamless interpolation between unconditional and conditional sampling at lower guidance scales, consistently outperforming traditional CFG at all scales. Experimental results confirm that our method significantly enhances performance in text-to-image generation, DDIM inversion, editing, and solving inverse problems, suggesting a wide-ranging impact and potential applications in various fields that utilize text guidance. Project Page: https://cfgpp-diffusion.github.io/.


title: US College Net Price Prediction Comparing ML Regression Models

abstract: This paper will illustrate the usage of Machine Learning algorithms on US College Scorecard datasets. For this paper, we will use our knowledge, research, and development of a predictive model to compare the results of all the models and predict the public and private net prices. This paper focuses on analyzing US College Scorecard data from data published on government websites. Our goal is to use four machine learning regression models to develop a predictive model to forecast the equitable net cost for every college, encompassing both public institutions and private, whether for-profit or nonprofit.


title: LQR control for a system describing the interaction between a floating solid and the surrounding fluid

abstract: This paper studies an infinite time horizon LQR optimal control problem for a system describing, within a linear approximation, the vertical oscillations of a floating solid, coupled to the motion of the free boundary fluid on which it floats. The fluid flow is described by a viscous version of the linearized Saint-Venant equations (shallow water regime). The major difficulty we are facing is that the domain occupied by the fluid is unbounded so that the system is not exponentially stable. This fact firstly raises challenges in proving the wellposedness, requiring the combined use of analytic semigroup theory and of an interpolation technique. The main contribution of the paper is that we show that, in spite of the lack of exponential stabilizability, we can define a wellposed LQR problem for which a Riccati based approach to design feedback controls can be implemented.


title: Bridging Resource Theory and Quantum Key Distribution: Geometric Analysis and Statistical Testing

abstract: Discerning between quantum and classical correlations is of great importance. Bell polytopes are well established as a fundamental tool. In this paper, we extend this line of inquiry by applying resource theory within the context of Network scenarios, to a Quantum Key Distribution (QKD) protocol. To achieve this, we consider the causal structure $P3$ that can describe the protocol, and we aim to develop useful statistical tests to assess it. More concretely, our objectives are twofold: firstly, to utilise the underlying causal structure of the QKD protocol to obtain a geometrical analysis of the resulting non-convex polytope, with a focus on the classical behaviours. Second, we devise a test within this framework to evaluate the distance between any two behaviours within the generated polytope. This approach offers a unique perspective, linking deviations from expected behaviour directly to the quality of the quantum resource or the residual nonclassicality in protocol execution.


title: A Concept-Based Explainability Framework for Large Multimodal Models

abstract: Large multimodal models (LMMs) combine unimodal encoders and large language models (LLMs) to perform multimodal tasks. Despite recent advancements towards the interpretability of these models, understanding internal representations of LMMs remains largely a mystery. In this paper, we present a novel framework for the interpretation of LMMs. We propose a dictionary learning based approach, applied to the representation of tokens. The elements of the learned dictionary correspond to our proposed concepts. We show that these concepts are well semantically grounded in both vision and text. Thus we refer to these as "multi-modal concepts". We qualitatively and quantitatively evaluate the results of the learnt concepts. We show that the extracted multimodal concepts are useful to interpret representations of test samples. Finally, we evaluate the disentanglement between different concepts and the quality of grounding concepts visually and textually. We will publicly release our code.


title: Balancing Molecular Information and Empirical Data in the Prediction of Physico-Chemical Properties

abstract: Predicting the physico-chemical properties of pure substances and mixtures is a central task in thermodynamics. Established prediction methods range from fully physics-based ab-initio calculations, which are only feasible for very simple systems, over descriptor-based methods that use some information on the molecules to be modeled together with fitted model parameters (e.g., quantitative-structure-property relationship methods or classical group contribution methods), to representation-learning methods, which may, in extreme cases, completely ignore molecular descriptors and extrapolate only from existing data on the property to be modeled (e.g., matrix completion methods). In this work, we propose a general method for combining molecular descriptors with representation learning using the so-called expectation maximization algorithm from the probabilistic machine learning literature, which uses uncertainty estimates to trade off between the two approaches. The proposed hybrid model exploits chemical structure information using graph neural networks, but it automatically detects cases where structure-based predictions are unreliable, in which case it corrects them by representation-learning based predictions that can better specialize to unusual cases. The effectiveness of the proposed method is demonstrated using the prediction of activity coefficients in binary mixtures as an example. The results are compelling, as the method significantly improves predictive accuracy over the current state of the art, showcasing its potential to advance the prediction of physico-chemical properties in general.


title: VECL-TTS: Voice identity and Emotional style controllable Cross-Lingual Text-to-Speech

abstract: Despite the significant advancements in Text-to-Speech (TTS) systems, their full utilization in automatic dubbing remains limited. This task necessitates the extraction of voice identity and emotional style from a reference speech in a source language and subsequently transferring them to a target language using cross-lingual TTS techniques. While previous approaches have mainly concentrated on controlling voice identity within the cross-lingual TTS framework, there has been limited work on incorporating emotion and voice identity together. To this end, we introduce an end-to-end Voice Identity and Emotional Style Controllable Cross-Lingual (VECL) TTS system using multilingual speakers and an emotion embedding network. Moreover, we introduce content and style consistency losses to enhance the quality of synthesized speech further. The proposed system achieved an average relative improvement of 8.83\% compared to the state-of-the-art (SOTA) methods on a database comprising English and three Indian languages (Hindi, Telugu, and Marathi).


title: Uses of Active and Passive Learning in Stateful Fuzzing

abstract: This paper explores the use of active and passive learning, i.e.\ active and passive techniques to infer state machine models of systems, for fuzzing. Fuzzing has become a very popular and successful technique to improve the robustness of software over the past decade, but stateful systems are still difficult to fuzz. Passive and active techniques can help in a variety of ways: to compare and benchmark different fuzzers, to discover differences between various implementations of the same protocol, and to improve fuzzers.


title: Analyzing the effect of higher dimensions on the black hole silhouette, deflection angles, and PINN approximated quasinormal modes

abstract: We investigate the impact of higher dimensions on the properties of Schwarzschild-Tangherlini black holes, focusing on the photonsphere, black hole shadow, deflection angles, and quasinormal modes (QNMs). We find that these properties diminish as the dimensionality ($n$) of the black hole increases. Analysis of the shadow radius measured by the Event Horizon Telescope suggests non-integer dimensions around $n\lessgtr4$. We derive an analytic formula for the weak field deflection angle, highlighting the need for advanced sensitive detection devices to observe lensed images influenced by higher dimensions. Our study of QNMs using physics-informed neural networks and the WKB method reveals a convergence towards known relationships between QNM frequencies and photon-sphere orbit frequencies. Despite the energetic nature of perturbing fields in higher dimensions, their damping increases. This suggests a complex interplay between dimensionality and the dynamics of black hole phenomena.


title: A$^{2}$-MAE: A spatial-temporal-spectral unified remote sensing pre-training method based on anchor-aware masked autoencoder

abstract: Vast amounts of remote sensing (RS) data provide Earth observations across multiple dimensions, encompassing critical spatial, temporal, and spectral information which is essential for addressing global-scale challenges such as land use monitoring, disaster prevention, and environmental change mitigation. Despite various pre-training methods tailored to the characteristics of RS data, a key limitation persists: the inability to effectively integrate spatial, temporal, and spectral information within a single unified model. To unlock the potential of RS data, we construct a Spatial-Temporal-Spectral Structured Dataset (STSSD) characterized by the incorporation of multiple RS sources, diverse coverage, unified locations within image sets, and heterogeneity within images. Building upon this structured dataset, we propose an Anchor-Aware Masked AutoEncoder method (A$^{2}$-MAE), leveraging intrinsic complementary information from the different kinds of images and geo-information to reconstruct the masked patches during the pre-training phase. A$^{2}$-MAE integrates an anchor-aware masking strategy and a geographic encoding module to comprehensively exploit the properties of RS images. Specifically, the proposed anchor-aware masking strategy dynamically adapts the masking process based on the meta-information of a pre-selected anchor image, thereby facilitating the training on images captured by diverse types of RS sources within one model. Furthermore, we propose a geographic encoding method to leverage accurate spatial patterns, enhancing the model generalization capabilities for downstream applications that are generally location-related. Extensive experiments demonstrate our method achieves comprehensive improvements across various downstream tasks compared with existing RS pre-training methods, including image classification, semantic segmentation, and change detection tasks.


title: AustroTox: A Dataset for Target-Based Austrian German Offensive Language Detection

abstract: Model interpretability in toxicity detection greatly profits from token-level annotations. However, currently such annotations are only available in English. We introduce a dataset annotated for offensive language detection sourced from a news forum, notable for its incorporation of the Austrian German dialect, comprising 4,562 user comments. In addition to binary offensiveness classification, we identify spans within each comment constituting vulgar language or representing targets of offensive statements. We evaluate fine-tuned language models as well as large language models in a zero- and few-shot fashion. The results indicate that while fine-tuned models excel in detecting linguistic peculiarities such as vulgar dialect, large language models demonstrate superior performance in detecting offensiveness in AustroTox. We publish the data and code.


title: CLDTA: Contrastive Learning based on Diagonal Transformer Autoencoder for Cross-Dataset EEG Emotion Recognition

abstract: Recent advances in non-invasive EEG technology have broadened its application in emotion recognition, yielding a multitude of related datasets. Yet, deep learning models struggle to generalize across these datasets due to variations in acquisition equipment and emotional stimulus materials. To address the pressing need for a universal model that fluidly accommodates diverse EEG dataset formats and bridges the gap between laboratory and real-world data, we introduce a novel deep learning framework: the Contrastive Learning based Diagonal Transformer Autoencoder (CLDTA), tailored for EEG-based emotion recognition. The CLDTA employs a diagonal masking strategy within its encoder to extracts full-channel EEG data's brain network knowledge, facilitating transferability to the datasets with fewer channels. And an information separation mechanism improves model interpretability by enabling straightforward visualization of brain networks. The CLDTA framework employs contrastive learning to distill subject-independent emotional representations and uses a calibration prediction process to enable rapid adaptation of the model to new subjects with minimal samples, achieving accurate emotion recognition. Our analysis across the SEED, SEED-IV, SEED-V, and DEAP datasets highlights CLDTA's consistent performance and proficiency in detecting both task-specific and general features of EEG signals related to emotions, underscoring its potential to revolutionize emotion recognition research.


title: Bridging Simulation and Measurements through Ray-Launching Analysis: A Study in a Complex Urban Scenario Environment

abstract: With the rapid increase in mobile subscribers, there is a drive towards achieving higher data rates, prompting the use of higher frequencies in future wireless communication technologies. Wave propagation channel modeling for these frequencies must be considered in conjunction with measurement results. This paper presents a ray-launching (RL)-based simulation in a complex urban scenario characterized by an undulating terrain with a high density of trees. The simulation results tend to closely match the reported measurements when more details are considered. This underscores the benefits of using the RL method, which provides detailed space-time and angle-delay results.


title: Dilute suspensions of Janus rods: the role of bond and shape anisotropy

abstract: Nanometer-sized clusters are often targeted due to their potential applications as nanoreactors or storage/delivery devices. One route to assemble and stabilize finite structures consists in imparting directional bonding patterns between the nanoparticles. When only a portion of the particle surface is able to form an inter-particle bond, finite-size aggregates such as micelles and vesicles may form. Building on this approach, we combine particle shape anisotropy with the directionality of the bonding patterns and investigate the combined effect of particle elongation and surface patchiness on the low density assembly scenario. To this aim, we study the assembly of tip-functionalised Janus hard spherocylinder by means of Monte Carlo simulations. By exploring the effects of changing the interaction strength and range at different packing fractions, we highlight the role played by shape and bond anisotropy on the emerging aggregates (micelles, vesicles, elongated micelles and lamellae). We observe that shape anisotropy plays a crucial role in suppressing phases that are typical to spherical Janus nanoparticles and that a careful tuning of the interaction parameters allows to promote the formation of spherical micelles. These finite-size spherical clusters composed of elongated particles might offer more interstitials and larger surface areas than those offered by micelles of spherical or almost-spherical units, thus enhancing their storage and catalytic properties.


title: Characterizing and Detecting Propaganda-Spreading Accounts on Telegram

abstract: Information-based attacks on social media, such as disinformation campaigns and propaganda, are emerging cybersecurity threats. The security community has focused on countering these threats on social media platforms like X and Reddit. However, they also appear in instant-messaging social media platforms such as WhatsApp, Telegram, and Signal. In these platforms information-based attacks primarily happen in groups and channels, requiring manual moderation efforts by channel administrators. We collect, label, and analyze a large dataset of more than 17 million Telegram comments and messages. Our analysis uncovers two independent, coordinated networks that spread pro-Russian and pro-Ukrainian propaganda, garnering replies from real users. We propose a novel mechanism for detecting propaganda that capitalizes on the relationship between legitimate user messages and propaganda replies and is tailored to the information that Telegram makes available to moderators. Our method is faster, cheaper, and has a detection rate (97.6%) 11.6 percentage points higher than human moderators after seeing only one message from an account. It remains effective despite evolving propaganda.


title: Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams

abstract: Benefiting from the advancements in large language models and cross-modal alignment, existing multi-modal video understanding methods have achieved prominent performance in offline scenario. However, online video streams, as one of the most common media forms in the real world, have seldom received attention. Compared to offline videos, the 'dynamic' nature of online video streams poses challenges for the direct application of existing models and introduces new problems, such as the storage of extremely long-term information, interaction between continuous visual content and 'asynchronous' user questions. Therefore, in this paper we present Flash-VStream, a video-language model that simulates the memory mechanism of human. Our model is able to process extremely long video streams in real-time and respond to user queries simultaneously. Compared to existing models, Flash-VStream achieves significant reductions in inference latency and VRAM consumption, which is intimately related to performing understanding of online streaming video. In addition, given that existing video understanding benchmarks predominantly concentrate on offline scenario, we propose VStream-QA, a novel question answering benchmark specifically designed for online video streaming understanding. Comparisons with popular existing methods on the proposed benchmark demonstrate the superiority of our method for such challenging setting. To verify the generalizability of our approach, we further evaluate it on existing video understanding benchmarks and achieves state-of-the-art performance in offline scenarios as well. All code, models, and datasets are available at the https://invinciblewyq.github.io/vstream-page/


title: Classical simulability of constant-depth linear-optical circuits with noise

abstract: Noise is one of the main obstacles to realizing quantum devices that achieve a quantum computational advantage. A possible approach to minimize the noise effect is to employ shallow-depth quantum circuits since noise typically accumulates as circuit depth grows. In this work, we investigate the complexity of shallow-depth linear-optical circuits under the effects of photon loss and partial distinguishability. By establishing a correspondence between a linear-optical circuit and a bipartite graph, we show that the effects of photon loss and partial distinguishability are equivalent to removing the corresponding vertices. Using this correspondence and percolation theory, we prove that for constant-depth linear-optical circuits with single photons, there is a threshold of loss (noise) rate above which the linear-optical systems can be decomposed into smaller systems with high probability, which enables us to simulate the systems efficiently. Consequently, our result implies that even in shallow-depth circuits where noise is not accumulated enough, its effect may be sufficiently significant to make them efficiently simulable using classical algorithms due to its entanglement structure constituted by shallow-depth circuits.


title: A Unified Pilot Design for Integrated Sensing and Communications

abstract: This paper investigates a unified pilot signal design in an orthogonal frequency division modulation (OFDM)-based integrated sensing and communications (ISAC) system. The novel designed two-dimensional (2D) pilot signal is generated on the delay-Doppler (DD) plane for sensing, while its time-frequency (TF) plane transformation acts as the demodulation reference signal (DMRS) for the OFDM data. The well-designed pilot signal preserves orthogonality with the data in terms of resource occupancy in the TF plane and quasi-orthogonality in terms of codeword in the DD plane. Leveraging these nice properties, we are allowed to implement sensing detection in the DD plane using a simple 2D correlation, taking advantage of the favorable auto-correlation properties of the 2D pilot. In the communication part, the transformed pilot in the TF plane serves as a known DMRS for channel estimation and equalization. The 2D pilot design demonstrates good scalability and can adapt to different delay and Doppler resolution requirements without violating the OFDM data detection and can overcome the fractional Doppler with limited sensing resources. Experimental results show the effective sensing performance of the proposed pilot, with only a small fraction of power shared from the OFDM data,while maintaining satisfactory symbol detection performance in communication.


title: Vector valued piecewise continuous almost automorphic functions and some consequences

abstract: In the present work, for $\mathbb{X}$ a Banach space, the notion of piecewise continuous $\mathbb{Z}$-almost automorphic functions with values in finite dimensional spaces is extended to piecewise continuous $\mathbb{Z}$-almost automorphic functions with values in $\mathbb{X}$. Several properties of this class of functions are provided, in particular it is shown that if $\mathbb{X}$ is a Banach algebra, then this class of functions constitute also a Banach algebra; furthermore, using the theory of $\mathbb{Z}$-almost automorphic functions, a new characterization of compact almost automorphic functions is given. As consequences, with the help of $\mathbb{Z}$-almost automorphic functions, it is presented a simple proof of the characterization of almost automorphic sequences by compact almost automorphic functions; the method permits us to give explicit examples of compact almost automorphic functions which are not almost periodic. Also, using the theory developed here, it is shown that almost automorphic solutions of differential equations with piecewise constant argument are in fact compact almost automorphic. Finally, it is proved that the classical solution of the $1D$ heat equation with continuous $\mathbb{Z}$-almost automorphic source is also continuous $\mathbb{Z}$-almost automorphic; furthermore, we comment applications to the existence and uniqueness of the asymptotically continuous $\mathbb{Z}$-almost automorphic mild solution to abstract integro-differential equations with nonlocal initial conditions.


title: Identification of Conversation Partners from Egocentric Video

abstract: Communicating in noisy, multi-talker environments is challenging, especially for people with hearing impairments. Egocentric video data can potentially be used to identify a user's conversation partners, which could be used to inform selective acoustic amplification of relevant speakers. Recent introduction of datasets and tasks in computer vision enable progress towards analyzing social interactions from an egocentric perspective. Building on this, we focus on the task of identifying conversation partners from egocentric video and describe a suitable dataset. Our dataset comprises 69 hours of egocentric video of diverse multi-conversation scenarios where each individual was assigned one or more conversation partners, providing the labels for our computer vision task. This dataset enables the development and assessment of algorithms for identifying conversation partners and evaluating related approaches. Here, we describe the dataset alongside initial baseline results of this ongoing work, aiming to contribute to the exciting advancements in egocentric video analysis for social settings.