title: Broadband NIR photon upconversion generates NIR persistent luminescence for bioimaging

abstract: Upconversion persistent luminescence (UCPL) phosphors that can be directly charged by near-infrared (NIR) light have gained considerable attention due to their promising applications ranging from photonics to biomedicine. However, current lanthanide-based UCPL phosphors show small absorption cross-sections and low upconversion charging efficiency. The development of UCPL phosphors faces challenges of lacking flexible upconversion charging pathways and poor design flexibility. Herein, we discovered a new lattice defect-mediated broadband photon upconversion process and the accompanied NIR-to-NIR UCPL in Cr-doped zinc gallate nanoparticles. The zinc gallate nanoparticles can be directly activated by broadband NIR light in the 700-1000 nm range to produce persistent luminescence at about 700 nm, which is also readily enhanced by rationally tailoring the lattice defects in the phosphors. This proposed UCPL phosphors achieved a signal-to-background ratio of over 200 in bioimaging by efficiently avoiding interference from autofluorescence and light scattering. Our findings reported the lattice defect-mediated photon upconversion for the first time, which significantly expanded the horizons for the flexible design of NIR-to-NIR UCPL phosphors toward broad applications.


title: Gun Culture in Fringe Social Media

abstract: The increasing frequency of mass shootings in the United States has, unfortunately, become a norm. While the issue of gun control in the US involves complex legal concerns, there are also societal issues at play. One such social issue is so-called "gun culture," i.e., a general set of beliefs and actions related to gun ownership. However relatively little is known about gun culture, and even less is known when it comes to fringe online communities. This is especially worrying considering the aforementioned rise in mass shootings and numerous instances of shooters being radicalized online. To address this gap, we explore gun culture on /k/, 4chan's weapons board. More specifically, using a variety of quantitative techniques, we examine over 4M posts on /k/ and position their discussion within the larger body of theoretical understanding of gun culture. Among other things, our findings suggest that gun culture on /k/ covers a relatively diverse set of topics (with a particular focus on legal discussion), some of which are signals of fetishism.


title: Quantum analog of Landau-Lifshitz-Gilbert dynamics

abstract: The Landau-Lifshitz-Gilbert (LLG) and Landau-Lifshitz (LL) equations play an essential role for describing the dynamics of magnetization in solids. While a quantum analog of the LL dynamics has been proposed in [Phys. Rev. Lett. 110, 147201 (2013)], the corresponding quantum version of LLG remains unknown. Here, we propose such a quantum LLG equation that inherently conserves purity of the quantum state. We examine the quantum LLG dynamics of a dimer consisting of two interacting spin-1/2 particles. Our analysis reveals that, in the case of ferromagnetic coupling, the evolution of initially uncorrelated spins mirrors the classical LLG dynamics. However, in the antiferromagnetic scenario, we observe pronounced deviations from classical behavior, underscoring the unique dynamics of becoming a spinless state, which is non-locally correlated. Moreover, when considering spins that are initially correlated, our study uncovers an unusual form of transient quantum correlation dynamics, which differ significantly from what is typically seen in open quantum systems.


title: A Modified da Vinci Surgical Instrument for OCE based Elasticity Estimation with Deep Learning

abstract: Robot-assisted surgery has advantages compared to conventional laparoscopic procedures, e.g., precise movement of the surgical instruments, improved dexterity, and high-resolution visualization of the surgical field. However, mechanical tissue properties may provide additional information, e.g., on the location of lesions or vessels. While elastographic imaging has been proposed, it is not readily available as an online modality during robot-assisted surgery. We propose modifying a da~Vinci surgical instrument to realize optical coherence elastography (OCE) for quantitative elasticity estimation. The modified da~Vinci instrument is equipped with piezoelectric elements for shear wave excitation and we employ fast optical coherence tomography (OCT) imaging to track propagating wave fields, which are directly related to biomechanical tissue properties. All high-voltage components are mounted at the proximal end outside the patient. We demonstrate that external excitation at the instrument shaft can effectively stimulate shear waves, even when considering damping. Comparing conventional and deep learning-based signal processing, resulting in mean absolute errors of 19.27 kPa and 6.29 kPa, respectively. These results illustrate that precise quantitative elasticity estimates can be obtained. We also demonstrate quantitative elasticity estimation on ex-vivo tissue samples of heart, liver and stomach, and show that the measurements can be used to distinguish soft and stiff tissue types.


title: WSI-SAM: Multi-resolution Segment Anything Model (SAM) for histopathology whole-slide images

abstract: The Segment Anything Model (SAM) marks a significant advancement in segmentation models, offering robust zero-shot abilities and dynamic prompting. However, existing medical SAMs are not suitable for the multi-scale nature of whole-slide images (WSIs), restricting their effectiveness. To resolve this drawback, we present WSI-SAM, enhancing SAM with precise object segmentation capabilities for histopathology images using multi-resolution patches, while preserving its efficient, prompt-driven design, and zero-shot abilities. To fully exploit pretrained knowledge while minimizing training overhead, we keep SAM frozen, introducing only minimal extra parameters and computational overhead. In particular, we introduce High-Resolution (HR) token, Low-Resolution (LR) token and dual mask decoder. This decoder integrates the original SAM mask decoder with a lightweight fusion module that integrates features at multiple scales. Instead of predicting a mask independently, we integrate HR and LR token at intermediate layer to jointly learn features of the same object across multiple resolutions. Experiments show that our WSI-SAM outperforms state-of-the-art SAM and its variants. In particular, our model outperforms SAM by 4.1 and 2.5 percent points on a ductal carcinoma in situ (DCIS) segmentation tasks and breast cancer metastasis segmentation task (CAMELYON16 dataset). The code will be available at https://github.com/HongLiuuuuu/WSI-SAM.


title: Near-Field EM-Based Multistatic Radar Range Estimation

abstract: Radar targets are traditionally modelled as point target reflectors, even in the near-field region. Yet, for radar systems operating at high carrier frequencies and small distances, traditional radar propagation models do not accurately model the scatterer responses. In this paper, a novel electromagnetic-based model is thus developed for the multistatic radar detection of a rectangular plate reflector in the near-field region. This model is applied to an automotive scenario, in which a linear antenna array is spread out at the front of a vehicle, and performs a radar measurement of the distance to the back of the vehicle ahead. Based on the developed received signal model, the maximum likelihood estimator of the range is designed. By exploiting the near-field target model, this estimator is shown to provide a significant gain with respect to traditional range estimators. The impact of the system and scenario parameters, i.e. the carrier frequency, bandwidth and distance to the target, is furthermore evaluated. This analysis shows that the radar resolution in the near-field regime is improved at high carrier frequencies, while saturating to the traditional bandwidth-dependent resolution in the far-field region.


title: To Label or Not to Label: Hybrid Active Learning for Neural Machine Translation

abstract: Active learning (AL) techniques reduce labeling costs for training neural machine translation (NMT) models by selecting smaller representative subsets from unlabeled data for annotation. Diversity sampling techniques select heterogeneous instances, while uncertainty sampling methods select instances with the highest model uncertainty. Both approaches have limitations - diversity methods may extract varied but trivial examples, while uncertainty sampling can yield repetitive, uninformative instances. To bridge this gap, we propose HUDS, a hybrid AL strategy for domain adaptation in NMT that combines uncertainty and diversity for sentence selection. HUDS computes uncertainty scores for unlabeled sentences and subsequently stratifies them. It then clusters sentence embeddings within each stratum using k-MEANS and computes diversity scores by distance to the centroid. A weighted hybrid score that combines uncertainty and diversity is then used to select the top instances for annotation in each AL iteration. Experiments on multi-domain German-English datasets demonstrate the better performance of HUDS over other strong AL baselines. We analyze the sentence selection with HUDS and show that it prioritizes diverse instances having high model uncertainty for annotation in early AL iterations.


title: Belief and Persuasion in Scientific Discourse on Social Media: A Study of the COVID-19 Pandemic

abstract: Research into COVID-19 has been rapidly evolving since the onset of the pandemic. This occasionally results in contradictory recommendations by credible sources of scientific opinion, public health authorities, and medical professionals. In this study, we examine whether this has resulted in a lack of trust in scientific opinion, by examining the belief patterns of social media users and their reactions to statements related to scientific facts. We devise models to mine belief and persuasion in Twitter discourse using semi-supervised approaches, and show the relationship between lack of belief and insurgence of paranoia and conspiracy theories. By investigating these belief patterns, we explore the best persuasion tactics for communicating information related to COVID-19.


title: Hadamard property of the Unruh state for massless fermions on Kerr spacetime : the large $a$ case

abstract: In a recent paper by G\'erard, H\"afner, and Wrochna, the Unruh state for massless fermions on a Kerr spacetime was constructed and the authors showed its Hadmard property in the case of very slowly rotating black holes $\vert a\vert\ll M$. In this note, we extend this result to the full non extreme case $\vert a\vert<M$.


title: Advanced Tumor Segmentation in Medical Imaging: An Ensemble Approach for BraTS 2023 Adult Glioma and Pediatric Tumor Tasks

abstract: Automated segmentation proves to be a valuable tool in precisely detecting tumors within medical images. The accurate identification and segmentation of tumor types hold paramount importance in diagnosing, monitoring, and treating highly fatal brain tumors. The BraTS challenge serves as a platform for researchers to tackle this issue by participating in open challenges focused on tumor segmentation. This study outlines our methodology for segmenting tumors in the context of two distinct tasks from the BraTS 2023 challenge: Adult Glioma and Pediatric Tumors. Our approach leverages two encoder-decoder-based CNN models, namely SegResNet and MedNeXt, for segmenting three distinct subregions of tumors. We further introduce a set of robust postprocessing to improve the segmentation, especially for the newly introduced BraTS 2023 metrics. The specifics of our approach and comprehensive performance analyses are expounded upon in this work. Our proposed approach achieves third place in the BraTS 2023 Adult Glioma Segmentation Challenges with an average of 0.8313 and 36.38 Dice and HD95 scores on the test set, respectively.


title: A noncommutative maximal inequality for Fej\'{e}r means on totally disconnected non-abelian groups

abstract: In this paper, we explore Fourier analysis for noncommutative $L_p$ space-valued functions on $G$, where $G$ is a totally disconnected non-abelian compact group. By additionally assuming that the value of these functions remains invariant within each conjugacy class, we establish a noncommutative maximal inequality for Fej\'er means utilizing the associated character system of $G$. This is an operator-valued version of the classical result due to G\'at. We follow essentially the classical sketch, but due to the noncommutativity, many classical arguments have to be revised. Notably, compared to the classical results. the bounds of our estimates are explicity calculated.


title: Sketches and Classifying Logoi

abstract: Inspired by the theory of classifying topoi for geometric theories, we define rounded sketches and logoi and provide the notion of classifying logos for a rounded sketch. Rounded sketches can be used to axiomatise all the known fragments of infinitary first order logic in $\mathbf{L}_{\infty,\infty}$, in a spectrum ranging from weaker than finitary algebraic to stronger than $\lambda$-geometric for $\lambda$ a regular cardinal. We show that every rounded sketch has an associated classifying logos, having similar properties to the classifying topos of a geometric theory. This amounts to a Diaconescu-type result for rounded sketches and (Morita small) logoi, which generalises the one for classifying topoi.


title: Zonal vs. Nodal Pricing: An Analysis of Different Pricing Rules in the German Day-Ahead Market

abstract: The European electricity market is based on large pricing zones with a uniform day-ahead price. The energy transition leads to changes in supply and demand and increasing redispatch costs. In an attempt to ensure efficient market clearing and congestion management, the EU Commission has mandated the Bidding Zone Review (BZR) to reevaluate the configuration of European bidding zones. Based on a unique data set published in the context of the BZR for the target year 2025, we compare various pricing rules for the German power market. We compare market clearing and pricing for different zonal and nodal models, including their generation costs and associated redispatch costs. In numerical experiments with this dataset, the differences in the average prices in different zones are low. Congestion arises as well, but not necessarily on the cross-zonal interconnectors. The total costs across different configurations are similar and the reduction of standard deviations in prices is also small. This might be different with other load and generation scenarios, but the BZR data is important as it was created to make a decision about splits of the existing bidding zones. Nodal pricing rules lead to the lowest total cost. We also evaluate differences of nodal pricing rules with respect to the necessary uplift payments, which is relevant in the context of the current discussion on non-uniform pricing in the EU. While the study focuses on Germany, the analysis is relevant beyond and feeds into the broader discussion about pricing rules in non-convex markets.


title: Quadratic Riemann-Roch formulas

abstract: In this article, we produce Grothendieck-Riemann-Roch formulas for cohomology theories that are not oriented in the classical sense. We then specialize to the case of cohomology theories that admit a so-called symplectic orientation and show how to compute the relevant Todd classes in that situation. At the end of the article, we illustrate our methods on the Borel character linking Hermitian K-theory and rational MW-motivic cohomology.


title: Deep Limit Order Book Forecasting

abstract: We exploit cutting-edge deep learning methodologies to explore the predictability of high-frequency Limit Order Book mid-price changes for a heterogeneous set of stocks traded on the NASDAQ exchange. In so doing, we release `LOBFrame', an open-source code base to efficiently process large-scale Limit Order Book data and quantitatively assess state-of-the-art deep learning models' forecasting capabilities. Our results are twofold. We demonstrate that the stocks' microstructural characteristics influence the efficacy of deep learning methods and that their high forecasting power does not necessarily correspond to actionable trading signals. We argue that traditional machine learning metrics fail to adequately assess the quality of forecasts in the Limit Order Book context. As an alternative, we propose an innovative operational framework that evaluates predictions' practicality by focusing on the probability of accurately forecasting complete transactions. This work offers academics and practitioners an avenue to make informed and robust decisions on the application of deep learning techniques, their scope and limitations, effectively exploiting emergent statistical properties of the Limit Order Book.


title: Injection and capture of antiprotons in a Penning-Malmberg trap using a drift tube accelerator and degrader foil

abstract: The Antiproton Decelerator (AD) at CERN provides antiproton bunches with a kinetic energy of 5.3 MeV. The Extra-Low ENergy Antiproton ring at CERN, commissioned at the AD in 2018, now supplies a bunch of electron-cooled antiprotons at a fixed energy of 100 keV. The MUSASHI antiproton trap was upgraded by replacing the radio-frequency quadrupole decelerator with a pulsed drift tube to re-accelerate antiprotons and optimize the injection energy into the degrader foils. By increasing the beam energy to 119 keV, a cooled antiproton accumulation efficiency of (26 +- 6)% was achieved.


title: Direct observation of nanometer-scale orbital angular momentum accumulation

abstract: Conversion of charge to orbital angular momentum through the orbital Hall effect (OHE) holds transformative potential for the development of orbital-based electronics, however, it is challenging to directly observe the electrically generated orbital accumulation. Here, we detect the OHE by directly quantifying the orbital accumulation along the edges of a titanium thin film using a scanning transmission electron microscope. We measure the Ti L-edge using electron energy-loss spectroscopy with nanometer resolution and find a sizable orbital accumulation at the sample's outer perimeters, consistent with all signatures expected for the OHE, and determine an orbital diffusion length $\ell_o \approx 7.3$ nm. Our data points to a surprising dependence of the orbital diffusion length on the nano-structural morphology.


title: A Deep Reinforcement Learning Approach for Autonomous Reconfigurable Intelligent Surfaces

abstract: A reconfigurable intelligent surface (RIS) is a prospective wireless technology that enhances wireless channel quality. An RIS is often equipped with passive array of elements and provides cost and power-efficient solutions for coverage extension of wireless communication systems. Without any radio frequency (RF) chains or computing resources, however, the RIS requires control information to be sent to it from an external unit, e.g., a base station (BS). The control information can be delivered by wired or wireless channels, and the BS must be aware of the RIS and the RIS-related channel conditions in order to effectively configure its behavior. Recent works have introduced hybrid RIS structures possessing a few active elements that can sense and digitally process received data. Here, we propose the operation of an entirely autonomous RIS that operates without a control link between the RIS and BS. Using a few sensing elements, the autonomous RIS employs a deep Q network (DQN) based on reinforcement learning in order to enhance the sum rate of the network. Our results illustrate the potential of deploying autonomous RISs in wireless networks with essentially no network overhead.


title: Research and teaching in physics at the University of Franche-Comt\'e 1845-1970

abstract: Recently uncovered archives at the University of Franche-Comt\'e in Besan\c{c}on (France) reveal a rich history of research and teaching in physics since the Faculty of Science was first established in 1845. Here, we describe a selection of notable activities conducted by the named Chairs of Physics during the period 1845-1970. We uncover a long tradition of major contributions to physics education and research, including the production of highly regarded physics textbooks that were widely used in Europe, as well as pioneering contributions to electron diffraction and microscopy, Fourier optics, and holography. These discoveries yield valuable insights into the historical development of physics research in France, and show how even a small provincial university was able to stay up-to-date with international developments across several areas of physics.


title: Global Shipyard Capacities Limiting the Ramp-Up of Global Hydrogen Transport

abstract: Decarbonizing the global energy system requires significant expansions of renewable energy technologies. Given that cost-effective renewable sources are not necessarily situated in proximity to the largest energy demand centers globally, the maritime transportation of low-carbon energy carriers, such as renewable-based hydrogen or ammonia, will be needed. However, whether existent shipyards possess the required capacity to provide the necessary global fleet has not yet been answered. Therefore, this study estimates global tanker demand based on projections for global hydrogen demand, while comparing these projections with historic shipyard production. Our findings reveal a potential bottleneck until 2033-2039 if relying on liquefied hydrogen exclusively. This bottleneck could be circumvented by increasing local hydrogen production, utilizing pipelines, or liquefied ammonia as an energy carrier for hydrogen. Furthermore, the regional concentration of shipyard locations raises concerns about diversification. Increasing demand for container vessels could substantially hinder the scale-up of maritime hydrogen transport.


title: Identifying Galaxy Cluster Mergers with Deep Neural Networks using Idealized Compton-y and X-ray maps

abstract: We present a novel approach to identify galaxy clusters that are undergoing a merger using a deep learning approach. This paper uses massive galaxy clusters spanning $0 \leq z \leq 2$ from \textsc{The Three Hundred} project, a suite of hydrodynamic re-simulations of 324 large galaxy clusters. Mock, idealised Compton-{\it y} and X-ray maps were constructed for the sample, capturing them out to a radius of $2R_{200}$. The idealised nature of these maps mean they do not consider observational effects such as foreground or background astrophysical objects, any spatial resolution limits or restriction on X-ray energy bands. Half of the maps belong to a merging population as defined by a mass increase $\Delta${\it M/M} $\geq$ 0.75, and the other half serve as a control, relaxed population. We employ a convolutional neural network architecture and train the model to classify clusters into one of the groups. A best-performing model was able to correctly distinguish between the two populations with a balanced accuracy (BA) and recall of 0.77, ROC-AUC of 0.85, PR-AUC of 0.55 and $F_{1}$ score of 0.53. Using a multichannel model relative to a single channel model, we obtain a 3\% improvement in BA score, and a 6\% improvement in $F_{1}$ score. We use a saliency interpretation approach to discern the regions most important to each classification decision. By analysing radially binned saliency values we find a preference to utilise regions out to larger distances for mergers with respect to non-mergers, greater than $\sim1.2 R_{200}$ and $\sim0.7 R_{200}$ for SZ and X-ray respectively.


title: EventRPG: Event Data Augmentation with Relevance Propagation Guidance

abstract: Event camera, a novel bio-inspired vision sensor, has drawn a lot of attention for its low latency, low power consumption, and high dynamic range. Currently, overfitting remains a critical problem in event-based classification tasks for Spiking Neural Network (SNN) due to its relatively weak spatial representation capability. Data augmentation is a simple but efficient method to alleviate overfitting and improve the generalization ability of neural networks, and saliency-based augmentation methods are proven to be effective in the image processing field. However, there is no approach available for extracting saliency maps from SNNs. Therefore, for the first time, we present Spiking Layer-Time-wise Relevance Propagation rule (SLTRP) and Spiking Layer-wise Relevance Propagation rule (SLRP) in order for SNN to generate stable and accurate CAMs and saliency maps. Based on this, we propose EventRPG, which leverages relevance propagation on the spiking neural network for more efficient augmentation. Our proposed method has been evaluated on several SNN structures, achieving state-of-the-art performance in object recognition tasks including N-Caltech101, CIFAR10-DVS, with accuracies of 85.62% and 85.55%, as well as action recognition task SL-Animals with an accuracy of 91.59%. Our code is available at https://github.com/myuansun/EventRPG.


title: Static Grouping Strategy Design for Beyond Diagonal Reconfigurable Intelligent Surfaces

abstract: Beyond diagonal reconfigurable intelligent surface (BD-RIS) extends conventional RIS through novel architectures, such as group-connected RIS, with scattering matrix not restricted to being diagonal. However, it remains unexplored how to optimally group the elements in group-connected RISs to maximize the performance while maintaining a low-complexity circuit. In this study, we propose and model BD-RIS with a static grouping strategy optimized based on the channel statistics. After formulating the corresponding problems, we design the grouping in single- and multi-user systems. Numerical results reveal the benefits of grouping optimization, i.e., up to 60% sum rate improvement, especially in highly correlated channels.


title: Rational Gluing in Edge Replacement Systems

abstract: In this paper, we prove the rationality of the gluing relation of edge replacement systems, which were introduced for studying rearrangement groups of fractals. More precisely, we describe an algorithmic procedure for building a finite state automaton that recognizes pairs or equivalent sequences that are glued in the fractal. This fits in recent interest towards the rationality of gluing relations on totally disconnected compact metrizable spaces.


title: Folding $\pi$

abstract: It is well known that the set of origami constructible numbers is larger than the classical straight-edge and compass constructible numbers. However, the Huzita-Justin-Hatori origami constructible numbers remain algebraic so that the transcendental number $\pi$ can only be approximated using a finite number of straight line folds. Using these methods we give a convergent sequence for folding $\pi$ as well as other methods to approximate $\pi$. Folding along curved creases, however, allows for the construction of transcendental numbers. We here give a method to construct $\pi$ exactly by folding along a parabola, and we discuss generalizations for folding other transcendental numbers such as $\Gamma(1/4)$.


title: Nonlinear Kinematics of Recursive Origami Inspired by the Spidron

abstract: Non-periodic folding of periodic crease patterns paves the way to novel nonlinear phenomena that cannot be feasible through periodic folding. This paper focuses on the non-periodic folding of recursive crease patterns generalized from Spidron. Although it is known that the Spidron has a $1$-DOF isotropic rigid folding motion, its general kinematics and dependence on the crease pattern remain unclear. Using the kinematics of a single unit cell of the Spidron and the recursive construction of the folded state of multiple unit cells, we consider the folding of the Spidron that is not necessarily isotropic. We found that as the number of unit cells increases, the non-periodic folding is restricted and the isotropic folding becomes dominant. Then, we analyze the three kinds of isotropic folding modes by constructing $1$-dimensional dynamical systems governing each of them. We show that these systems can possess different recursive natures depending on folding modes even in an identical crease pattern. Furthermore, we show their novel nonlinear nature, including the period-doubling cascade leading to the emergence of chaos.


title: Whittle Index Based User Association in Dense Millimeter Wave Networks

abstract: We address the problem of user association in a dense millimeter wave (mmWave) network, in which each arriving user brings a file containing a random number of packets and each time slot is divided into multiple mini-slots. This problem is an instance of the restless multi-armed bandit problem, and is provably hard to solve. Using a technique introduced by Whittle, we relax the hard per-stage constraint that each arriving user must be associated with exactly one mmWave base station (mBS) to a long-term constraint and then use the Lagrangian multiplier technique to convert the problem into an unconstrained problem. This decouples the process governing the system into separate Markov Decision Processes at different mBSs. We prove that the problem is Whittle indexable, present a scheme for computing the Whittle indices of different mBSs, and propose an association scheme under which, each arriving user is associated with the mBS with the smallest value of the Whittle index. Using extensive simulations, we show that the proposed Whittle index based scheme outperforms several user association schemes proposed in prior work in terms of various performance metrics such as average cost, delay, throughput, and Jain's fairness index.


title: The elastic stored energy of initially strained, or stressed, materials: restrictions and third-order expansions

abstract: A large variety of materials, widely encountered both in engineering applications and in the biological realm, are characterised by a non-vanishing internal stress distribution, even in the absence of external deformations or applied forces. These initial stresses are due to initial strains or microstructural changes, such as thermal expansion, manufacturing processes, volumetric growth, remodelling, etc. A common constitutive choice for modelling such materials extends the classical approach in the field theory of continuum mechanics to include, explicitly, the initial stress or strain in the elastic stored energy function. Here, we discuss why these energy functions need to satisfy some restrictions to avoid unphysical behaviours, such as non-conservation of energy, {and we derive the required restrictions from the classical assumptions of elasticity.} To illustrate their need, we perform a rigorous asymptotic expansion for proving that these restrictions on stored energy functions that depend on the strain and initial stress are required for consistency with strain energy functions of classical third-order weakly nonlinear elasticity.


title: CLIP-EBC: CLIP Can Count Accurately through Enhanced Blockwise Classification

abstract: The CLIP (Contrastive Language-Image Pretraining) model has exhibited outstanding performance in recognition problems, such as zero-shot image classification and object detection. However, its ability to count remains understudied due to the inherent challenges of transforming counting--a regression task--into a recognition task. In this paper, we investigate CLIP's potential in counting, focusing specifically on estimating crowd sizes. Existing classification-based crowd-counting methods have encountered issues, including inappropriate discretization strategies, which impede the application of CLIP and result in suboptimal performance. To address these challenges, we propose the Enhanced Blockwise Classification (EBC) framework. In contrast to previous methods, EBC relies on integer-valued bins that facilitate the learning of robust decision boundaries. Within our model-agnostic EBC framework, we introduce CLIP-EBC, the first fully CLIP-based crowd-counting model capable of generating density maps. Comprehensive evaluations across diverse crowd-counting datasets demonstrate the state-of-the-art performance of our methods. Particularly, EBC can improve existing models by up to 76.9%. Moreover, our CLIP-EBC model surpasses current crowd-counting methods, achieving mean absolute errors of 55.0 and 6.3 on ShanghaiTech part A and part B datasets, respectively. The code will be made publicly available.


title: Regularity and trend to equilibrium for a non-local advection-diffusion model of active particles

abstract: We establish regularity and, under suitable assumptions, convergence to stationary states for weak solutions of a parabolic equation with a non-linear non-local drift term; this equation was derived from a model of active Brownian particles with repulsive interactions in a previous work, which incorporates advection-diffusion processes both in particle position and orientation. We apply De Giorgi's method and differentiate the equation with respect to the time variable iteratively to show that weak solutions become smooth away from the initial time. This strategy requires that we obtain improved integrability estimates in order to cater for the presence of the non-local drift. The instantaneous smoothing effect observed for weak solutions is shown to also hold for very weak solutions arising from distributional initial data; the proof of this result relies on a uniqueness theorem in the style of M.~Pierre for low-regularity solutions. The convergence to stationary states is proved under a smallness assumption on the drift term.


title: Observation of quantum oscillations near the Mott-Ioffe-Regel limit in CaAs3

abstract: The Mott-Ioffe-Regel limit sets the lower bound of carrier mean free path for coherent quasiparticle transport. Metallicity beyond this limit is of great interest because it is often closely related to quantum criticality and unconventional superconductivity. Progress along this direction mainly focuses on the strange-metal behaviors originating from the evolution of quasiparticle scattering rate such as linear-in-temperature resistivity, while the quasiparticle coherence phenomena in this regime are much less explored due to the short mean free path at the diffusive bound. Here we report the observation of quantum oscillations from Landau quantization near the Mott-Ioffe-Regel limit in CaAs3. Despite the insulator-like temperature dependence of resistivity, CaAs3 presents giant magnetoresistance and prominent Shubnikov-de Haas oscillations from Fermi surfaces, indicating highly coherent band transport. In contrast, the quantum oscillation is absent in the magnetic torque. The quasiparticle effective mass increases systematically with magnetic fields, manifesting a much larger value than the expectation given by magneto-infrared spectroscopy. It suggests a strong many-body renormalization effect near Fermi surface. We find that these unconventional behaviors may be explained by the interplay between the mobility edge and the van Hove singularity, which results in the formation of coherent cyclotron orbits emerging at the diffusive bound. Our results call for further study on the electron correlation effect of the van Hove singularity.


title: DA-PFL: Dynamic Affinity Aggregation for Personalized Federated Learning

abstract: Personalized federated learning becomes a hot research topic that can learn a personalized learning model for each client. Existing personalized federated learning models prefer to aggregate similar clients with similar data distribution to improve the performance of learning models. However, similaritybased personalized federated learning methods may exacerbate the class imbalanced problem. In this paper, we propose a novel Dynamic Affinity-based Personalized Federated Learning model (DA-PFL) to alleviate the class imbalanced problem during federated learning. Specifically, we build an affinity metric from a complementary perspective to guide which clients should be aggregated. Then we design a dynamic aggregation strategy to dynamically aggregate clients based on the affinity metric in each round to reduce the class imbalanced risk. Extensive experiments show that the proposed DA-PFL model can significantly improve the accuracy of each client in three real-world datasets with state-of-the-art comparison methods.


title: TH\"OR-MAGNI: A Large-scale Indoor Motion Capture Recording of Human Movement and Robot Interaction

abstract: We present a new large dataset of indoor human and robot navigation and interaction, called TH\"OR-MAGNI, that is designed to facilitate research on social navigation: e.g., modelling and predicting human motion, analyzing goal-oriented interactions between humans and robots, and investigating visual attention in a social interaction context. TH\"OR-MAGNI was created to fill a gap in available datasets for human motion analysis and HRI. This gap is characterized by a lack of comprehensive inclusion of exogenous factors and essential target agent cues, which hinders the development of robust models capable of capturing the relationship between contextual cues and human behavior in different scenarios. Unlike existing datasets, TH\"OR-MAGNI includes a broader set of contextual features and offers multiple scenario variations to facilitate factor isolation. The dataset includes many social human-human and human-robot interaction scenarios, rich context annotations, and multi-modal data, such as walking trajectories, gaze tracking data, and lidar and camera streams recorded from a mobile robot. We also provide a set of tools for visualization and processing of the recorded data. TH\"OR-MAGNI is, to the best of our knowledge, unique in the amount and diversity of sensor data collected in a contextualized and socially dynamic environment, capturing natural human-robot interactions.


title: Optical Calibration of Holographic Acoustic Tweezers

abstract: Recently, acoustic tweezers based on an array of ultrasonic transducers have been reported taking inspiration from holographic optical tweezers. In the latter technique, the calibration of the optical trap is an essential procedure to obtain the trap stiffnesses. On the contrary, in the case of acoustic tweezers the calibration of the acoustic forces is seldom carried out. To cover this gap, in this work, we adapt the calibration protocols employed in optical tweezers to acoustic tweezers based on arrays of ultrasonic transducers. We measure trap stiffnesses in the mN/m range that are consistent with theoretical estimates obtained by calculations of the acoustic radiation forces based on the Gorkov potential. This work gives a common framework to the optical and acoustic manipulation communities, paving the way to a consistent calibration of hybrid acoustooptical setups.


title: Duality and hidden symmetry breaking in the q-deformed Affleck-Kennedy-Lieb-Tasaki model

abstract: We revisit the question of string order and hidden symmetry breaking in the q-deformed AKLT model, an example of a spin chain that possesses generalized symmetry. We first argue that the non-local Kennedy-Tasaki duality transformation that was previously proposed to relate the string order to a local order parameter leads to a non-local Hamiltonian and thus does not provide a physically adequate description of the symmetry breaking. We then present a modified non-local transformation which is based on a recently developed generalization of Witten's Conjugation to frustration-free lattice models and capable of resolving this issue.

categories: cond-mat.str-el cond-mat.stat-mech hep-th math-ph math.MP


title: Adversarial Training with OCR Modality Perturbation for Scene-Text Visual Question Answering

abstract: Scene-Text Visual Question Answering (ST-VQA) aims to understand scene text in images and answer questions related to the text content. Most existing methods heavily rely on the accuracy of Optical Character Recognition (OCR) systems, and aggressive fine-tuning based on limited spatial location information and erroneous OCR text information often leads to inevitable overfitting. In this paper, we propose a multimodal adversarial training architecture with spatial awareness capabilities. Specifically, we introduce an Adversarial OCR Enhancement (AOE) module, which leverages adversarial training in the embedding space of OCR modality to enhance fault-tolerant representation of OCR texts, thereby reducing noise caused by OCR errors. Simultaneously, We add a Spatial-Aware Self-Attention (SASA) mechanism to help the model better capture the spatial relationships among OCR tokens. Various experiments demonstrate that our method achieves significant performance improvements on both the ST-VQA and TextVQA datasets and provides a novel paradigm for multimodal adversarial training.


title: Silico-centric Theory of Mind

abstract: Theory of Mind (ToM) refers to the ability to attribute mental states, such as beliefs, desires, intentions, and knowledge, to oneself and others, and to understand that these mental states can differ from one's own and from reality. We investigate ToM in environments with multiple, distinct, independent AI agents, each possessing unique internal states, information, and objectives. Inspired by human false-belief experiments, we present an AI ('focal AI') with a scenario where its clone undergoes a human-centric ToM assessment. We prompt the focal AI to assess whether its clone would benefit from additional instructions. Concurrently, we give its clones the ToM assessment, both with and without the instructions, thereby engaging the focal AI in higher-order counterfactual reasoning akin to human mentalizing--with respect to humans in one test and to other AI in another. We uncover a discrepancy: Contemporary AI demonstrates near-perfect accuracy on human-centric ToM assessments. Since information embedded in one AI is identically embedded in its clone, additional instructions are redundant. Yet, we observe AI crafting elaborate instructions for their clones, erroneously anticipating a need for assistance. An independent referee AI agrees with these unsupported expectations. Neither the focal AI nor the referee demonstrates ToM in our 'silico-centric' test.


title: SELECTOR: Heterogeneous graph network with convolutional masked autoencoder for multimodal robust prediction of cancer survival

abstract: Accurately predicting the survival rate of cancer patients is crucial for aiding clinicians in planning appropriate treatment, reducing cancer-related medical expenses, and significantly enhancing patients' quality of life. Multimodal prediction of cancer patient survival offers a more comprehensive and precise approach. However, existing methods still grapple with challenges related to missing multimodal data and information interaction within modalities. This paper introduces SELECTOR, a heterogeneous graph-aware network based on convolutional mask encoders for robust multimodal prediction of cancer patient survival. SELECTOR comprises feature edge reconstruction, convolutional mask encoder, feature cross-fusion, and multimodal survival prediction modules. Initially, we construct a multimodal heterogeneous graph and employ the meta-path method for feature edge reconstruction, ensuring comprehensive incorporation of feature information from graph edges and effective embedding of nodes. To mitigate the impact of missing features within the modality on prediction accuracy, we devised a convolutional masked autoencoder (CMAE) to process the heterogeneous graph post-feature reconstruction. Subsequently, the feature cross-fusion module facilitates communication between modalities, ensuring that output features encompass all features of the modality and relevant information from other modalities. Extensive experiments and analysis on six cancer datasets from TCGA demonstrate that our method significantly outperforms state-of-the-art methods in both modality-missing and intra-modality information-confirmed cases. Our codes are made available at https://github.com/panliangrui/Selector.


title: Parametric tuning of dynamical phase transitions in ultracold reactions

abstract: Advances in ultracold chemistry have led to the possibility of a coherent transformation between ultracold atoms and molecules including between completely bosonic condensates. Such transformations are enabled by the magneto-association of atoms at a Feshbach resonance which results in a passage through a quantum critical point. In this study, we show that the presence of generic interaction between the formed molecules can fundamentally alter the nature of the critical point, change the yield of the reaction and the order of the consequent phase transition. We find that the correlations introduced by this rather general interaction induce nontrivial many-body physics such as coherent oscillations between atoms and molecules, and a selective formation of squeezed molecular quantum states and quantum cat states. We provide analytical and numerical descriptions of these many-body effects, along with scaling laws for the reaction yield in both the adiabatic and non-adiabatic regimes, and highlight the potential experimental relevance in quantum sensing.


title: Exploration at the high-energy frontier: ATLAS Run 2 searches investigating the exotic jungle beyond the Standard Model

abstract: The Large Hadron Collider is at the high-energy frontier of particle physics, having produced proton$-$proton collisions during Run 2, from 2015 to 2018, at an unprecedented centre-of-mass energy of 13 TeV. The ATLAS experiment has a broad programme to thoroughly explore this uncharted territory, to seek out new exotic particles predicted by theories that boldly go beyond the Standard Model. Although the Standard Model has been very successful, it leaves many questions unanswered, prompting novel ideas about particles that could be hiding in the data, waiting to be discovered by intrepid explorers. These include dark-matter candidates, hidden-sector particles, new vector resonances, leptoquarks, and vector-like quarks, to name a few examples. Searches for new particles are reported here, with the exception of searches for supersymmetry or extended Higgs sectors as these are the subjects of separate reports.


title: Long-time weak convergence analysis of a semi-discrete scheme for stochastic Maxwell equations

abstract: It is known from the monograph [1, Chapter 5] that the weak convergence analysis of numerical schemes for stochastic Maxwell equations is an unsolved problem. This paper aims to fill the gap by establishing the long-time weak convergence analysis of the semi-implicit Euler scheme for stochastic Maxwell equations. Based on analyzing the regularity of transformed Kolmogorov equation associated to stochastic Maxwell equations and constructing a proper continuous adapted auxiliary process for the semi-implicit scheme, we present the long-time weak convergence analysis for this scheme and prove that the weak convergence order is one, which is twice the strong convergence order. As applications of this result, we obtain the convergence order of the numerical invariant measure, the strong law of large numbers and central limit theorem related to the numerical solution, and the error estimate of the multi-level Monte Carlo estimator. As far as we know, this is the first result on the weak convergence order for stochastic Maxwell equations.


title: Anatomical Structure-Guided Medical Vision-Language Pre-training

abstract: Learning medical visual representations through vision-language pre-training has reached remarkable progress. Despite the promising performance, it still faces challenges, i.e., local alignment lacks interpretability and clinical relevance, and the insufficient internal and external representation learning of image-report pairs. To address these issues, we propose an Anatomical Structure-Guided (ASG) framework. Specifically, we parse raw reports into triplets <anatomical region, finding, existence>, and fully utilize each element as supervision to enhance representation learning. For anatomical region, we design an automatic anatomical region-sentence alignment paradigm in collaboration with radiologists, considering them as the minimum semantic units to explore fine-grained local alignment. For finding and existence, we regard them as image tags, applying an image-tag recognition decoder to associate image features with their respective tags within each sample and constructing soft labels for contrastive learning to improve the semantic association of different image-report pairs. We evaluate the proposed ASG framework on two downstream tasks, including five public benchmarks. Experimental results demonstrate that our method outperforms the state-of-the-art methods.


title: Seed-based information retrieval in networks of research publications: Evaluation of direct citations, bibliographic coupling, co-citations and PubMed related article score

abstract: In this contribution, we deal with seed-based information retrieval in networks of research publications. Using systematic reviews as a baseline, and publication data from the NIH Open Citation Collection, we compare the performance of the three citation-based approaches direct citation, co-citation, and bibliographic coupling with respect to recall and precision measures. In addition, we include the PubMed Related Article score as well as combined approaches in the comparison. We also provide a fairly comprehensive review of earlier research in which citation relations have been used for information retrieval purposes. The results show an advantage for co-citation over bibliographic coupling and direct citation. However, combining the three approaches outperforms the exclusive use of co-citation in the study. The results further indicate, in line with previous research, that combining citation-based approaches with textual approaches enhances the performance of seed-based information retrieval. The results from the study may guide approaches combining citation-based and textual approaches in their choice of citation similarity measures. We suggest that future research use more structured approaches to evaluate methods for seed-based retrieval of publications, including comparative approaches as well as the elaboration of common data sets and baselines for evaluation.


title: Select and Distill: Selective Dual-Teacher Knowledge Transfer for Continual Learning on Vision-Language Models

abstract: Large-scale vision-language models (VLMs) have shown a strong zero-shot generalization capability on unseen-domain data. However, when adapting pre-trained VLMs to a sequence of downstream tasks, they are prone to forgetting previously learned knowledge and degrade their zero-shot classification capability. To tackle this problem, we propose a unique Selective Dual-Teacher Knowledge Transfer framework that leverages the most recent fine-tuned and the original pre-trained VLMs as dual teachers to preserve the previously learned knowledge and zero-shot capabilities, respectively. With only access to an unlabeled reference dataset, our proposed framework performs a selective knowledge distillation mechanism by measuring the feature discrepancy from the dual teacher VLMs. Consequently, our selective dual-teacher knowledge distillation would mitigate catastrophic forgetting of previously learned knowledge while preserving the zero-shot capabilities from pre-trained VLMs. Through extensive experiments on benchmark datasets, we show that our proposed framework is favorable against state-of-the-art continual learning approaches for preventing catastrophic forgetting and zero-shot degradation.


title: A complete logic for causal consistency

abstract: The $\mathrm{Caus}[-]$ construction takes a base category of ``raw materials'' and builds a category of higher order causal processes, that is a category whose types encode causal (a.k.a. signalling) constraints between collections of systems. Notable examples are categories of higher-order stochastic maps and higher-order quantum channels. Well-typedness in $\mathrm{Caus}[-]$ corresponds to a composition of processes being causally consistent, in the sense that any choice of local processes of the prescribed types yields an overall process respecting causality constraints. It follows that closed processes always occur with probability 1, ruling out e.g. causal paradoxes arising from time loops. It has previously been shown that $\mathrm{Caus}[\mathcal{C}]$ gives a model of MLL+MIX and BV logic, hence these logics give sufficient conditions for causal consistency, but they fail to provide a complete characterisation. In this follow-on work, we introduce graph types as a tool to examine causal structures over graphs in this model. We explore their properties, standard forms, and equivalent definitions; in particular, a process obeys all signalling constraints of the graph iff it is expressible as an affine combination of factorisations into local causal processes connected according to the edges of the graph. The properties of graph types are then used to prove completeness for causal consistency of a new causal logic that conservatively extends pomset logic. The crucial extra ingredient is a notion of distinguished atoms that correspond to first-order states, which only admit a flow of information in one direction. Using the fact that causal logic conservatively extends pomset logic, we finish by giving a physically-meaningful interpretation to a separating statement between pomset and BV.


title: More than words: Advancements and challenges in speech recognition for singing

abstract: This paper addresses the challenges and advancements in speech recognition for singing, a domain distinctly different from standard speech recognition. Singing encompasses unique challenges, including extensive pitch variations, diverse vocal styles, and background music interference. We explore key areas such as phoneme recognition, language identification in songs, keyword spotting, and full lyrics transcription. I will describe some of my own experiences when performing research on these tasks just as they were starting to gain traction, but will also show how recent developments in deep learning and large-scale datasets have propelled progress in this field. My goal is to illuminate the complexities of applying speech recognition to singing, evaluate current capabilities, and outline future research directions.


title: Reflexivity and Hochschild Cohomology

abstract: Reflexive DG-categories were defined by Kuznetsov and Shinder as generalisations of smooth and proper DG-categories. Over a perfect field, they include all projective schemes and finite dimensional algebras. Smooth and proper DG-categories are the dualizable objects in the symmetric monoidal category of DG-categories localised at Morita equivalences. We show the reflexive DG-categories are the reflexive objects in this monoidal category. Using this perspective we prove that the Hochschild cohomology of a reflexive DG-category is isomorphic to that of its derived category of cohomologically finite modules.


title: Recursive Causal Discovery

abstract: Causal discovery, i.e., learning the causal graph from data, is often the first step toward the identification and estimation of causal effects, a key requirement in numerous scientific domains. Causal discovery is hampered by two main challenges: limited data results in errors in statistical testing and the computational complexity of the learning task is daunting. This paper builds upon and extends four of our prior publications (Mokhtarian et al., 2021; Akbari et al., 2021; Mokhtarian et al., 2022, 2023a). These works introduced the concept of removable variables, which are the only variables that can be removed recursively for the purpose of causal discovery. Presence and identification of removable variables allow recursive approaches for causal discovery, a promising solution that helps to address the aforementioned challenges by reducing the problem size successively. This reduction not only minimizes conditioning sets in each conditional independence (CI) test, leading to fewer errors but also significantly decreases the number of required CI tests. The worst-case performances of these methods nearly match the lower bound. In this paper, we present a unified framework for the proposed algorithms, refined with additional details and enhancements for a coherent presentation. A comprehensive literature review is also included, comparing the computational complexity of our methods with existing approaches, showcasing their state-of-the-art efficiency. Another contribution of this paper is the release of RCD, a Python package that efficiently implements these algorithms. This package is designed for practitioners and researchers interested in applying these methods in practical scenarios. The package is available at github.com/ban-epfl/rcd, with comprehensive documentation provided at rcdpackage.com.


title: CRB Analysis for Mixed-ADC Based DOA Estimation

abstract: We consider a mixed analog-to-digital converter (ADC) based architecture consisting of high-precision and one-bit ADCs with the antenna-varying threshold for direction of arrival (DOA) estimation using a uniform linear array (ULA), which utilizes fixed but different thresholds for one-bit ADCs across different receive antennas. The Cram{\'e}r-Rao bound (CRB) with the antenna-varying threshold is obtained. Then based on the lower bound of the CRB, we derive the asymptotic CRB of the DOA, which depends on the placement of mixed-ADC. Our analysis shows that distributing high-precision ADCs evenly around the two edges of the ULA yields improved performance. This result can be extended to a more general case where the ULA is equipped with two types of ADCs with different quantization precisions. To efficiently obtain the maximum likelihood DOA estimates, we propose a two-step algorithm. Firstly, we formulate the model as a sparse signal representation problem, and modify the sparse learning via iterative minimization (SLIM) approach to the mixed-ADC based DOA estimation. In the second step, we use the relaxation-based approach to cyclically refine the estimates of SLIM, further enhancing the DOA estimation performance. Numerical examples are presented to demonstrate the validity of the CRB analysis and the effectiveness of our methods.


title: StainFuser: Controlling Diffusion for Faster Neural Style Transfer in Multi-Gigapixel Histology Images

abstract: Stain normalization algorithms aim to transform the color and intensity characteristics of a source multi-gigapixel histology image to match those of a target image, mitigating inconsistencies in the appearance of stains used to highlight cellular components in the images. We propose a new approach, StainFuser, which treats this problem as a style transfer task using a novel Conditional Latent Diffusion architecture, eliminating the need for handcrafted color components. With this method, we curate SPI-2M the largest stain normalization dataset to date of over 2 million histology images with neural style transfer for high-quality transformations. Trained on this data, StainFuser outperforms current state-of-the-art GAN and handcrafted methods in terms of the quality of normalized images. Additionally, compared to existing approaches, it improves the performance of nuclei instance segmentation and classification models when used as a test time augmentation method on the challenging CoNIC dataset. Finally, we apply StainFuser on multi-gigapixel Whole Slide Images (WSIs) and demonstrate improved performance in terms of computational efficiency, image quality and consistency across tiles over current methods.


title: Rethinking Autoencoders for Medical Anomaly Detection from A Theoretical Perspective

abstract: Medical anomaly detection aims to identify abnormal findings using only normal training data, playing a crucial role in health screening and recognizing rare diseases. Reconstruction-based methods, particularly those utilizing autoencoders (AEs), are dominant in this field. They work under the assumption that AEs trained on only normal data cannot reconstruct unseen abnormal regions well, thereby enabling the anomaly detection based on reconstruction errors. However, this assumption does not always hold due to the mismatch between the reconstruction training objective and the anomaly detection task objective, rendering these methods theoretically unsound. This study focuses on providing a theoretical foundation for AE-based reconstruction methods in anomaly detection. By leveraging information theory, we elucidate the principles of these methods and reveal that the key to improving AE in anomaly detection lies in minimizing the information entropy of latent vectors. Experiments on four datasets with two image modalities validate the effectiveness of our theory. To the best of our knowledge, this is the first effort to theoretically clarify the principles and design philosophy of AE for anomaly detection. Code will be available upon acceptance.


title: The Existential Closedness and Zilber-Pink Conjectures

abstract: In this paper we survey the history of, and recent developments on, two major conjectures originating in Zilber's model-theoretic work on complex exponentiation -- Existential Closedness and Zilber-Pink. The main focus is on the modular versions of these conjectures and specifically on novel variants incorporating the derivatives of modular functions. The functional analogues of all the conjectures that we consider are theorems which are presented too. The paper also contains some new results and conjectures.


title: Pushing in the Dark: A Reactive Pushing Strategy for Mobile Robots Using Tactile Feedback

abstract: For mobile robots, navigating cluttered or dynamic environments often necessitates non-prehensile manipulation, particularly when faced with objects that are too large, irregular, or fragile to grasp. The unpredictable behavior and varying physical properties of these objects significantly complicate manipulation tasks. To address this challenge, this manuscript proposes a novel Reactive Pushing Strategy. This strategy allows a mobile robot to dynamically adjust its base movements in real-time to achieve successful pushing maneuvers towards a target location. Notably, our strategy adapts the robot motion based on changes in contact location obtained through the tactile sensor covering the base, avoiding dependence on object-related assumptions and its modeled behavior. The effectiveness of the Reactive Pushing Strategy was initially evaluated in the simulation environment, where it significantly outperformed the compared baseline approaches. Following this, we validated the proposed strategy through real-world experiments, demonstrating the robot capability to push objects to the target points located in the entire vicinity of the robot. In both simulation and real-world experiments, the object-specific properties (shape, mass, friction, inertia) were altered along with the changes in target locations to assess the robustness of the proposed method comprehensively.


title: Partially coherent beam: Theory and simulation

abstract: Since the development of lasers, we have continuously sought to advance techniques and theory to obtain beams with a high degree of coherence, as natural light sources provide incoherent light. However, there are applications where it is advantageous to use partially coherent (PC) beams in a controlled manner, such as in propagation through turbulent media. To generate a PC beam in the laboratory or in simulations, specific theories and methods are required. In this article, we provide an introduction to PC beam theory, describing how to generate them through modal decompositions and a step-by-step guide for simulating and analyzing beam generation inspired by experiments. To illustrate the methods, we present Gaussian Schell-Model beams as an example.


title: Annotation Free Semantic Segmentation with Vision Foundation Models

abstract: Semantic Segmentation is one of the most challenging vision tasks, usually requiring large amounts of training data with expensive pixel level annotations. With the success of foundation models and especially vision-language models, recent works attempt to achieve zeroshot semantic segmentation while requiring either large-scale training or additional image/pixel level annotations. In this work, we generate free annotations for any semantic segmentation dataset using existing foundation models. We use CLIP to detect objects and SAM to generate high quality object masks. Next, we build a lightweight module on top of a self-supervised vision encoder, DinoV2, to align the patch features with a pretrained text encoder for zeroshot semantic segmentation. Our approach can bring language-based semantics to any pretrained vision encoder with minimal training. Our module is lightweight, uses foundation models as the sole source of supervision and shows impressive generalization capability from little training data with no annotation.


title: Enabling Waypoint Generation for Collaborative Robots using LLMs and Mixed Reality

abstract: Programming a robotic is a complex task, as it demands the user to have a good command of specific programming languages and awareness of the robot's physical constraints. We propose a framework that simplifies robot deployment by allowing direct communication using natural language. It uses large language models (LLM) for prompt processing, workspace understanding, and waypoint generation. It also employs Augmented Reality (AR) to provide visual feedback of the planned outcome. We showcase the effectiveness of our framework with a simple pick-and-place task, which we implement on a real robot. Moreover, we present an early concept of expressive robot behavior and skill generation that can be used to communicate with the user and learn new skills (e.g., object grasping).


title: MOTPose: Multi-object 6D Pose Estimation for Dynamic Video Sequences using Attention-based Temporal Fusion

abstract: Cluttered bin-picking environments are challenging for pose estimation models. Despite the impressive progress enabled by deep learning, single-view RGB pose estimation models perform poorly in cluttered dynamic environments. Imbuing the rich temporal information contained in the video of scenes has the potential to enhance models ability to deal with the adverse effects of occlusion and the dynamic nature of the environments. Moreover, joint object detection and pose estimation models are better suited to leverage the co-dependent nature of the tasks for improving the accuracy of both tasks. To this end, we propose attention-based temporal fusion for multi-object 6D pose estimation that accumulates information across multiple frames of a video sequence. Our MOTPose method takes a sequence of images as input and performs joint object detection and pose estimation for all objects in one forward pass. It learns to aggregate both object embeddings and object parameters over multiple time steps using cross-attention-based fusion modules. We evaluate our method on the physically-realistic cluttered bin-picking dataset SynPick and the YCB-Video dataset and demonstrate improved pose estimation accuracy as well as better object detection accuracy


title: Large deviations of one-hidden-layer neural networks

abstract: We study large deviations in the context of stochastic gradient descent for one-hidden-layer neural networks with quadratic loss. We derive a quenched large deviation principle, where we condition on an initial weight measure, and an annealed large deviation principle for the empirical weight evolution during training when letting the number of neurons and the number of training iterations simultaneously tend to infinity. The weight evolution is treated as an interacting dynamic particle system. The distinctive aspect compared to prior work on interacting particle systems lies in the discrete particle updates, simultaneously with a growing number of particles.


title: Binary Stretch Embedding of Weighted Graphs

abstract: In this paper, we introduce and study the problem of \textit{binary stretch embedding} of edge-weighted graph. This problem is closely related to the well-known \textit{addressing problem} of Graham and Pollak. Addressing problem is the problem of assigning the shortest possible length strings (called ``addresses") over the alphabet $\{0,1,*\}$ to the vertices of an input graph $G$ with the following property. For every pair $u,v$ of vertices, the number of positions in which one of their addresses is $1$, and the other is $0$ is exactly equal to the distance of $u,v$ in graph $G$. When the addresses do not contain the symbol $*$, the problem is called \textit{isometric hypercube embedding}. As far as we know, the isometric hypercube embedding was introduced by Firsov in 1965. It is known that such addresses do not exist for general graphs. Inspired by the addressing problem, in this paper, we introduce the \textit{binary stretch embedding problem}, or BSEP for short, for the edge-weighted undirected graphs. We also argue how this problem is related to other graph embedding problems in the literature. Using tools and techniques such as Hadamard codes and the theory of linear programming, several upper and lower bounds as well as exact solutions for certain classes of graphs will be discovered. As an application of the results in this paper, we derive improved upper bounds or exact values for the maximum size of Lee metric codes of certain parameters.


title: Modular parametric PGD enabling online solution of partial differential equations

abstract: In the present work, a new methodology is proposed for building surrogate parametric models of engineering systems based on modular assembly of pre-solved modules. Each module is a generic parametric solution considering parametric geometry, material and boundary conditions. By assembling these modules and satisfying continuity constraints at the interfaces, a parametric surrogate model of the full problem can be obtained. In the present paper, the PGD technique in connection with NURBS geometry representation is used to create a parametric model for each module. In this technique, the NURBS objects allow to map the governing boundary value problem from a parametric non-regular domain into a regular reference domain and the PGD is used to create a reduced model in the reference domain. In the assembly stage, an optimization problem is solved to satisfy the continuity constraints at the interfaces. The proposed procedure is based on the offline--online paradigm: the offline stage consists of creating multiple pre-solved modules which can be afterwards assembled in almost real-time during the online stage, enabling quick evaluations of the full system response. To show the potential of the proposed approach some numerical examples in heat conduction and structural plates under bending are presented.


title: Knowledge Distillation in YOLOX-ViT for Side-Scan Sonar Object Detection

abstract: In this paper we present YOLOX-ViT, a novel object detection model, and investigate the efficacy of knowledge distillation for model size reduction without sacrificing performance. Focused on underwater robotics, our research addresses key questions about the viability of smaller models and the impact of the visual transformer layer in YOLOX. Furthermore, we introduce a new side-scan sonar image dataset, and use it to evaluate our object detector's performance. Results show that knowledge distillation effectively reduces false positives in wall detection. Additionally, the introduced visual transformer layer significantly improves object detection accuracy in the underwater environment. The source code of the knowledge distillation in the YOLOX-ViT is at https://github.com/remaro-network/KD-YOLOX-ViT.


title: Onsager vortex clusters on a sphere

abstract: We study Onsager vortex clustered states in a shell-shaped superfluid containing a large number of quantum vortices. In the incompressible limit and at low temperatures, the relevant problem can be boiled down to the statistical mechanics of neutral point vortices confined on a sphere. We analyze rotation free vortex clustered states within the mean field theory in the microcanonical ensemble. We find that the sandwich state, which involves the separating of vortices with opposite circulation and the clustering of vortices with same circulation around the poles and the equator, is the maximum entropy vortex distribution, subject to zero angular momentum constraint. The dipole momentum vanishes for the sandwich state and the quadrupole tensor serves as an order parameter to characterize the vortex cluster structure. For given finite angular momentum, the equilibrium vortex distribution forms a dipole structure, i.e., vortices with opposite sign are separated and are accumulated around the south and north pole, respectively. The conditions for the onset of clustering, and the exponents associated with the quadrupole moment and the dipole moment as functions of energy, are obtained within the mean field theory. At large energies, we obtain asymptotically exact vortex density distributions using the stereographic projection method, which give rise the parameter bounds for the vortex clustered states. The analytical predictions are in excellent agreement with microcanonical Monte Carlo simulations.


title: Semi- and Weakly-Supervised Learning for Mammogram Mass Segmentation with Limited Annotations

abstract: Accurate identification of breast masses is crucial in diagnosing breast cancer; however, it can be challenging due to their small size and being camouflaged in surrounding normal glands. Worse still, it is also expensive in clinical practice to obtain adequate pixel-wise annotations for training deep neural networks. To overcome these two difficulties with one stone, we propose a semi- and weakly-supervised learning framework for mass segmentation that utilizes limited strongly-labeled samples and sufficient weakly-labeled samples to achieve satisfactory performance. The framework consists of an auxiliary branch to exclude lesion-irrelevant background areas, a segmentation branch for final prediction, and a spatial prompting module to integrate the complementary information of the two branches. We further disentangle encoded obscure features into lesion-related and others to boost performance. Experiments on CBIS-DDSM and INbreast datasets demonstrate the effectiveness of our method.


title: A consistent explanation for the unusual initial mass function and star formation rate in the Central Molecular Zone (CMZ)

abstract: We examine various physical processes that may explain the shallow high-mass slope of the IMF as well as the low SFR in star-forming molecular clouds (MCs) in the Central Molecular Zone (CMZ). We show that the strong tidal field and the tidal shear experienced by the CMZ have opposite effects on the collapse of density fluctuations and nearly compensate, but in any case have a negligible impact and can not explain these unusual properties. Similarly, we show that the intense magnetic field in the CMZ provides a negligible pressure support and, for the high densities at play should not modify the probability density function (PDF) of the turbulent gas flow in the clouds, thus affecting negligibly the slope of the IMF. However, we show that, in contrast to MCs in the Galactic disk, the ones in the CMZ experience only one single episode of turbulence injection at large scale, most likely due dominantly to bar gas inflow. Indeed, their rather short lifetime, due to their high mean densities, is similar to one typical turbulence crossing time. Consequently, according to the Hennebelle-Chabrier theory of star formation, within this 'single turbulence episode' scenario, the cloud experiences one single field of turbulence induced density fluctuations, leading eventually to gravitationally unstable prestellar cores. As shown in Hennebelle & Chabrier (2013}, this yields a flatter IMF than usual and leads to the correct observed slope for the CMZ star-forming clouds. Similarly, this single large scale turbulence event within the cloud lifetime yields a 5 to 6 lower SFR than under usual MW cloud conditions, again in agreement with the observed values. Therefore, we suggest that this 'single large scale turbulence injection' episode can explain both the shallow IMF high-mass slope and low SFR of clouds in the CMZ.


title: SD-Net: Symmetric-Aware Keypoint Prediction and Domain Adaptation for 6D Pose Estimation In Bin-picking Scenarios

abstract: Despite the success in 6D pose estimation in bin-picking scenarios, existing methods still struggle to produce accurate prediction results for symmetry objects and real world scenarios. The primary bottlenecks include 1) the ambiguity keypoints caused by object symmetries; 2) the domain gap between real and synthetic data. To circumvent these problem, we propose a new 6D pose estimation network with symmetric-aware keypoint prediction and self-training domain adaptation (SD-Net). SD-Net builds on pointwise keypoint regression and deep hough voting to perform reliable detection keypoint under clutter and occlusion. Specifically, at the keypoint prediction stage, we designe a robust 3D keypoints selection strategy considering the symmetry class of objects and equivalent keypoints, which facilitate locating 3D keypoints even in highly occluded scenes. Additionally, we build an effective filtering algorithm on predicted keypoint to dynamically eliminate multiple ambiguity and outlier keypoint candidates. At the domain adaptation stage, we propose the self-training framework using a student-teacher training scheme. To carefully distinguish reliable predictions, we harnesses a tailored heuristics for 3D geometry pseudo labelling based on semi-chamfer distance. On public Sil'eane dataset, SD-Net achieves state-of-the-art results, obtaining an average precision of 96%. Testing learning and generalization abilities on public Parametric datasets, SD-Net is 8% higher than the state-of-the-art method. The code is available at https://github.com/dingthuang/SD-Net.


title: A Hierarchical Fused Quantum Fuzzy Neural Network for Image Classification

abstract: Neural network is a powerful learning paradigm for data feature learning in the era of big data. However, most neural network models are deterministic models that ignore the uncertainty of data. Fuzzy neural networks are proposed to address this problem. FDNN is a hierarchical deep neural network that derives information from both fuzzy and neural representations, the representations are then fused to form representation to be classified. FDNN perform well on uncertain data classification tasks. In this paper, we proposed a novel hierarchical fused quantum fuzzy neural network (HQFNN). Different from classical FDNN, HQFNN uses quantum neural networks to learn fuzzy membership functions in fuzzy neural network. We conducted simulated experiment on two types of datasets (Dirty-MNIST and 15-Scene), the results show that the proposed model can outperform several existing methods. In addition, we demonstrate the robustness of the proposed quantum circuit.


title: Anomalous quantum scattering and transport of electrons with Mexican-hat dispersion induced by electrical potential

abstract: We theoretically study the quantum scattering and transport of electrons with Mexican-hat dispersion through both step and rectangular potential barriers by using the transfer matrix method. Owing to the torus-like iso-energy lines of the Mexican-hat dispersion, we observe the presence of double reflections and double transmissions in both two different barrier scenarios, i.e., the normal reflection (NR), retro-reflection (RR), normal transmission (NT), and specular transmission (ST).For the step potential with electrons incident from the large wavevector, the transmission is primarily governed by NT with nearly negligible ST, while the reflection is dominant by RR (NR) within (outside) the critical angle. Additionally, for electrons incident from the small wavevector, the NT can be reduced to zero by adjusting the barrier, resulting in a significant enhancement of ST and RR. For the rectangular barrier, the transmission and reflection spectra resemble those of the step barrier, but there are two kinds of resonant tunneling which can lead to perfect NT or ST. There exists a negative differential conductance (NDC) effect in the conductance spectrum. The conductance and the peak-to-valley ratio of the NDC effect can be effectively controlled by adjusting the height and width of the barrier as well as the incident energy. Our results provide a deeper understanding of the electron states governed by the Mexican-hat dispersion.


title: Stopping mass-selected alkaline-earth metal monofluoride beams of high energy via formation of unusually stable anions

abstract: Direct laser-coolability and a comparatively simple electronic structure render alkaline-earth metal monofluoride molecules versatile laboratories for precision tests of fundamental physics. In this theoretical work, a route for efficient stopping and cooling of high-energy hot beams of mass-selected alkaline-earth metal monofluorides via their anions is explored to facilitate subsequent precision experiments with trapped molecules. It is shown that these molecular anions possess an unusually strong chemical bond and that RaF$^-$ features properties favourable for efficient pre-cooling, indicating the applicability of direct laser-cooling of the anion.


title: A Practical Guide to Spectrogram Analysis for Audio Signal Processing

abstract: The paper summarizes spectrogram and gives practical application of spectrogram in signal processing. For analysis, finger-snapping is recorded with a sampling rate of 441000 Hz and 96000 Hz. The effects of the number of segments on the Power Spectral Density (PSD) and spectrogram are analyzed and visualized.


title: Privacy Preserving Anomaly Detection on Homomorphic Encrypted Data from IoT Sensors

abstract: IoT devices have become indispensable components of our lives, and the advancement of AI technologies will make them even more pervasive, increasing the vulnerability to malfunctions or cyberattacks and raising privacy concerns. Encryption can mitigate these challenges; however, most existing anomaly detection techniques decrypt the data to perform the analysis, potentially undermining the encryption protection provided during transit or storage. Homomorphic encryption schemes are promising solutions as they enable the processing and execution of operations on IoT data while still encrypted, however, these schemes offer only limited operations, which poses challenges to their practical usage. In this paper, we propose a novel privacy-preserving anomaly detection solution designed for homomorphically encrypted data generated by IoT devices that efficiently detects abnormal values without performing decryption. We have adapted the Histogram-based anomaly detection technique for TFHE scheme to address limitations related to the input size and the depth of computation by implementing vectorized support operations. These operations include addition, value placement in buckets, labeling abnormal buckets based on a threshold frequency, labeling abnormal values based on their range, and bucket labels. Evaluation results show that the solution effectively detects anomalies without requiring data decryption and achieves consistent results comparable to the mechanism operating on plain data. Also, it shows robustness and resilience against various challenges commonly encountered in IoT environments, such as noisy sensor data, adversarial attacks, communication failures, and device malfunctions. Moreover, the time and computational overheads determined for several solution configurations, despite being large, are reasonable compared to those reported in existing literature.


title: E2E-MFD: Towards End-to-End Synchronous Multimodal Fusion Detection

abstract: Multimodal image fusion and object detection are crucial for autonomous driving. While current methods have advanced the fusion of texture details and semantic information, their complex training processes hinder broader applications. Addressing this challenge, we introduce E2E-MFD, a novel end-to-end algorithm for multimodal fusion detection. E2E-MFD streamlines the process, achieving high performance with a single training phase. It employs synchronous joint optimization across components to avoid suboptimal solutions tied to individual tasks. Furthermore, it implements a comprehensive optimization strategy in the gradient matrix for shared parameters, ensuring convergence to an optimal fusion detection configuration. Our extensive testing on multiple public datasets reveals E2E-MFD's superior capabilities, showcasing not only visually appealing image fusion but also impressive detection outcomes, such as a 3.9% and 2.0% mAP50 increase on horizontal object detection dataset M3FD and oriented object detection dataset DroneVehicle, respectively, compared to state-of-the-art approaches. The code is released at https://github.com/icey-zhang/E2E-MFD.


title: Hydrodynamic behavior near dynamical criticality of a facilitated conservative lattice gas

abstract: We investigate a $2d$-conservative lattice gas exhibiting a dynamical active-absorbing phase transition with critical density $\rho_c$. We derive the hydrodynamic equation for this model, showing that all critical exponents governing the large scale behavior near criticality can be obtained from two independent ones. We show that as the supercritical density approaches criticality, distinct length scales naturally appear. Remarkably, this behavior is different from the subcritical one. Numerical simulations support the critical relations and the scale separation.


title: Improved Constraints on the Variation of the Weak Scale from Big Bang Nucleosynthesis

abstract: We present an improved calculation of the light element abundances in the framework of Big Bang nucleosynthesis as a function of the Higgs vacuum expectation value $v$. We compare the methods of our calculation to previous literature including the recently published work of Burns et al. [1]. The PDG result for the $^4$He abundance can be explained within $2\sigma$ by $-0.014 \leq \delta v / v \leq 0.026$, for deuterium we find the constraint $-0.005 \leq \delta v / v \leq -0.001$. These bounds are more stringent than what was found earlier.

categories: hep-ph astro-ph.CO hep-lat hep-th nucl-th


title: HeadEvolver: Text to Head Avatars via Expressive and Attribute-Preserving Mesh Deformation

abstract: We present HeadEvolver, a novel framework to generate stylized head avatars from text guidance. HeadEvolver uses locally learnable mesh deformation from a template head mesh, producing high-quality digital assets for detail-preserving editing and animation. To tackle the challenges of lacking fine-grained and semantic-aware local shape control in global deformation through Jacobians, we introduce a trainable parameter as a weighting factor for the Jacobian at each triangle to adaptively change local shapes while maintaining global correspondences and facial features. Moreover, to ensure the coherence of the resulting shape and appearance from different viewpoints, we use pretrained image diffusion models for differentiable rendering with regularization terms to refine the deformation under text guidance. Extensive experiments demonstrate that our method can generate diverse head avatars with an articulated mesh that can be edited seamlessly in 3D graphics software, facilitating downstream applications such as more efficient animation with inherited blend shapes and semantic consistency.


title: Perspective-Equivariant Imaging: an Unsupervised Framework for Multispectral Pansharpening

abstract: Ill-posed image reconstruction problems appear in many scenarios such as remote sensing, where obtaining high quality images is crucial for environmental monitoring, disaster management and urban planning. Deep learning has seen great success in overcoming the limitations of traditional methods. However, these inverse problems rarely come with ground truth data, highlighting the importance of unsupervised learning from partial and noisy measurements alone. We propose perspective-equivariant imaging (EI), a framework that leverages perspective variability in optical camera-based imaging systems, such as satellites or handheld cameras, to recover information lost in ill-posed optical camera imaging problems. This extends previous EI work to include a much richer non-linear class of group transforms and is shown to be an excellent prior for satellite and urban image data, where perspective-EI achieves state-of-the-art results in multispectral pansharpening, outperforming other unsupervised methods in the literature. Code at https://andrewwango.github.io/perspective-equivariant-imaging


title: Selective Excitation of Vibrations in a Single Molecule

abstract: The capability to excite, probe, and manipulate vibrational modes is essential for understanding and controlling chemical reactions at the molecular level. Recent advancements in tip-enhanced Raman spectroscopies have enabled the probing of vibrational fingerprints in a single molecule with Angstrom-scale spatial resolution. However, achieving controllable excitation of specific vibrational modes in individual molecules remains challenging. Here, we demonstrate the selective excitation and probing of vibrational modes in single deprotonated phthalocyanine molecules utilizing resonance Raman spectroscopy in a scanning tunneling microscope. Selective excitation is achieved by finely tuning the excitation wavelength of the laser to be resonant with the vibronic transitions between the molecular ground electronic state and the vibrational levels in the excited electronic state, resulting in the state-selective enhancement of the resonance Raman signal. Our approach sets the stage for steering chemical transformations in molecules on surfaces by selective excitation of molecular vibrations.


title: On ultrafilters in ZF models and indecomposable ultrafilters

abstract: We use indecomposable ultrafilters to answer some questions of Hayut, Karagila paper "Spectra of uniformity". It is shown that the bound on the strength by T. Usuba "A note on uniform ultrafilters in choiceless context" is optimal.


title: Radar Rainbow Beams For Wideband mmWave Communication: Beam Training And Tracking

abstract: We propose a novel integrated sensing and communication (ISAC) system that leverages sensing to assist communication, ensuring fast initial access, seamless user tracking, and uninterrupted communication for millimeter wave (mmWave) wideband systems. True-time-delayers (TTDs) are utilized to generate frequency-dependent radar rainbow beams by controlling the beam squint effect. These beams cover users across the entire angular space simultaneously for fast beam training using just one orthogonal frequency-division multiplexing (OFDM) symbol. Three detection and estimation schemes are proposed based on radar rainbow beams for estimation of the users' angles, distances, and velocities, which are then exploited for communication beamformer design. The first proposed scheme utilizes a single-antenna radar receiver and one set of rainbow beams, but may cause a Doppler ambiguity. To tackle this limitation, two additional schemes are introduced, utilizing two sets of rainbow beams and a multi-antenna receiver, respectively. Furthermore, the proposed detection and estimation schemes are extended to realize user tracking by choosing different subsets of OFDM subcarriers. This approach eliminates the need to switch phase shifters and TTDs, which are typically necessary in existing tracking technologies, thereby reducing the demands on the control circurity. Simulation results reveal the effectiveness of the proposed rainbow beam-based training and tracking methods for mobile users. Notably, the scheme employing a multi-antenna radar receiver can accurately estimate the channel parameters and can support communication rates comparable to those achieved with perfect channel information.


title: Up and Down Quark Structure of the Proton

abstract: We measure proton structure parameters sensitive primarily to valence quarks using 8.6 fb$^{-1}$ of data collected by the D0 detector in $\sqrt{s}=1.96$ TeV $p\bar{p}$ collisions at the Fermilab Tevatron. We exploit the property of the forward-backward asymmetry in dilepton events to be factorized in to distinct structure parameters and electroweak quark-level asymmetries. Contributions to the asymmetry from $s$, $c$ and $b$ quarks, as well as from $u$ and $d$ quarks, are suppressed allowing valence $u$ and $d$ quarks to be separately determined. We find and $u$ to $d$ quark ratio near the peak values in the quark density distributions that is smaller than predictions from modern parton distribution functions.


title: A secular solar system resonance that disrupts the dominant cycle in Earth's orbital eccentricity (g2-g5): Implications for astrochronology

abstract: The planets' gravitational interaction causes rhythmic changes in Earth's orbital parameters (also called Milankovi\'c cycles), which have powerful applications in geology and astrochronology. For instance, the primary astronomical eccentricity cycle due to the secular frequency term (g2-g5) (~405 kyr in the recent past) utilized in deep-time analyses is dominated by Venus' and Jupiter's orbits, aka long eccentricity cycle. The widely accepted and long-held view is that (g2-g5) was practically stable in the past and may hence be used as a "metronome" to reconstruct accurate ages and chronologies. However, using state-of-the-art integrations of the solar system, we show here that (g2-g5) can become unstable over long time scales, without major changes in, or destabilization of, planetary orbits. The (g2-g5) disruption is due to the secular resonance $\sigma_{12}$ = (g1 - g2) + (s1 - s2), a major contributor to solar system chaos. We demonstrate that entering/exiting the $\sigma_{12}$ resonance is a common phenomenon on long time scales, occurring in ~40% of our solutions. During $\sigma_{12}$-resonance episodes, (g2-g5) is very weak or absent and Earth's orbital eccentricity and climate-forcing spectrum are unrecognizable compared to the recent past. Our results have fundamental implications for geology and astrochronology, as well as climate forcing because the paradigm that the longest Milankovi\'c cycle dominates Earth's astronomical forcing, is stable, and has a period of ~405 kyr requires revision.


title: Griffon v2: Advancing Multimodal Perception with High-Resolution Scaling and Visual-Language Co-Referring

abstract: Large Vision Language Models have achieved fine-grained object perception, but the limitation of image resolution remains a significant obstacle to surpass the performance of task-specific experts in complex and dense scenarios. Such limitation further restricts the model's potential to achieve nuanced visual and language referring in domains such as GUI Agents, Counting and \etc. To address this issue, we introduce a unified high-resolution generalist model, Griffon v2, enabling flexible object referring with visual and textual prompts. To efficiently scaling up image resolution, we design a simple and lightweight down-sampling projector to overcome the input tokens constraint in Large Language Models. This design inherently preserves the complete contexts and fine details, and significantly improves multimodal perception ability especially for small objects. Building upon this, we further equip the model with visual-language co-referring capabilities through a plug-and-play visual tokenizer. It enables user-friendly interaction with flexible target images, free-form texts and even coordinates. Experiments demonstrate that Griffon v2 can localize any objects of interest with visual and textual referring, achieve state-of-the-art performance on REC, phrase grounding, and REG tasks, and outperform expert models in object detection and object counting. Data, codes and models will be released at https://github.com/jefferyZhan/Griffon.


title: Video Editing via Factorized Diffusion Distillation

abstract: We introduce Emu Video Edit (EVE), a model that establishes a new state-of-the art in video editing without relying on any supervised video editing data. To develop EVE we separately train an image editing adapter and a video generation adapter, and attach both to the same text-to-image model. Then, to align the adapters towards video editing we introduce a new unsupervised distillation procedure, Factorized Diffusion Distillation. This procedure distills knowledge from one or more teachers simultaneously, without any supervised data. We utilize this procedure to teach EVE to edit videos by jointly distilling knowledge to (i) precisely edit each individual frame from the image editing adapter, and (ii) ensure temporal consistency among the edited frames using the video generation adapter. Finally, to demonstrate the potential of our approach in unlocking other capabilities, we align additional combinations of adapters


title: Generalized Euler-Maclaurin formula and Signatures

abstract: The Euler-Maclaurin formula which relates a discrete sum with an integral, is generalised to the setting of Riemann-Stieltjes sums and integrals on stochastic processes whose paths are a.s. rectifiable, that is continuous and bounded variation. For this purpose, new variants of the signature are introduced, such as the flip and the sawtooth signature. The counterparts of the Bernoulli numbers that arise in the classical Euler-Maclaurin formula are obtained by choosing the appropriate integration constants in the repeated integration by parts to ``minimise the error'' of every truncation level.