title: 3rd Place Solution for MeViS Track in CVPR 2024 PVUW workshop: Motion Expression guided Video Segmentation

abstract: Referring video object segmentation (RVOS) relies on natural language expressions to segment target objects in video, emphasizing modeling dense text-video relations. The current RVOS methods typically use independently pre-trained vision and language models as backbones, resulting in a significant domain gap between video and text. In cross-modal feature interaction, text features are only used as query initialization and do not fully utilize important information in the text. In this work, we propose using frozen pre-trained vision-language models (VLM) as backbones, with a specific emphasis on enhancing cross-modal feature interaction. Firstly, we use frozen convolutional CLIP backbone to generate feature-aligned vision and text features, alleviating the issue of domain gap and reducing training costs. Secondly, we add more cross-modal feature fusion in the pipeline to enhance the utilization of multi-modal information. Furthermore, we propose a novel video query initialization method to generate higher quality video queries. Without bells and whistles, our method achieved 51.5 J&F on the MeViS test set and ranked 3rd place for MeViS Track in CVPR 2024 PVUW workshop: Motion Expression guided Video Segmentation.


title: Variational Flow Matching for Graph Generation

abstract: We present a formulation of flow matching as variational inference, which we refer to as variational flow matching (VFM). Based on this formulation we develop CatFlow, a flow matching method for categorical data. CatFlow is easy to implement, computationally efficient, and achieves strong results on graph generation tasks. In VFM, the objective is to approximate the posterior probability path, which is a distribution over possible end points of a trajectory. We show that VFM admits both the CatFlow objective and the original flow matching objective as special cases. We also relate VFM to score-based models, in which the dynamics are stochastic rather than deterministic, and derive a bound on the model likelihood based on a reweighted VFM objective. We evaluate CatFlow on one abstract graph generation task and two molecular generation tasks. In all cases, CatFlow exceeds or matches performance of the current state-of-the-art models.


title: Multi-Granularity Language-Guided Multi-Object Tracking

abstract: Most existing multi-object tracking methods typically learn visual tracking features via maximizing dis-similarities of different instances and minimizing similarities of the same instance. While such a feature learning scheme achieves promising performance, learning discriminative features solely based on visual information is challenging especially in case of environmental interference such as occlusion, blur and domain variance. In this work, we argue that multi-modal language-driven features provide complementary information to classical visual features, thereby aiding in improving the robustness to such environmental interference. To this end, we propose a new multi-object tracking framework, named LG-MOT, that explicitly leverages language information at different levels of granularity (scene-and instance-level) and combines it with standard visual features to obtain discriminative representations. To develop LG-MOT, we annotate existing MOT datasets with scene-and instance-level language descriptions. We then encode both instance-and scene-level language information into high-dimensional embeddings, which are utilized to guide the visual features during training. At inference, our LG-MOT uses the standard visual features without relying on annotated language descriptions. Extensive experiments on three benchmarks, MOT17, DanceTrack and SportsMOT, reveal the merits of the proposed contributions leading to state-of-the-art performance. On the DanceTrack test set, our LG-MOT achieves an absolute gain of 2.2\% in terms of target object association (IDF1 score), compared to the baseline using only visual features. Further, our LG-MOT exhibits strong cross-domain generalizability. The dataset and code will be available at ~\url{https://github.com/WesLee88524/LG-MOT}.


title: FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models

abstract: Federated learning has enabled multiple parties to collaboratively train large language models without directly sharing their data (FedLLM). Following this training paradigm, the community has put massive efforts from diverse aspects including framework, performance, and privacy. However, an unpleasant fact is that there are currently no realistic datasets and benchmarks for FedLLM and previous works all rely on artificially constructed datasets, failing to capture properties in real-world scenarios. Addressing this, we propose FedLLM-Bench, which involves 8 training methods, 4 training datasets, and 6 evaluation metrics, to offer a comprehensive testbed for the FedLLM community. FedLLM-Bench encompasses three datasets (e.g., user-annotated multilingual dataset) for federated instruction tuning and one dataset (e.g., user-annotated preference dataset) for federated preference alignment, whose scale of client number ranges from 38 to 747. Our datasets incorporate several representative diversities: language, quality, quantity, instruction, length, embedding, and preference, capturing properties in real-world scenarios. Based on FedLLM-Bench, we conduct experiments on all datasets to benchmark existing FL methods and provide empirical insights (e.g., multilingual collaboration). We believe that our FedLLM-Bench can benefit the FedLLM community by reducing required efforts, providing a practical testbed, and promoting fair comparisons. Code and datasets are available at https://github.com/rui-ye/FedLLM-Bench.


title: Efficient Fault-Tolerant Single Qubit Gate Approximation And Universal Quantum Computation Without Using The Solovay-Kitaev Theorem

abstract: Arbitrarily accurate fault-tolerant (FT) universal quantum computation can be carried out using the Clifford gates Z, S, CNOT plus the non-Clifford T gate. Moreover, a recent improvement of the Solovay-Kitaev theorem by Kuperberg implies that to approximate any single-qubit gate to an accuracy of $\epsilon > 0$ requires $\text{O}(\log^c[1/\epsilon])$ quantum gates with $c > 1.44042$. Can one do better? That was the question asked by Nielsen and Chuang in their quantum computation textbook. Specifically, they posted a challenge to efficiently approximate single-qubit gate, fault-tolerantly or otherwise, using $\Omega(\log[1/\epsilon])$ gates chosen from a finite set. Here I give a partial answer to this question by showing that this is possible using $\text{O}(\log[1/\epsilon] \log\log[1/\epsilon] \log\log\log[1/\epsilon] \cdots)$ FT gates chosen from a finite set depending on the value of $\epsilon$. The key idea is to construct an approximation of any phase gate in a FT way by recursion to any given accuracy $\epsilon > 0$. This method is straightforward to implement, easy to understand, and interestingly does not involve the Solovay-Kitaev theorem.


title: Do Language Models Exhibit Human-like Structural Priming Effects?

abstract: We explore which linguistic factors -- at the sentence and token level -- play an important role in influencing language model predictions, and investigate whether these are reflective of results found in humans and human corpora (Gries and Kootstra, 2017). We make use of the structural priming paradigm, where recent exposure to a structure facilitates processing of the same structure. We don't only investigate whether, but also where priming effects occur, and what factors predict them. We show that these effects can be explained via the inverse frequency effect, known in human priming, where rarer elements within a prime increase priming effects, as well as lexical dependence between prime and target. Our results provide an important piece in the puzzle of understanding how properties within their context affect structural prediction in language models.


title: CTBENCH: A Library and Benchmark for Certified Training

abstract: Training certifiably robust neural networks is an important but challenging task. While many algorithms for (deterministic) certified training have been proposed, they are often evaluated on different training schedules, certification methods, and systematically under-tuned hyperparameters, making it difficult to compare their performance. To address this challenge, we introduce CTBENCH, a unified library and a high-quality benchmark for certified training that evaluates all algorithms under fair settings and systematically tuned hyperparameters. We show that (1) almost all algorithms in CTBENCH surpass the corresponding reported performance in literature in the magnitude of algorithmic improvements, thus establishing new state-of-the-art, and (2) the claimed advantage of recent algorithms drops significantly when we enhance the outdated baselines with a fair training schedule, a fair certification method and well-tuned hyperparameters. Based on CTBENCH, we provide new insights into the current state of certified training and suggest future research directions. We are confident that CTBENCH will serve as a benchmark and testbed for future research in certified training.


title: Dynamic prediction of death risk given a renewal hospitalization process

abstract: Predicting the risk of death for chronic patients is highly valuable for informed medical decision-making. This paper proposes a general framework for dynamic prediction of the risk of death of a patient given her hospitalization history, which is generally available to physicians. Predictions are based on a joint model for the death and hospitalization processes, thereby avoiding the potential bias arising from selection of survivors. The framework accommodates various submodels for the hospitalization process. In particular, we study prediction of the risk of death in a renewal model for hospitalizations, a common approach to recurrent event modelling. In the renewal model, the distribution of hospitalizations throughout the follow-up period impacts the risk of death. This result differs from prediction in the Poisson model, previously studied, where only the number of hospitalizations matters. We apply our methodology to a prospective, observational cohort study of 401 patients treated for COPD in one of six outpatient respiratory clinics run by the Respiratory Service of Galdakao University Hospital, with a median follow-up of 4.16 years. We find that more concentrated hospitalizations increase the risk of death.


title: Expected Lipschitz-Killing curvatures for spin random fields and other non-isotropic fields

abstract: Spherical spin random fields are used to model the Cosmic Microwave Background polarization, the study of which is at the heart of modern Cosmology and will be the subject of the LITEBIRD mission, in the 2030s. Its scope is to collect datas to test the theoretical predictions of the Cosmic Inflation model. In particular, the Minkowski functionals, or the Lipschitz-Killing curvatures, of excursion sets can be used to detect deviations from Gaussianity and anisotropies of random fields, being fine descriptors of their geometry and topology. In this paper we give an explicit, non-asymptotic, formula for the expectation of the Lipshitz-Killing curvatures of the excursion set of the real part of an arbitrary left-invariant Gaussian spin spherical random field, seen as a field on $SO(3)$. Our findings are coherent with the asymptotic ones presented in Carr\'on Duque, J. et al. "Minkowski Functionals in $SO(3)$ for the spin-2 CMB polarisation field", Journal of Cosmology and Astroparticle Physics (2024). We also give explicit expressions for the Adler-Taylor metric, and its curvature. We obtain such result as an application of a general formula that applies to any nondegenerate Gaussian random field defined on an arbitrary three dimensional compact Riemannian manifold. The novelty is that the Lipschitz-Killing curvatures are computed with respect to an arbitrary metric, possibly different than the Adler-Taylor metric of the field.


title: Digital assistant in a point of sales

abstract: This article investigates the deployment of a Voice User Interface (VUI)-powered digital assistant in a retail setting and assesses its impact on customer engagement and service efficiency. The study explores how digital assistants can enhance user interactions through advanced conversational capabilities with multilingual support. By integrating a digital assistant into a high-traffic retail environment, we evaluate its effectiveness in improving the quality of customer service and operational efficiency. Data collected during the experiment demonstrate varied impacts on customer interaction, revealing insights into the future optimizations of digital assistant technologies in customer-facing roles. This study contributes to the understanding of digital transformation strategies within the customer relations domain emphasizing the need for service flexibility and user-centric design in modern retail stores.


title: Destabilization of Alzheimers Amyloid-beta Protofibrils by Bai-calein: Mechanistic Insights from All-atom Molecular Dynamics Simulations

abstract: Alzheimer's disease (AD) is a neurodegenerative disorder; it is the most common form of de-mentia and the fifth leading cause of death globally. Aggregation and deposition of neurotoxic A-beta fibrils in the neural tissues of the brain is a key hallmark in the pathogenesis of AD. Desta-bilisation studies of the amyloid-peptide by various natural molecules are of the utmost rele-vance due to their enormous potential as neuroprotective and therapeutic agents for AD. We performed molecular dynamics (MD) simulation on the U-shaped pentamers of amyloidogenic protofilament intermediates to investigate the destabilisation mechanism in the presence of Bai-calein (BCL), a naturally occurring flavonoid. We found that the BCL molecule formed strong hydrophobic contacts with non-polar residues of the protofibril. Upon binding, it competed with the native hydrophobic contacts of the A-beta protein. BCL loosened the tight packing of the hydrophobic core of the protofibril by disrupting the inter-chain salt bridges and hydrogen bonds. The decrease in the structural stability of A-beta protofibrils was confirmed through the en-hanced root mean square deviation (RMSD), radius of gyration and solvent accessible surface area (SASA), and reduced beta-sheet content. PCA indicated that the presence of the BCL mole-cule intensified protofibril motions, particularly affecting residues in Chain A and B regions. Our findings propose that BCL would be a potent destabiliser of A-beta protofilament, and may be considered as a therapeutic agent in treating AD.


title: Time-Series JEPA for Predictive Remote Control under Capacity-Limited Networks

abstract: In remote control systems, transmitting large data volumes (e.g. video feeds) from wireless sensors to faraway controllers is challenging when the uplink channel capacity is limited (e.g. RedCap devices or massive wireless sensor networks). Furthermore, the controllers often only need the information-rich components of the original data. To address this, we propose a Time-Series Joint Embedding Predictive Architecture (TS-JEPA) and a semantic actor trained through self-supervised learning. This approach harnesses TS-JEPA's semantic representation power and predictive capabilities by capturing spatio-temporal correlations in the source data. We leverage this to optimize uplink channel utilization, while the semantic actor calculates control commands directly from the encoded representations, rather than from the original data. We test our model through multiple parallel instances of the well-known inverted cart-pole scenario, where the approach is validated through the maximization of stability under constrained uplink channel capacity.


title: Uncertainty Aware Learning for Language Model Alignment

abstract: As instruction-tuned large language models (LLMs) evolve, aligning pretrained foundation models presents increasing challenges. Existing alignment strategies, which typically leverage diverse and high-quality data sources, often overlook the intrinsic uncertainty of tasks, learning all data samples equally. This may lead to suboptimal data efficiency and model performance. In response, we propose uncertainty-aware learning (UAL) to improve the model alignment of different task scenarios, by introducing the sample uncertainty (elicited from more capable LLMs). We implement UAL in a simple fashion -- adaptively setting the label smoothing value of training according to the uncertainty of individual samples. Analysis shows that our UAL indeed facilitates better token clustering in the feature space, validating our hypothesis. Extensive experiments on widely used benchmarks demonstrate that our UAL significantly and consistently outperforms standard supervised fine-tuning. Notably, LLMs aligned in a mixed scenario have achieved an average improvement of 10.62\% on high-entropy tasks (i.e., AlpacaEval leaderboard), and 1.81\% on complex low-entropy tasks (i.e., MetaMath and GSM8K).


title: The Russian Legislative Corpus

abstract: We present the comprehensive Russian primary and secondary legislation corpus covering 1991 to 2023. The corpus collects all 281,413 texts (176,523,268 tokens) of non-secret federal regulations and acts, along with their metadata. The corpus has two versions the original text with minimal preprocessing and a version prepared for linguistic analysis with morphosyntactic markup.


title: Emergence of KNO scaling in multiplicity distributions in jets produced at the LHC

abstract: In this work we study the multiplicity distributions (MDs) of charged particles within jets in proton-proton collisions, which were measured by the ATLAS collaboration in 2011, 2016 and 2019. The first data set refers to jets with lower transverse momenta ($4 < p_T < 40$ GeV ) whereas the other two refer to higher $p_T$ jets ($0.1 < p_T < 2.5$ TeV). We find that the first set shows no sign of KNO scaling whereas the higher $p_T$ sets gradually approach the scaling limit. In the first set the mean multiplicity as a function of $p_T$ can be well described by expressions derived from QCD with different approximation schemes. For higher ($> 500$ GeV) values of $p_T$ these expressions significantly overshoot the data. We show that the behavior of the MDs can be well represented by a Sub-Poisson distribution with energy dependent parameters. In the range $40 < p_T < 100$ GeV there is a transition from sub to super poissonian behavior and the MD evolves to a geometric distribution, which shows KNO scaling. In this way we fit the MDs in all transverse momentum intervals with one single expression. We discuss the implications of this phenomenological finding.


title: A Near-Linear Time Approximation Algorithm for Beyond-Worst-Case Graph Clustering

abstract: We consider the semi-random graph model of [Makarychev, Makarychev and Vijayaraghavan, STOC'12], where, given a random bipartite graph with $\alpha$ edges and an unknown bipartition $(A, B)$ of the vertex set, an adversary can add arbitrary edges inside each community and remove arbitrary edges from the cut $(A, B)$ (i.e. all adversarial changes are \textit{monotone} with respect to the bipartition). For this model, a polynomial time algorithm is known to approximate the Balanced Cut problem up to value $O(\alpha)$ [MMV'12] as long as the cut $(A, B)$ has size $\Omega(\alpha)$. However, it consists of slow subroutines requiring optimal solutions for logarithmically many semidefinite programs. We study the fine-grained complexity of the problem and present the first near-linear time algorithm that achieves similar performances to that of [MMV'12]. Our algorithm runs in time $O(|V(G)|^{1+o(1)} + |E(G)|^{1+o(1)})$ and finds a balanced cut of value $O(\alpha)$. Our approach appears easily extendible to related problem, such as Sparsest Cut, and also yields an near-linear time $O(1)$-approximation to Dagupta's objective function for hierarchical clustering [Dasgupta, STOC'16] for the semi-random hierarchical stochastic block model inputs of [Cohen-Addad, Kanade, Mallmann-Trenn, Mathieu, JACM'19].


title: Auto-Multilift: Distributed Learning and Control for Cooperative Load Transportation With Quadrotors

abstract: Designing motion control and planning algorithms for multilift systems remains challenging due to the complexities of dynamics, collision avoidance, actuator limits, and scalability. Existing methods that use optimization and distributed techniques effectively address these constraints and scalability issues. However, they often require substantial manual tuning, leading to suboptimal performance. This paper proposes Auto-Multilift, a novel framework that automates the tuning of model predictive controllers (MPCs) for multilift systems. We model the MPC cost functions with deep neural networks (DNNs), enabling fast online adaptation to various scenarios. We develop a distributed policy gradient algorithm to train these DNNs efficiently in a closed-loop manner. Central to our algorithm is distributed sensitivity propagation, which parallelizes gradient computation across quadrotors, focusing on actual system state sensitivities relative to key MPC parameters. We also provide theoretical guarantees for the convergence of this algorithm. Extensive simulations show rapid convergence and favorable scalability to a large number of quadrotors. Our method outperforms a state-of-the-art open-loop MPC tuning approach by effectively learning adaptive MPCs from trajectory tracking errors and handling the unique dynamics couplings within the multilift system. Additionally, our framework can learn an adaptive reference for reconfigurating the system when traversing through multiple narrow slots.


title: Stochastic full waveform inversion with deep generative prior for uncertainty quantification

abstract: To obtain high-resolution images of subsurface structures from seismic data, seismic imaging techniques such as Full Waveform Inversion (FWI) serve as crucial tools. However, FWI involves solving a nonlinear and often non-unique inverse problem, presenting challenges such as local minima trapping and inadequate handling of inherent uncertainties. In addressing these challenges, we propose leveraging deep generative models as the prior distribution of geophysical parameters for stochastic Bayesian inversion. This approach integrates the adjoint state gradient for efficient back-propagation from the numerical solution of partial differential equations. Additionally, we introduce explicit and implicit variational Bayesian inference methods. The explicit method computes variational distribution density using a normalizing flow-based neural network, enabling computation of the Bayesian posterior of parameters. Conversely, the implicit method employs an inference network attached to a pretrained generative model to estimate density, incorporating an entropy estimator. Furthermore, we also experimented with the Stein Variational Gradient Descent (SVGD) method as another variational inference technique, using particles. We compare these variational Bayesian inference methods with conventional Markov chain Monte Carlo (McMC) sampling. Each method is able to quantify uncertainties and to generate seismic data-conditioned realizations of subsurface geophysical parameters. This framework provides insights into subsurface structures while accounting for inherent uncertainties.


title: Multi-View Stochastic Block Models

abstract: Graph clustering is a central topic in unsupervised learning with a multitude of practical applications. In recent years, multi-view graph clustering has gained a lot of attention for its applicability to real-world instances where one has access to multiple data sources. In this paper we formalize a new family of models, called \textit{multi-view stochastic block models} that captures this setting. For this model, we first study efficient algorithms that naively work on the union of multiple graphs. Then, we introduce a new efficient algorithm that provably outperforms previous approaches by analyzing the structure of each graph separately. Furthermore, we complement our results with an information-theoretic lower bound studying the limits of what can be done in this model. Finally, we corroborate our results with experimental evaluations.


title: Normal-guided Detail-Preserving Neural Implicit Functions for High-Fidelity 3D Surface Reconstruction

abstract: Neural implicit representations have emerged as a powerful paradigm for 3D reconstruction. However, despite their success, existing methods fail to capture fine geometric details and thin structures, especially in scenarios where only sparse RGB views of the objects of interest are available. We hypothesize that current methods for learning neural implicit representations from RGB or RGBD images produce 3D surfaces with missing parts and details because they only rely on 0-order differential properties, i.e. the 3D surface points and their projections, as supervisory signals. Such properties, however, do not capture the local 3D geometry around the points and also ignore the interactions between points. This paper demonstrates that training neural representations with first-order differential properties, i.e. surface normals, leads to highly accurate 3D surface reconstruction even in situations where only as few as two RGB (front and back) images are available. Given multiview RGB images of an object of interest, we first compute the approximate surface normals in the image space using the gradient of the depth maps produced using an off-the-shelf monocular depth estimator such as Depth Anything model. An implicit surface regressor is then trained using a loss function that enforces the first-order differential properties of the regressed surface to match those estimated from Depth Anything. Our extensive experiments on a wide range of real and synthetic datasets show that the proposed method achieves an unprecedented level of reconstruction accuracy even when using as few as two RGB views. The detailed ablation study also demonstrates that normal-based supervision plays a key role in this significant improvement in performance, enabling the 3D reconstruction of intricate geometric details and thin structures that were previously challenging to capture.


title: Cactus-like Metamaterial Structures for Electromagnetically Induced Transparency at THz frequencies

abstract: THz metamaterials present unique opportunities for next generation technologies and applications, as they can fill the ``THz gap'' originating from the weak response of natural materials in this regime, providing a variety of novel or advanced electromagnetic wave control components and systems. Here, we propose a novel metamaterial design, made of three-dimensional, metallic, "cactus like" meta-atoms, showing electromagnetically induced transparency (EIT) and enhanced refractive index sensing performance at low THz frequencies. Following a detailed theoretical analysis, the structure is realized experimentally using multi-photon polymerization and electroless silver plating. The experimental characterization results obtained through THz time domain spectroscopy validate the corresponding numerical data, verifying the high potential of the proposed structure in slow light and sensing applications.


title: Constructing $3$-Dimensional Monogenic Homogeneous Functions

abstract: This paper is dedicated to the construction of multidimensional spherical monogenics. Firstly, we investigate the construction of monogenic functions in dimension $3$ by applying the Dirac operator to the orthonormal bases of spherical harmonics, resulting in orthogonal spherical monogenics. Additionally, we employ the reproducing kernel for monogenic functions and a specialized optimization method to derive various types of $3$-dimensional spherical harmonics and spherical monogenics.


title: Shaking and Tumbling: Short- and Long-Timescale Mechanisms for Resurfacing of Near-Earth Asteroid Surfaces from Planetary Tides and Predictions for the 2029 Earth Encounter by (99942) Apophis

abstract: Spectral characterization of near-Earth asteroids (NEAs) has revealed a continuum of space-weathered states for the surfaces of S-complex NEAs, with Q-class NEAs, an S-complex subclass, most closely matching the un-weathered surfaces of ordinary chondrite meteorites. Dynamical calculations of the orbital evolution of S-complex NEAs revealed that Q-class NEAs tend to have close encounters with terrestrial planets, suggesting that planetary tides may play a role in refreshing NEA surfaces. However, the exact physical mechanism(s) that drive resurfacing through tidal encounters and the encounter distance at which these mechanisms are effective, has remained unclear. Through the lens of the upcoming (99942) Apophis encounter with Earth in 2029, we investigate the potential for surface mobilization through tidally-driven seismic shaking over short-timescales during encounter and subsequent surface slope evolution over longer-timescales driven by tumbling. We perform multi-scale numerical modeling and find that the 2029 encounter will induce short-term tidally-driven discrete seismic events that lead to high-frequency (greater than 0.1 Hz) surface accelerations that reach magnitudes similar to Apophis' gravity, and that may be detectable by modern seismometers. It is still unclear if the shaking we model translates to widespread particle mobilization and/or lofting. We also find there will be a significant change in Apophis' tumbling spin state that could lead to longer-term surface refreshing in response to tumbling-induced surface slope changes. We propose that through these mechanisms, space-weathered S-class asteroid surfaces may become refreshed through the exposure of unweathered underlying material. These results will be tested by the future exploration of Apophis by NASA's OSIRIS-APEX.


title: Entangled magnon-pair generation in a driven synthetic antiferromagnet

abstract: Understanding, manipulating, and using magnons - the quanta of spin waves - for energy-efficient applications is one of the primary goals of magnonics. In this paper, we consider a synthetic antiferromagnet in which one of the ferromagnetic layers is driven by spin-orbit torque. We find that under specific conditions for the magnitude of the spin-orbit torque and field, magnon pairs are spontaneously produced by quantum fluctuations in a way that is similar to Hawking pair production near black-hole horizons. One of the magnons is generated near the interface with the spacer layer in one of the magnetic layers of the synthetic antiferromagnet, while the other magnon is produced in the other magnetic layer. We compute the magnon current due to these spontaneously generated magnon pairs and estimate the temperature below which they should become observable. Additionally, we find that the magnons are entangled, which makes them interesting for future applications in quantum magnonics.


title: ComplexTempQA: A Large-Scale Dataset for Complex Temporal Question Answering

abstract: We introduce ComplexTempQA,a large-scale dataset consisting of over 100 million question-answer pairs designed to tackle the challenges in temporal question answering. ComplexTempQA significantly surpasses existing benchmarks like HOTPOTQA, TORQUE, and TEQUILA in scale and scope. Utilizing data from Wikipedia and Wikidata, the dataset covers questions spanning over two decades and offers an unmatched breadth of topics. We introduce a unique taxonomy that categorizes questions as attributes, comparisons, and counting questions, each revolving around events, entities, and time periods. One standout feature of ComplexTempQA is the high complexity of its questions, which demand effective capabilities for answering such as across-time comparison, temporal aggregation, and multi-hop reasoning involving temporal event ordering and entity recognition. Additionally, each question is accompanied by detailed metadata, including specific time scopes, allowing for comprehensive evaluation and enhancement of the temporal reasoning abilities of large language models. ComplexTempQA serves both as a testing ground for developing sophisticated AI models and as a foundation for advancing research in question answering, information retrieval, and language understanding. Dataset and code are freely available at: https://github.com/DataScienceUIBK/ComplexTempQA.


title: Deep learning for precipitation nowcasting: A survey from the perspective of time series forecasting

abstract: Deep learning-based time series forecasting has dominated the short-term precipitation forecasting field with the help of its ability to estimate motion flow in high-resolution datasets. The growing interest in precipitation nowcasting offers substantial opportunities for the advancement of current forecasting technologies. Nevertheless, there has been a scarcity of in-depth surveys of time series precipitation forecasting using deep learning. Thus, this paper systemically reviews recent progress in time series precipitation forecasting models. Specifically, we investigate the following key points within background components, covering: i) preprocessing, ii) objective functions, and iii) evaluation metrics. We then categorize forecasting models into \textit{recursive} and \textit{multiple} strategies based on their approaches to predict future frames, investigate the impacts of models using the strategies, and performance assessments. Finally, we evaluate current deep learning-based models for precipitation forecasting on a public benchmark, discuss their limitations and challenges, and present some promising research directions. Our contribution lies in providing insights for a better understanding of time series precipitation forecasting and in aiding the development of robust AI solutions for the future.


title: Perturb-and-Project: Differentially Private Similarities and Marginals

abstract: We revisit the input perturbations framework for differential privacy where noise is added to the input $A\in \mathcal{S}$ and the result is then projected back to the space of admissible datasets $\mathcal{S}$. Through this framework, we first design novel efficient algorithms to privately release pair-wise cosine similarities. Second, we derive a novel algorithm to compute $k$-way marginal queries over $n$ features. Prior work could achieve comparable guarantees only for $k$ even. Furthermore, we extend our results to $t$-sparse datasets, where our efficient algorithms yields novel, stronger guarantees whenever $t\le n^{5/6}/\log n\,.$ Finally, we provide a theoretical perspective on why \textit{fast} input perturbation algorithms works well in practice. The key technical ingredients behind our results are tight sum-of-squares certificates upper bounding the Gaussian complexity of sets of solutions.


title: Unraveling-induced entanglement phase transition in diffusive trajectories of continuously monitored noninteracting fermionic systems

abstract: The competition between unitary quantum dynamics and dissipative stochastic effects, as emerging from continuous-monitoring processes, can culminate in measurement-induced phase transitions. Here, a many-body system abruptly passes, when exceeding a critical measurement rate, from a highly entangled phase to a low-entanglement one. We consider a different perspective on entanglement phase transitions and explore whether these can emerge when the measurement process itself is modified, while keeping the measurement rate fixed. To illustrate this idea, we consider a noninteracting fermionic system and focus on diffusive detection processes. Through extensive numerical simulations, we show that, upon varying a suitable \textit{unraveling parameter} -- interpolating between measurements of different quadrature operators -- the system displays a transition from a phase with area-law entanglement to one where entanglement scales logarithmically with the system size. Our findings may be relevant for tailoring quantum correlations in noisy quantum devices and for conceiving optimal classical simulation strategies.


title: The $\beta$ Pictoris b Hill sphere transit campaign. Paper II: Searching for the signatures of the $\beta$ Pictoris exoplanets through time delay analysis of the $\delta$ Scuti pulsations

abstract: The $\beta$ Pictoris system is the closest known stellar system with directly detected gas giant planets, an edge-on circumstellar disc, and evidence of falling sublimating bodies and transiting exocomets. The inner planet, $\beta$ Pictoris c, has also been indirectly detected with radial velocity (RV) measurements. The star is a known $\delta$ Scuti pulsator, and the long-term stability of these pulsations opens up the possibility of indirectly detecting the gas giant planets through time delays of the pulsations due to a varying light travel time. We search for phase shifts in the $\delta$ Scuti pulsations consistent with the known planets $\beta$ Pictoris b and c and carry out an analysis of the stellar pulsations of $\beta$ Pictoris over a multi-year timescale. We used photometric data collected by the BRITE-Constellation, bRing, ASTEP, and TESS to derive a list of the strongest and most significant $\delta$ Scuti pulsations. We carried out an analysis with the open-source python package maelstrom to study the stability of the pulsation modes of $\beta$ Pictoris in order to determine the long-term trends in the observed pulsations. We did not detect the expected signal for $\beta$ Pictoris b or $\beta$ Pictoris c. The expected time delay is 6 seconds for $\beta$ Pictoris c and 24 seconds for $\beta$ Pictoris b. With simulations, we determined that the photometric noise in all the combined data sets cannot reach the sensitivity needed to detect the expected timing drifts. An analysis of the pulsational modes of $\beta$ Pictoris using maelstrom showed that the modes themselves drift on the timescale of a year, fundamentally limiting our ability to detect exoplanets around $\beta$ Pictoris via pulsation timing.


title: Mind Mansion: Exploring Metaphorical Interactions to Engage with Negative Thoughts in Virtual Reality

abstract: Recurrent negative thoughts can significantly disrupt daily life and contribute to negative emotional states. Facing, confronting, and noticing such thoughts without support can be challenging. To provide a playful setting and leverage the technical maturation of Virtual Reality (VR), our VR experience, Mind Mansion, places the user in an initially cluttered virtual apartment. Here we utilize established concepts from traditional therapy and metaphors identified in prior works to let users engage metaphorically with representations of thoughts, gradually sorting the space, fostering awareness of thoughts, and supporting mental self-care. The results of our user study (n = 30) reveal that Mind Mansion encourages the exploration of alternative perspectives, fosters acceptance, and potentially offers new coping mechanisms. Our findings suggest that this VR intervention can reduce negative affect and improve overall emotional awareness.


title: Diversified Batch Selection for Training Acceleration

abstract: The remarkable success of modern machine learning models on large datasets often demands extensive training time and resource consumption. To save cost, a prevalent research line, known as online batch selection, explores selecting informative subsets during the training process. Although recent efforts achieve advancements by measuring the impact of each sample on generalization, their reliance on additional reference models inherently limits their practical applications, when there are no such ideal models available. On the other hand, the vanilla reference-model-free methods involve independently scoring and selecting data in a sample-wise manner, which sacrifices the diversity and induces the redundancy. To tackle this dilemma, we propose Diversified Batch Selection (DivBS), which is reference-model-free and can efficiently select diverse and representative samples. Specifically, we define a novel selection objective that measures the group-wise orthogonalized representativeness to combat the redundancy issue of previous sample-wise criteria, and provide a principled selection-efficient realization. Extensive experiments across various tasks demonstrate the significant superiority of DivBS in the performance-speedup trade-off. The code is publicly available.


title: Ada-VE: Training-Free Consistent Video Editing Using Adaptive Motion Prior

abstract: Video-to-video synthesis models face significant challenges, such as ensuring consistent character generation across frames, maintaining smooth temporal transitions, and preserving quality during fast motion. The introduction of joint fully cross-frame self-attention mechanisms has improved character consistency, but this comes at the cost of increased computational complexity. This full cross-frame self-attention mechanism also incorporates redundant details and limits the number of frames that can be jointly edited due to its computational cost. Moreover, the lack of frames in cross-frame attention adversely affects temporal consistency and visual quality. To address these limitations, we propose a new adaptive motion-guided cross-frame attention mechanism that drastically reduces complexity while preserving semantic details and temporal consistency. Specifically, we selectively incorporate the moving regions of successive frames in cross-frame attention and sparsely include stationary regions based on optical flow sampling. This technique allows for an increased number of jointly edited frames without additional computational overhead. For longer duration of video editing, existing methods primarily focus on frame interpolation or flow-warping from jointly edited keyframes, which often results in blurry frames or reduced temporal consistency. To improve this, we introduce KV-caching of jointly edited frames and reuse the same KV across all intermediate frames, significantly enhancing both intermediate frame quality and temporal consistency. Overall, our motion-sampling method enables the use of around three times more keyframes than existing joint editing methods while maintaining superior prediction quality. Ada-VE achieves up to 4x speed-up when using fully-extended self-attention across 40 frames for joint editing, without compromising visual quality or temporal consistency.


title: Approximate Bayesian Computation with Deep Learning and Conformal prediction

abstract: Approximate Bayesian Computation (ABC) methods are commonly used to approximate posterior distributions in models with unknown or computationally intractable likelihoods. Classical ABC methods are based on nearest neighbor type algorithms and rely on the choice of so-called summary statistics, distances between datasets and a tolerance threshold. Recently, methods combining ABC with more complex machine learning algorithms have been proposed to mitigate the impact of these "user-choices". In this paper, we propose the first, to our knowledge, ABC method completely free of summary statistics, distance and tolerance threshold. Moreover, in contrast with usual generalizations of the ABC method, it associates a confidence interval (having a proper frequentist marginal coverage) with the posterior mean estimation (or other moment-type estimates). Our method, ABCD-Conformal, uses a neural network with Monte Carlo Dropout to provide an estimation of the posterior mean (or others moment type functional), and conformal theory to obtain associated confidence sets. Efficient for estimating multidimensional parameters, we test this new method on three different applications and compare it with other ABC methods in the literature.


title: 3DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Views

abstract: 3D cars are commonly used in self-driving systems, virtual/augmented reality, and games. However, existing 3D car datasets are either synthetic or low-quality, presenting a significant gap toward the high-quality real-world 3D car datasets and limiting their applications in practical scenarios. In this paper, we propose the first large-scale 3D real car dataset, termed 3DRealCar, offering three distinctive features. (1) \textbf{High-Volume}: 2,500 cars are meticulously scanned by 3D scanners, obtaining car images and point clouds with real-world dimensions; (2) \textbf{High-Quality}: Each car is captured in an average of 200 dense, high-resolution 360-degree RGB-D views, enabling high-fidelity 3D reconstruction; (3) \textbf{High-Diversity}: The dataset contains various cars from over 100 brands, collected under three distinct lighting conditions, including reflective, standard, and dark. Additionally, we offer detailed car parsing maps for each instance to promote research in car parsing tasks. Moreover, we remove background point clouds and standardize the car orientation to a unified axis for the reconstruction only on cars without background and controllable rendering. We benchmark 3D reconstruction results with state-of-the-art methods across each lighting condition in 3DRealCar. Extensive experiments demonstrate that the standard lighting condition part of 3DRealCar can be used to produce a large number of high-quality 3D cars, improving various 2D and 3D tasks related to cars. Notably, our dataset brings insight into the fact that recent 3D reconstruction methods face challenges in reconstructing high-quality 3D cars under reflective and dark lighting conditions. \textcolor{red}{\href{https://xiaobiaodu.github.io/3drealcar/}{Our dataset is available here.}}


title: HateDebias: On the Diversity and Variability of Hate Speech Debiasing

abstract: Hate speech on social media is ubiquitous but urgently controlled. Without detecting and mitigating the biases brought by hate speech, different types of ethical problems. While a number of datasets have been proposed to address the problem of hate speech detection, these datasets seldom consider the diversity and variability of bias, making it far from real-world scenarios. To fill this gap, we propose a benchmark, named HateDebias, to analyze the model ability of hate speech detection under continuous, changing environments. Specifically, to meet the diversity of biases, we collect existing hate speech detection datasets with different types of biases. To further meet the variability (i.e., the changing of bias attributes in datasets), we reorganize datasets to follow the continuous learning setting. We evaluate the detection accuracy of models trained on the datasets with a single type of bias with the performance on the HateDebias, where a significant performance drop is observed. To provide a potential direction for debiasing, we further propose a debiasing framework based on continuous learning and bias information regularization, as well as the memory replay strategies to ensure the debiasing ability of the model. Experiment results on the proposed benchmark show that the aforementioned method can improve several baselines with a distinguished margin, highlighting its effectiveness in real-world applications.


title: A star-comb lemma for infinite digraphs

abstract: The star-comb lemma is a fundamental tool in infinite graph theory, which states that for any infinite set $U$ of vertices in a connected graph $G$ there exists either a subdivided infinite star in $G$ with all leaves in $U$, or an infinite comb in $G$ with all teeth in $U$. In this paper, we elaborate a pendant of the star-comb lemma for directed graphs. More precisely, we prove that for any infinite set $U$ of vertices in a strongly connected directed graph $D$, there exists a strongly connected substructure of $D$ attached to infinitely many vertices of $U$ that is either shaped by a star or shaped by a comb, or is a chain of triangles.


title: Fourth Post-Minkowskian Local-in-Time Conservative Dynamics of Binary Systems

abstract: We compute the purely local-in-time (scale-free and logarithm-free) part of the conservative dynamics of gravitationally interacting two-body systems at the fourth post-Minkowskian order, and at the thirtiest order in velocity. The gauge-invariant content of this fourth post-Minkowskian local dynamics is given in two ways: (i) its contribution to the on-shell action (for both hyperboliclike and ellipticlike motions); and (ii) its contribution to the Effective One Body Hamiltonian (in energy gauge). Our computation capitalizes on the Tutti Frutti approach [Phys. Rev. Lett. \textbf{123}, no.23, 231104 (2019)], and on recent post-Minkowskian advances [Phys. Rev. Lett. \textbf{128}, no.16, 161103 (2022)], [Phys. Rev. Lett. \textbf{128}, no.16, 161104 (2022)], and [Phys. Rev. Lett. \textbf{132}, no.22, 221401 (2024)].


title: A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques

abstract: Large language models are first pre-trained on trillions of tokens and then instruction-tuned or aligned to specific preferences. While pre-training remains out of reach for most researchers due to the compute required, fine-tuning has become affordable thanks to parameter-efficient methods such as LoRA and QLoRA. Alignment is known to be sensitive to the many factors involved, including the quantity and quality of data, the alignment method, and the adapter rank. However, there has not yet been an extensive study of their effect on downstream performance. To address this gap, we conduct an in-depth investigation of the impact of popular choices for three crucial axes: (i) the alignment dataset (HH-RLHF and BeaverTails), (ii) the alignment technique (SFT and DPO), and (iii) the model (LLaMA-1, Vicuna-v1.3, Mistral-7b, and Mistral-7b-Instruct). Our extensive setup spanning over 300 experiments reveals consistent trends and unexpected findings. We observe how more informative data helps with preference alignment, cases where supervised fine-tuning outperforms preference optimization, and how aligning to a distinct preference boosts performance on downstream tasks. Through our in-depth analyses, we put forward key guidelines to help researchers perform more effective parameter-efficient LLM alignment.


title: The free boundary problem of an epidemic model with nonlocal diffusions and nonlocal reactions: spreading-vanishing dichotomy

abstract: This paper concerns the free boundary problem of an epidemic model. The spatial movements of the infectious agents and the infective humans are approximated by nonlocal diffusion operators. Especially, both the growth rate of the agents and the infective rate of humans are represented by nonlocal reaction terms. Thus our model has four integral terms which bring some diffculties for the study of the corresponding principal eigenvalue problem. Firstly, using some elementray analysis instead of Krein-Rutman theorem and the variational characteristic, we obtain the existence and asymptotic behaviors of principal eigenvalue. Then a spreading-vanishing dichotomy is proved to hold, and the criteria for spreading and vanishing are derived. Lastly, comparing our results with those in the existing works, we discuss the effect of nonlocal reaction term on spreading and vanishing, finding that the more nonlocal reaction terms a model has, the harder spreading happens.


title: MIMO Capacity Analysis and Channel Estimation for Electromagnetic Information Theory

abstract: Electromagnetic information theory (EIT) is an interdisciplinary subject that serves to integrate deterministic electromagnetic theory with stochastic Shannon's information theory. Existing EIT analysis operates in the continuous space domain, which is not aligned with the practical algorithms working in the discrete space domain. This mismatch leads to a significant difficulty in application of EIT methodologies to practical discrete space systems, which is called as the discrete-continuous gap in this paper. To bridge this gap, we establish the discrete-continuous correspondence with a prolate spheroidal wave function (PSWF)-based ergodic capacity analysis framework. Specifically, we state and prove some discrete-continuous correspondence lemmas to establish a firm theoretical connection between discrete information-theoretic quantities to their continuous counterparts. With these lemmas, we apply the PSWF ergodic capacity bound to advanced MIMO architectures such as continuous-aperture MIMO (CAP-MIMO) and extremely large-scale MIMO (XL-MIMO). From this PSWF capacity bound, we discover the capacity saturation phenomenon both theoretically and empirically. Although the growth of MIMO performance is fundamentally limited in this EIT-based analysis framework, we reveal new opportunities in MIMO channel estimation by exploiting the EIT knowledge about the channel. Inspired by the PSWF capacity bound, we utilize continuous PSWFs to improve the pilot design of discrete MIMO channel estimators, which is called as the PSWF channel estimator (PSWF-CE). Simulation results demonstrate improved performances of the proposed PSWF-CE, compared to traditional minimum mean squared error (MMSE) and compressed sensing-based estimators.


title: InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environment

abstract: Enabling robots to navigate following diverse language instructions in unexplored environments is an attractive goal for human-robot interaction. However, this goal is challenging because different navigation tasks require different strategies. The scarcity of instruction navigation data hinders training an instruction navigation model with varied strategies. Therefore, previous methods are all constrained to one specific type of navigation instruction. In this work, we propose InstructNav, a generic instruction navigation system. InstructNav makes the first endeavor to handle various instruction navigation tasks without any navigation training or pre-built maps. To reach this goal, we introduce Dynamic Chain-of-Navigation (DCoN) to unify the planning process for different types of navigation instructions. Furthermore, we propose Multi-sourced Value Maps to model key elements in instruction navigation so that linguistic DCoN planning can be converted into robot actionable trajectories. With InstructNav, we complete the R2R-CE task in a zero-shot way for the first time and outperform many task-training methods. Besides, InstructNav also surpasses the previous SOTA method by 10.48% on the zero-shot Habitat ObjNav and by 86.34% on demand-driven navigation DDN. Real robot experiments on diverse indoor scenes further demonstrate our method's robustness in coping with the environment and instruction variations.


title: Upright to supine image registration and contour propagation for thoracic patients

abstract: A renewed interest in upright therapy is currently driven by the availability of upright positioning and imaging systems. Aside from reduced cost, upright positioning possibly provides clinical advantages. The comparison between upright and supine particle therapy treatments can be biased through multiple variables, such as differences in the target contouring on the two CTs. We present a method for upright and supine CT registration and structures propagation, and the investigation of an AI-based contouring tool for upright images. Six paired 4DCTs from Proton Therapy Collaboration Group registry were available from the Northwestern Medicine Proton Centre. Deformable image registration (DIR) is challenged by the different patient anatomy between postures, causing artefacts in the warped images. To achieve high quality contour propagation, we propose the construction of a region of interest covering the ribcage volume to overcome this problem. As no target contour ground truth was available, the registration quality analysis (QA) was performed on lung structures, for which dice score coefficient (DSC) and average Hausdorff distance (AHD) is reported. The TotalSegmentator tool, trained on supine dataset, was applied on upright images, verified against lung structures and used as additional comparison for contour propagation. The TotalSegmentator QA results in a maximum AHD of 2mm and a minimum DSC of 0.94. An average AHD of 1.5mm and 1.6mm, and an average DSC of 0.95 and 0.94 were obtained comparing the propagated volumes to manually contoured and AI structures, respectively. All AHD values are smaller than the CT slice distances. The developed framework allows for target propagation between upright and supine images, defining the first step to compare upright and supine therapy of thoracic patients and enabling the application of image fusion techniques in the upright therapy field.


title: Stability of stationary states for mean field models with multichromatic interaction potentials

abstract: We consider weakly interacting diffusions on the torus, for multichromatic interaction potentials. We consider interaction potentials that are not H-stable, leading to phase transitions in the mean field limit. We show that the mean field dynamics can exhibit multipeak stationary states, where the number of peaks is related to the number of nonzero Fourier modes of the interaction. We also consider the effect of a confining potential on the structure of non-uniform steady states. We approach the problem by means of analysis, perturbation theory and numerical simulations for the interacting particle systems and the PDEs.


title: Characters for extended affine Lie algebras; a combinatorial approach

abstract: The behavior of objects associated with general extended affine Lie algebras is typically distinct from their counterparts in affine Lie algebras. Our research focuses on studying characters and Cartan automorphisms, which appear in the study of Chevalley involutions and Chevalley bases for extended affine Lie algebras. We show that for almost all extended affine Lie algebras, any finite order Cartan automorphism is diagonal, and its corresponding combinatorial map is a character.


title: Seeing the Unseen: Visual Metaphor Captioning for Videos

abstract: Metaphors are a common communication tool used in our day-to-day life. The detection and generation of metaphors in textual form have been studied extensively but metaphors in other forms have been under-explored. Recent studies have shown that Vision-Language (VL) models cannot understand visual metaphors in memes and adverts. As of now, no probing studies have been done that involve complex language phenomena like metaphors with videos. Hence, we introduce a new VL task of describing the metaphors present in the videos in our work. To facilitate this novel task, we construct and release a manually created dataset with 705 videos and 2115 human-written captions, along with a new metric called Average Concept Distance (ACD), to automatically evaluate the creativity of the metaphors generated. We also propose a novel low-resource video metaphor captioning system: GIT-LLaVA, which obtains comparable performance to SoTA video language models on the proposed task. We perform a comprehensive analysis of existing video language models on this task and publish our dataset, models, and benchmark results to enable further research.


title: A variable version of the quasi-kernel conjecture

abstract: A quasi-kernel of a digraph $D$ is an independent set $Q$ such that every vertex can reach $Q$ in at most two steps. A 48-year conjecture made by P.L. Erd\H{o}s and Sz\'ekely, denoted the small QK conjecture, says that every sink-free digraph contains a quasi-kernel of size at most $n/2$. Recently, Spiro posed the large QK conjecture, that every sink-free digraph contains a quasi-kernel $Q$ such that $|N^-[Q]|\geq n/2$, and showed that it follows from the small QK conjecture. In this paper, we establish that the large QK conjecture implies the small QK conjecture with a weaker constant. We also show that the large QK conjecture is equivalent to a sharp version of it, answering affirmatively a question of Spiro. We formulate variable versions of these conjectures, which are still open in general. Not many digraphs are known to have quasi-kernels of size $(1-\alpha)n$ or less. We show this for digraphs with bounded dichromatic number, by proving the stronger statement that every sink-free digraph contains a quasi-kernel of size at most $(1-1/k)n$, where $k$ is the digraph's kernel-perfect number.


title: Zero-Shot Video Editing through Adaptive Sliding Score Distillation

abstract: The burgeoning field of text-based video generation (T2V) has reignited significant interest in the research of controllable video editing. Although pre-trained T2V-based editing models have achieved efficient editing capabilities, current works are still plagued by two major challenges. Firstly, the inherent limitations of T2V models lead to content inconsistencies and motion discontinuities between frames. Secondly, the notorious issue of over-editing significantly disrupts areas that are intended to remain unaltered. To address these challenges, our work aims to explore a robust video-based editing paradigm based on score distillation. Specifically, we propose an Adaptive Sliding Score Distillation strategy, which not only enhances the stability of T2V supervision but also incorporates both global and local video guidance to mitigate the impact of generation errors. Additionally, we modify the self-attention layers during the editing process to further preserve the key features of the original video. Extensive experiments demonstrate that these strategies enable us to effectively address the aforementioned challenges, achieving superior editing performance compared to existing state-of-the-art methods.


title: Ensuring Grid-Safe Forwarding of Distributed Flexibility in Sequential DSO-TSO Markets

abstract: This paper investigates sequential flexibility markets consisting of a first market layer for distribution system operators (DSOs) to procure local flexibility to resolve their own needs (e.g., congestion management) followed by a second layer, in which the transmission system operator (TSO) procures remaining flexibility forwarded from the distribution system layer as well as flexibility from its own system for providing system services. As the TSO does not necessarily have full knowledge of the distribution grid constraints, this bid forwarding can cause an infeasibility problem for distribution systems, i.e., cleared distribution-level bids in the TSO layer might not satisfy local network constraints. To address this challenge, we introduce and examine three methods aiming to enable the grid-safe use of distribution-located resources in markets for system services, namely: a corrective three-layer market scheme, a bid prequalification/filtering method, and a bid aggregation method. Technically, we provide conditions under which these methods can produce a grid-safe use of distributed flexibility. We also characterize the efficiency of the market outcome under these methods. Finally, we carry out a representative case study to evaluate the performances of the three methods, focusing on economic efficiency, grid-safety, and computational load.


title: Enhancing Indoor Temperature Forecasting through Synthetic Data in Low-Data Environments

abstract: Forecasting indoor temperatures is important to achieve efficient control of HVAC systems. In this task, the limited data availability presents a challenge as most of the available data is acquired during standard operation where extreme scenarios and transitory regimes such as major temperature increases or decreases are de-facto excluded. Acquisition of such data requires significant energy consumption and a dedicated facility, hindering the quantity and diversity of available data. Cost related constraints however do not allow for continuous year-around acquisition. To address this, we investigate the efficacy of data augmentation techniques leveraging SoTA AI-based methods for synthetic data generation. Inspired by practical and experimental motivations, we explore fusion strategies of real and synthetic data to improve forecasting models. This approach alleviates the need for continuously acquiring extensive time series data, especially in contexts involving repetitive heating and cooling cycles in buildings. In our evaluation 1) we assess the performance of synthetic data generators independently, particularly focusing on SoTA AI-based methods; 2) we measure the utility of incorporating synthetically augmented data in a subsequent forecasting tasks where we employ a simple model in two distinct scenarios: 1) we first examine an augmentation technique that combines real and synthetically generated data to expand the training dataset, 2) we delve into utilizing synthetic data to tackle dataset imbalances. Our results highlight the potential of synthetic data augmentation in enhancing forecasting accuracy while mitigating training variance. Through empirical experiments, we show significant improvements achievable by integrating synthetic data, thereby paving the way for more robust forecasting models in low-data regime.


title: Dispersive Qubit Readout with Intrinsic Resonator Reset

abstract: A key challenge in quantum computing is speeding up measurement and initialization. Here, we experimentally demonstrate a dispersive measurement method for superconducting qubits that simultaneously measures the qubit and returns the readout resonator to its initial state. The approach is based on universal analytical pulses and requires knowledge of the qubit and resonator parameters, but needs no direct optimization of the pulse shape, even when accounting for the nonlinearity of the system. Moreover, the method generalizes to measuring an arbitrary number of modes and states. For the qubit readout, we can drive the resonator to $\sim 10^2$ photons and back to $\sim 10^{-3}$ photons in less than $3 \kappa^{-1}$, while still achieving a $T_1$-limited assignment error below 1\%. We also present universal pulse shapes and experimental results for qutrit readout.


title: Sexism Detection on a Data Diet

abstract: There is an increase in the proliferation of online hate commensurate with the rise in the usage of social media. In response, there is also a significant advancement in the creation of automated tools aimed at identifying harmful text content using approaches grounded in Natural Language Processing and Deep Learning. Although it is known that training Deep Learning models require a substantial amount of annotated data, recent line of work suggests that models trained on specific subsets of the data still retain performance comparable to the model that was trained on the full dataset. In this work, we show how we can leverage influence scores to estimate the importance of a data point while training a model and designing a pruning strategy applied to the case of sexism detection. We evaluate the model performance trained on data pruned with different pruning strategies on three out-of-domain datasets and find, that in accordance with other work a large fraction of instances can be removed without significant performance drop. However, we also discover that the strategies for pruning data, previously successful in Natural Language Inference tasks, do not readily apply to the detection of harmful content and instead amplify the already prevalent class imbalance even more, leading in the worst-case to a complete absence of the hateful class.


title: Proton 3D reconstruction with T-odd TMD gluon densities

abstract: We present studies aimed at probing the 3D gluon content of the proton through spin-dependent TMD gluon densities, computed by means of the spectator-model approach. Our formalism incorporates a fit-based modulation function for the spectator mass, designed to capture longitudinal-momentum effects across a broad kinematic range. Special emphasis is placed on the time-reversal even Boer-Mulders and the time-reversal odd Sivers functions. Accurate understanding of these functions is crucial for conducting precise 3D analyses of nucleons, highlighting the importance of collaborative efforts between the LHC and EIC Communities.


title: Recovering a phase transition signal in simulated LISA data with a modulated galactic foreground

abstract: Stochastic backgrounds of gravitational waves from primordial first-order phase transitions are a key probe of physics beyond the Standard Model. They represent one of the best prospects for observing or constraining new physics with the LISA gravitational wave observatory. However, the large foreground population of galactic binaries in the same frequency range represents a challenge, and will hinder the recovery of a stochastic background. To test the recoverability of a stochastic gravitational wave background, we use the LISA Simulation Suite to generate data incorporating both a stochastic background and an annually modulated foreground modelling the galactic binary population, and the Bayesian analysis code Cobaya to attempt to recover the model parameters. By applying the Deviance Information Criterion to compare models with and without a stochastic background we place bounds on the detectability of gravitational waves from first-order phase transitions. By further comparing models with and without the annual modulation, we show that exploiting the modulation improves the goodness-of-fit and gives a modest improvement to the bounds on detectable models.


title: Operator entanglement growth quantifies complexity of cellular automata

abstract: Cellular automata (CA) exemplify systems where simple local interaction rules can lead to intricate and complex emergent phenomena at large scales. The various types of dynamical behavior of CA are usually categorized empirically into Wolfram's complexity classes. Here, we propose a quantitative measure, rooted in quantum information theory, to categorize the complexity of classical deterministic cellular automata. Specifically, we construct a Matrix Product Operator (MPO) of the transition matrix on the space of all possible CA configurations. We find that the growth of entropy of the singular value spectrum of the MPO reveals the complexity of the CA and can be used to characterize its dynamical behavior. This measure defines the concept of operator entanglement entropy for CA, demonstrating that quantum information measures can be meaningfully applied to classical deterministic systems.


title: Stabilizing Extreme Q-learning by Maclaurin Expansion

abstract: In Extreme Q-learning (XQL), Gumbel Regression is performed with an assumed Gumbel distribution for the error distribution. This allows learning of the value function without sampling out-of-distribution actions and has shown excellent performance mainly in Offline RL. However, issues remained, including the exponential term in the loss function causing instability and the potential for an error distribution diverging from the Gumbel distribution. Therefore, we propose Maclaurin Expanded Extreme Q-learning to enhance stability. In this method, applying Maclaurin expansion to the loss function in XQL enhances stability against large errors. It also allows adjusting the error distribution assumption from normal to Gumbel based on the expansion order. Our method significantly stabilizes learning in Online RL tasks from DM Control, where XQL was previously unstable. Additionally, it improves performance in several Offline RL tasks from D4RL, where XQL already showed excellent results.


title: From Link Prediction to Forecasting: Information Loss in Batch-based Temporal Graph Learning

abstract: Dynamic link prediction is an important problem considered by many recent works proposing various approaches for learning temporal edge patterns. To assess their efficacy, models are evaluated on publicly available benchmark datasets involving continuous-time and discrete-time temporal graphs. However, as we show in this work, the suitability of common batch-oriented evaluation depends on the datasets' characteristics, which can cause two issues: First, for continuous-time temporal graphs, fixed-size batches create time windows with different durations, resulting in an inconsistent dynamic link prediction task. Second, for discrete-time temporal graphs, the sequence of batches can additionally introduce temporal dependencies that are not present in the data. In this work, we empirically show that this common evaluation approach leads to skewed model performance and hinders the fair comparison of methods. We mitigate this problem by reformulating dynamic link prediction as a link forecasting task that better accounts for temporal information present in the data. We provide implementations of our new evaluation method for commonly used graph learning frameworks.


title: Labeled Data Selection for Category Discovery

abstract: Category discovery methods aim to find novel categories in unlabeled visual data. At training time, a set of labeled and unlabeled images are provided, where the labels correspond to the categories present in the images. The labeled data provides guidance during training by indicating what types of visual properties and features are relevant for performing discovery in the unlabeled data. As a result, changing the categories present in the labeled set can have a large impact on what is ultimately discovered in the unlabeled set. Despite its importance, the impact of labeled data selection has not been explored in the category discovery literature to date. We show that changing the labeled data can significantly impact discovery performance. Motivated by this, we propose two new approaches for automatically selecting the most suitable labeled data based on the similarity between the labeled and unlabeled data. Our observation is that, unlike in conventional supervised transfer learning, the best labeled is neither too similar, nor too dissimilar, to the unlabeled categories. Our resulting approaches obtains state-of-the-art discovery performance across a range of challenging fine-grained benchmark datasets.


title: Sliding Window 3-Objective Pareto Optimization for Problems with Chance Constraints

abstract: Constrained single-objective problems have been frequently tackled by evolutionary multi-objective algorithms where the constraint is relaxed into an additional objective. Recently, it has been shown that Pareto optimization approaches using bi-objective models can be significantly sped up using sliding windows (Neumann and Witt, ECAI 2023). In this paper, we extend the sliding window approach to $3$-objective formulations for tackling chance constrained problems. On the theoretical side, we show that our new sliding window approach improves previous runtime bounds obtained in (Neumann and Witt, GECCO 2023) while maintaining the same approximation guarantees. Our experimental investigations for the chance constrained dominating set problem show that our new sliding window approach allows one to solve much larger instances in a much more efficient way than the 3-objective approach presented in (Neumann and Witt, GECCO 2023).


title: Deconfinement and chiral phase transitions in quark matter with chiral imbalance

abstract: We study the thermodynamics of the Polyakov--Nambu--Jona-Lasinio model considering the effects of an effective chiral chemical potential. We offer a new parametrization of the Polyakov loop potential depending on temperature and the chemical potential which, when used together with a proper regularization scheme of vacuum contributions, predicts results consistent with those from lattice simulations.


title: Exotic compact objects: a recent numerical-relativity perspective

abstract: Beyond black holes and neutron stars, new hypothetical compact objects have been proposed as potential astrophysical entities. In general, their properties have not yet been fully explored or understood, nor has it been proven whether or not they exist in nature. They are the so-called $\textit{exotic compact objects}$, theoretical equilibrium configurations in the strong regime of gravity that involve new exotic physical phenomena deeply related to fundamental questions of theoretical physics (e.g., the nature of dark matter, the formation of singularities, or the presence of horizons). Among these exotic objects, there are those that require the existence of new fields and particles beyond the Standard Model, such as boson stars and ultralight bosons; those that seek to describe the dense equation of state of neutron stars as an even more extreme state of matter made up of free quarks; or those that exhibit additional properties related to extensions of General Relativity or even quantum gravity. However, in order to move from theoretical objects to astrophysical objects, their dynamics and stability must first be assessed by performing numerical-relativity simulations under the premise that solutions that are unstable on dynamical timescales will never completely form, being, at most, a transient state that will not be able to play any astrophysical role. Furthermore, numerical simulations also make it possible to extract the gravitational radiation from relevant astrophysical scenarios, such as the collapse of exotic stars or binary mergers, which could then be compared with current and upcoming LIGO-Virgo-KAGRA gravitational-wave detections.


title: Beyond Data, Towards Sustainability: A Sydney Case Study on Urban Digital Twins

abstract: As urban areas grapple with unprecedented challenges stemming from population growth and climate change, the emergence of urban digital twins offers a promising solution. This paper presents a case study focusing on Sydney's urban digital twin, a virtual replica integrating diverse real-time and historical data, including weather, crime, emissions, and traffic. Through advanced visualization and data analysis techniques, the study explores some applications of this digital twin in urban sustainability, such as spatial ranking of suburbs and automatic identification of correlations between variables. Additionally, the research delves into predictive modeling, employing machine learning to forecast traffic crash risks using environmental data, showcasing the potential for proactive interventions. The contributions of this work lie in the comprehensive exploration of a city-scale digital twin for sustainable urban planning, offering a multifaceted approach to data-driven decision-making.


title: Concept Drift Detection using Ensemble of Integrally Private Models

abstract: Deep neural networks (DNNs) are one of the most widely used machine learning algorithm. DNNs requires the training data to be available beforehand with true labels. This is not feasible for many real-world problems where data arrives in the streaming form and acquisition of true labels are scarce and expensive. In the literature, not much focus has been given to the privacy prospect of the streaming data, where data may change its distribution frequently. These concept drifts must be detected privately in order to avoid any disclosure risk from DNNs. Existing privacy models use concept drift detection schemes such ADWIN, KSWIN to detect the drifts. In this paper, we focus on the notion of integrally private DNNs to detect concept drifts. Integrally private DNNs are the models which recur frequently from different datasets. Based on this, we introduce an ensemble methodology which we call 'Integrally Private Drift Detection' (IPDD) method to detect concept drift from private models. Our IPDD method does not require labels to detect drift but assumes true labels are available once the drift has been detected. We have experimented with binary and multi-class synthetic and real-world data. Our experimental results show that our methodology can privately detect concept drift, has comparable utility (even better in some cases) with ADWIN and outperforms utility from different levels of differentially private models. The source code for the paper is available \hyperlink{https://github.com/Ayush-Umu/Concept-drift-detection-Using-Integrally-private-models}{here}.


title: XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Model

abstract: Most Zero-shot Multi-speaker TTS (ZS-TTS) systems support only a single language. Although models like YourTTS, VALL-E X, Mega-TTS 2, and Voicebox explored Multilingual ZS-TTS they are limited to just a few high/medium resource languages, limiting the applications of these models in most of the low/medium resource languages. In this paper, we aim to alleviate this issue by proposing and making publicly available the XTTS system. Our method builds upon the Tortoise model and adds several novel modifications to enable multilingual training, improve voice cloning, and enable faster training and inference. XTTS was trained in 16 languages and achieved state-of-the-art (SOTA) results in most of them.


title: On a higher-dimensional worm domain and its geometric properties

abstract: We construct new $3$-dimensional variants of the classical Diederich-Fornaess worm domain. We show that they are smoothly bounded, pseudoconvex, and have nontrivial Nebenh\"{u}lle. We also show that their Bergman projections do not preserve the Sobolev space for sufficiently large Sobolev indices.


title: RU-AI: A Large Multimodal Dataset for Machine Generated Content Detection

abstract: The recent advancements in generative AI models, which can create realistic and human-like content, are significantly transforming how people communicate, create, and work. While the appropriate use of generative AI models can benefit the society, their misuse poses significant threats to data reliability and authentication. However, due to a lack of aligned multimodal datasets, effective and robust methods for detecting machine-generated content are still in the early stages of development. In this paper, we introduce RU-AI, a new large-scale multimodal dataset designed for the robust and efficient detection of machine-generated content in text, image, and voice. Our dataset is constructed from three large publicly available datasets: Flickr8K, COCO, and Places205, by combining the original datasets and their corresponding machine-generated pairs. Additionally, experimental results show that our proposed unified model, which incorporates a multimodal embedding module with a multilayer perceptron network, can effectively determine the origin of the data (i.e., original data samples or machine-generated ones) from RU-AI. However, future work is still required to address the remaining challenges posed by RU-AI. The source code and dataset are available at https://github.com/ZhihaoZhang97/RU-AI.


title: A Modular Framework for Flexible Planning in Human-Robot Collaboration

abstract: This paper presents a comprehensive framework to enhance Human-Robot Collaboration (HRC) in real-world scenarios. It introduces a formalism to model articulated tasks, requiring cooperation between two agents, through a smaller set of primitives. Our implementation leverages Hierarchical Task Networks (HTN) planning and a modular multisensory perception pipeline, which includes vision, human activity recognition, and tactile sensing. To showcase the system's scalability, we present an experimental scenario where two humans alternate in collaborating with a Baxter robot to assemble four pieces of furniture with variable components. This integration highlights promising advancements in HRC, suggesting a scalable approach for complex, cooperative tasks across diverse applications.


title: Dosimetric comparison of the BNCT treatment planning performances when using a nnU-NET to automatically segment Glioblastoma Multiforme

abstract: This work presents a preliminary evaluation of the use of the convolutional neural network nnU-NET to automatically contour the volume of Glioblastoma Multiforme in medical images of patients. The goal is to assist the preparation of the Treatment Planning of patients who undergo Boron Neutron Capture Therapy (BNCT). BNCT is a binary form of radiotherapy based on the selective loading of a suitable 10-boron concentration into the tumour and on subsequent low-energy neutron irradiation. The selectivity of the therapeutic effect is based on the capacity of the boron drug to target preferentially cancer cells, thus triggering the neutron capture only in the tumour and depositing there a lethal dose. Even if the tailoring of the beam to the tumour volume is less crucial for BNCT than for other radiation therapies, a proper delimitation of the tumour volume is needed to assess a safe and effective dosimetry. In clinical application the contour must be manually decided by the physician, however, a tool to automatically define important structures such as the Gross Tumour Volume (GTV) and the Organs At Risk (OAR) would be beneficial to enable medical physicists assessing preliminary positioning and simulated dosimetry before the approval or possible changes introduced by the radiotherapist. Moreover, an initial contouring may speed up the work of the physician. The nnU-NET was trained and tested and its performance was evaluated through different parameters such as the Dice Coefficient. To assess a more meaningful evaluation for BNCT, for the first time, this work analyzed the difference of the clinical dosimetry in 16 patients using the manual and the automatic contoured images.


title: Orchestrating time and color: a programmable source of high-dimensional entanglement

abstract: High-dimensional encodings based on temporal modes (TMs) of photonic quantum states provide the foundations for a highly versatile and efficient quantum information science (QIS) framework. Here, we demonstrate a crucial building block for any QIS applications based on TMs: a programmable source of maximally entangled high-dimensional TM states. Our source is based on a parametric down-conversion process driven by a spectrally shaped pump pulse, which facilitates the generation of maximally entangled TM states with a well-defined dimensionality that can be chosen programmatically. We characterize the effective dimensionality of the generated states via measurements of second-order correlation functions and joint spectral intensities, demonstrating the generation of bi-photon TM states with a controlled dimensionality in up to 20 dimensions.


title: PolyLUT-Add: FPGA-based LUT Inference with Wide Inputs

abstract: FPGAs have distinct advantages as a technology for deploying deep neural networks (DNNs) at the edge. Lookup Table (LUT) based networks, where neurons are directly modelled using LUTs, help maximize this promise of offering ultra-low latency and high area efficiency on FPGAs. Unfortunately, LUT resource usage scales exponentially with the number of inputs to the LUT, restricting PolyLUT to small LUT sizes. This work introduces PolyLUT-Add, a technique that enhances neuron connectivity by combining $A$ PolyLUT sub-neurons via addition to improve accuracy. Moreover, we describe a novel architecture to improve its scalability. We evaluated our implementation over the MNIST, Jet Substructure classification and Network Intrusion Detection benchmark and found that for similar accuracy, PolyLUT-Add achieves a LUT reduction of $1.3-7.7\times$ with a $1.2-2.2\times$ decrease in latency.


title: Mean field stable matchings

abstract: Consider the complete bipartite graph on $n+n$ vertices where the edges are equipped with i.i.d. exponential costs. A matching of the vertices is stable if it does not contain any pair of vertices where the connecting edge is cheaper than both matching costs. There exists a unique stable matching obtained by iteratively pairing vertices with small edge costs. We show that the total cost $C_{n,n}$ of this matching is of order $\log n$ with bounded variance, and that $C_{n,n}-\log n$ converges to a Gumbel distribution. We also show that the typical cost of an edge in the matching is of order $1/n$, with an explicit density on this scale, and analyze the rank of a typical edge. These results parallel those of Aldous for the minimal cost matching in the same setting. We then consider the sensitivity of the matching and the matching cost to perturbations of the underlying edge costs. The matching itself is shown to be robust in the sense that two matchings based on largely identical edge costs will have a substantial overlap. The matching cost however is shown to be noise sensitive, as a result of the fact that the most expensive edges will with high probability be replaced after resampling. Our proofs also apply to the complete (unipartite) graph and the results in this case are qualitatively similar.


title: Mexican Computers: A Brief Technical and Historical Overview

abstract: The emergence of the microprocessor in the early 1970s allowed the design of computers that did not require the substantial economic resources of large computer companies of that era. Shortly after this event, a variety of computers based on microprocessors appeared in the United States and other developed countries. Unlike in those countries, where small and large companies developed most personal computers, in Mexico, the first microprocessor-based computers were designed within academic institutions. It is little known that Mexican computers of that era included a variety of systems ranging from purpose-specific research and teaching-oriented computers to high-performance personal computers. The goal of this article is to describe in detail some of these Mexican computers designed between the late 1970s and mid-1980s.


title: Online Adaptation for Enhancing Imitation Learning Policies

abstract: Imitation learning enables autonomous agents to learn from human examples, without the need for a reward signal. Still, if the provided dataset does not encapsulate the task correctly, or when the task is too complex to be modeled, such agents fail to reproduce the expert policy. We propose to recover from these failures through online adaptation. Our approach combines the action proposal coming from a pre-trained policy with relevant experience recorded by an expert. The combination results in an adapted action that closely follows the expert. Our experiments show that an adapted agent performs better than its pure imitation learning counterpart. Notably, adapted agents can achieve reasonable performance even when the base, non-adapted policy catastrophically fails.


title: Submodular Framework for Structured-Sparse Optimal Transport

abstract: Unbalanced optimal transport (UOT) has recently gained much attention due to its flexible framework for handling un-normalized measures and its robustness properties. In this work, we explore learning (structured) sparse transport plans in the UOT setting, i.e., transport plans have an upper bound on the number of non-sparse entries in each column (structured sparse pattern) or in the whole plan (general sparse pattern). We propose novel sparsity-constrained UOT formulations building on the recently explored maximum mean discrepancy based UOT. We show that the proposed optimization problem is equivalent to the maximization of a weakly submodular function over a uniform matroid or a partition matroid. We develop efficient gradient-based discrete greedy algorithms and provide the corresponding theoretical guarantees. Empirically, we observe that our proposed greedy algorithms select a diverse support set and we illustrate the efficacy of the proposed approach in various applications.


title: Bayesian inference of Latent Spectral Shapes

abstract: This paper proposes a hierarchical spatial-temporal model for modelling the spectrograms of animal calls. The motivation stems from analyzing recordings of the so-called grunt calls emitted by various lemur species. Our goal is to identify a latent spectral shape that characterizes each species and facilitates measuring dissimilarities between them. The model addresses the synchronization of animal vocalizations, due to varying time-lengths and speeds, with non-stationary temporal patterns and accounts for periodic sampling artifacts produced by the time discretization of analog signals. The former is achieved through a synchronization function, and the latter is modeled using a circular representation of time. To overcome the curse of dimensionality inherent in the model's implementation, we employ the Nearest Neighbor Gaussian Process, and posterior samples are obtained using the Markov Chain Monte Carlo method. We apply the model to a real dataset comprising sounds from 8 different species. We define a representative sound for each species and compare them using a simple distance measure. Cross-validation is used to evaluate the predictive capability of our proposal and explore special cases. Additionally, a simulation example is provided to demonstrate that the algorithm is capable of retrieving the true parameters.


title: Combinatorial Complex Score-based Diffusion Modelling through Stochastic Differential Equations

abstract: Graph structures offer a versatile framework for representing diverse patterns in nature and complex systems, applicable across domains like molecular chemistry, social networks, and transportation systems. While diffusion models have excelled in generating various objects, generating graphs remains challenging. This thesis explores the potential of score-based generative models in generating such objects through a modelization as combinatorial complexes, which are powerful topological structures that encompass higher-order relationships. In this thesis, we propose a unified framework by employing stochastic differential equations. We not only generalize the generation of complex objects such as graphs and hypergraphs, but we also unify existing generative modelling approaches such as Score Matching with Langevin dynamics and Denoising Diffusion Probabilistic Models. This innovation overcomes limitations in existing frameworks that focus solely on graph generation, opening up new possibilities in generative AI. The experiment results showed that our framework could generate these complex objects, and could also compete against state-of-the-art approaches for mere graph and molecule generation tasks.


title: Spatio-spectral optical fission in time-varying subwavelength layers

abstract: Transparent conducting oxides are highly doped semiconductors that exhibit favourable characteristics when compared to metals, including reduced material losses, tuneable electronic and optical properties, and enhanced damage thresholds. Recently, the photonic community has renewed its attention towards these materials, recognizing their remarkable nonlinear optical properties in the near-infrared spectrum, a feature previously overlooked despite their long-standing application in photovoltaics and touchscreens. The exceptionally large and ultra-fast change of the refractive index, which can be optically induced in these compounds, extends beyond the boundaries of conventional perturbative analysis and makes this class of materials the closest approximation to a time-varying system, and a unique playground for studying a variety of novel phenomena within the domain of photon acceleration. Here we report the spatio-spectral fission of an ultra-fast pulse trespassing a thin film of aluminium zinc oxide with a non-stationary refractive index. By applying phase conservation to this time-varying layer, our model can account for both space and time refraction and explain in quantitative terms, the spatial separation of both the spectrum and energy. Our findings represent an example of extreme nonlinear phenomena on subwavelength propagation distances and shed light on the nature of several nonlinear effects recently reported not accounting for the full optical field distribution. Our work also provides new important insights into transparent conducting oxides transient optical properties which are critical for the ongoing research in photonic time crystals, on-chip generation of nonclassical states of light, integrated optical neural networks as well as ultra-fast beam steering and frequency division multiplexing


title: The 3d-index of the 3d-skein module via the quantum trace map

abstract: We define a map from the skein module of a cusped hyperbolic 3-manifold to the ring of Laurent series in one variable with integer coefficients that satisfies two properties: its evaluation at peripheral curves coincides with the Dimofte--Gaiotto--Gukov 3d-index, and it factors through the 3d-quantum trace map associated to a suitable ideal triangulation of the manifold. The map fulfills a supersymmetry prediction of mathematical physics and is part of a conjectural 3+1 dimensional topological quantum field theory.


title: Anomaly inflow for dipole symmetry and higher form foliated field theories

abstract: In accordance with recent progress of fracton topological phases, unusual topological phases of matter hosting fractionalized quasiparticle excitations with mobility constraints, new type of symmetry is studied -- multipole symmetry, associated with conservation of multipoles. Based on algebraic relation between dipole and global charges, we introduce a series of $(d+1)$-dimensional BF theories with $p$-form gauge fields, which admit dipole of spatially extended excitations, and study their physical properties. We elucidate that gauge invariant loops have unusual form, containing linear function of the spatial coordinate, which leads to the position dependent braiding statistics and unusual ground state degeneracy dependence on the system size. We also show that the theories exhibit a mixed 't Hooft anomaly between $p$-form and $(d-p)$-form dipole symmetries, which is canceled by an invertible theory defined in one dimensional higher via anomaly inflow mechanism.

categories: cond-mat.str-el hep-lat hep-th math-ph math.MP quant-ph