title: Efficient first-order algorithms for large-scale, non-smooth maximum entropy models with application to wildfire science

abstract: Maximum entropy (Maxent) models are a class of statistical models that use the maximum entropy principle to estimate probability distributions from data. Due to the size of modern data sets, Maxent models need efficient optimization algorithms to scale well for big data applications. State-of-the-art algorithms for Maxent models, however, were not originally designed to handle big data sets; these algorithms either rely on technical devices that may yield unreliable numerical results, scale poorly, or require smoothness assumptions that many practical Maxent models lack. In this paper, we present novel optimization algorithms that overcome the shortcomings of state-of-the-art algorithms for training large-scale, non-smooth Maxent models. Our proposed first-order algorithms leverage the Kullback-Leibler divergence to train large-scale and non-smooth Maxent models efficiently. For Maxent models with discrete probability distribution of $n$ elements built from samples, each containing $m$ features, the stepsize parameters estimation and iterations in our algorithms scale on the order of $O(mn)$ operations and can be trivially parallelized. Moreover, the strong $\ell_{1}$ convexity of the Kullback--Leibler divergence allows for larger stepsize parameters, thereby speeding up the convergence rate of our algorithms. To illustrate the efficiency of our novel algorithms, we consider the problem of estimating probabilities of fire occurrences as a function of ecological features in the Western US MTBS-Interagency wildfire data set. Our numerical results show that our algorithms outperform the state of the arts by one order of magnitude and yield results that agree with physical models of wildfire occurrence and previous statistical analyses of wildfire drivers.


title: Are Targeted Messages More Effective?

abstract: Graph neural networks (GNN) are deep learning architectures for graphs. Essentially, a GNN is a distributed message passing algorithm, which is controlled by parameters learned from data. It operates on the vertices of a graph: in each iteration, vertices receive a message on each incoming edge, aggregate these messages, and then update their state based on their current state and the aggregated messages. The expressivity of GNNs can be characterised in terms of certain fragments of first-order logic with counting and the Weisfeiler-Lehman algorithm. The core GNN architecture comes in two different versions. In the first version, a message only depends on the state of the source vertex, whereas in the second version it depends on the states of the source and target vertices. In practice, both of these versions are used, but the theory of GNNs so far mostly focused on the first one. On the logical side, the two versions correspond to two fragments of first-order logic with counting that we call modal and guarded. The question whether the two versions differ in their expressivity has been mostly overlooked in the GNN literature and has only been asked recently (Grohe, LICS'23). We answer this question here. It turns out that the answer is not as straightforward as one might expect. By proving that the modal and guarded fragment of first-order logic with counting have the same expressivity over labelled undirected graphs, we show that in a non-uniform setting the two GNN versions have the same expressivity. However, we also prove that in a uniform setting the second version is strictly more expressive.


title: User Tracking and Direction Estimation Codebook Design for IRS-Assisted mmWave Communication

abstract: Future communication systems are envisioned to employ intelligent reflecting surfaces (IRSs) and the millimeter wave (mmWave) frequency band to provide reliable high-rate services. For mobile users, the time-varying channel state information (CSI) requires adequate adjustment of the reflection pattern of the IRS. We propose a novel codebook-based user tracking (UT) algorithm for IRS-assisted mmWave communication, allowing suitable reconfiguration of the IRS unit cell phase shifts, resulting in a high reflection gain. The presented algorithm acquires the direction information of the user based on a peak likelihood-based direction estimation. Using the direction information, the user's trajectory is extrapolated to proactively update the adopted codeword and adjust the IRS phase shift configuration accordingly. Furthermore, we conduct a theoretical analysis of the direction estimation error and utilize the obtained insights to design a codebook specifically optimized for direction estimation. Our numerical results reveal a lower direction estimation error of the proposed UT algorithm when employing our designed codebook compared to codebooks from the literature. Furthermore, the average achieved signal-to-noise ratio (SNR) as well as the average effective rate of the proposed UT algorithm are analyzed. The proposed UT algorithm requires only a low overhead for direction and channel estimation and avoids outdated IRS phase shifts. Furthermore, it is shown to outperform two benchmark schemes based on direct phase shift optimization and hierarchical codebook search, respectively, via computer simulations.


title: Geometric and topological corrections to Schwarzschild black hole

abstract: In this paper, we compute departures in the black hole thermodynamics induced by either geometric or topological corrections to general relativity. Specifically, we analyze the spherically symmetric spacetime solutions of two modified gravity scenarios with Lagrangians $\mathcal{L}\sim R^{1+\epsilon}$ and $\mathcal{L}\sim R+\epsilon\, \mathcal{G}^2$, where $\mathcal{G}$ is the Euler density in four dimensions, while $ 0<\epsilon\ll 1$ measures the perturbation around the Hilbert-Einstein action. Accordingly, we find the expressions of the Bekenstein-Hawking entropy by the Penrose formula, and the black hole temperature and horizon of the obtained solutions. We then investigate the heat capacities in terms of the free parameters of the theories under study. In doing so, we show that healing the problem of negative heat capacities can be possible under particular choices of the free constants, albeit with limitations on the masses allowed for the black hole solutions.


title: A quasilinear Keller-Segel model with saturated discontinuous advection

abstract: We consider the singular limit of a chemotaxis model of bacterial collective motion recently introduced in arXiv:2009.11048 [math.AP]. The equation models aggregation-diffusion phenomena with advection that is discontinuous and depends sharply on the gradient of the density itself. The quasi-linearity of the problem poses major challenges in the construction of the solution and complications arise in the proof of regularity. Our method overcomes these obstacle by relying solely on entropy inequalities and the theory of monotone operators. We provide existence, uniqueness and smoothing estimates in any dimensional space.


title: On discrete-time arrival processes and related random motions

abstract: We consider three kinds of discrete-time arrival processes: transient, intermediate and recurrent, characterized by a finite, possibly finite and infinite number of events, respectively. In this context, we study renewal processes which are stopped at the first event of a further independent renewal process whose inter-arrival time distribution can be defective. If this is the case, the resulting arrival process is of an intermediate nature. For non-defective absorbing times, the resulting arrival process is transient, i.e.\ stopped almost surely. For these processes we derive finite time and asymptotic properties. We apply these results to biased and unbiased random walks on the d-dimensional infinite lattice and as a special case on the two-dimensional triangular lattice. We study the spatial propagator of the walker and its large time asymptotics. In particular, we observe the emergence of a superdiffusive (ballistic) behavior in the case of biased walks. For geometrically distributed stopping times, the propagator converges to a stationary non-equilibrium steady state (NESS), which is universal in the sense that it is independent of the stopped process. In dimension one, for both light- and heavy-tailed step distributions, the NESS has an integral representation involving alpha-stable distributions.


title: Dynamics of Polyalkylfluorene Conjugated Polymers: Insights from Neutron Spectroscopy and Molecular Dynamics Simulations

abstract: Dynamics of the conjugated polymers poly(9,9-dioctylfluorene) (PF8) and poly(9,9-didodecylfluorene) (PF12), differing by the length of their side chains, is investigated in the amorphous phase using the quasielastic neutron scattering (QENS) technique. The neutron spectroscopy measurements are synergistically underpinned by molecular dynamics (MD) simulations. The probe is focused on the picosecond time scale where the structural dynamics of both PF8 and PF12 would mainly be dominated by the motions of their side chains. The measurements highlighted temperature-induced dynamics reflected in the broadening of the QENS spectra upon heating. The MD simulations reproduced well the observations, hence the neutron measurements validate the MD force fields, the adopted amorphous model structures and the numerical procedure. As the QENS spectra are dominated by the signal from the hydrogens on the backbones and side chains of PF8 and PF12, extensive analysis of the MD simulations allowed: (i) tagging these hydrogens, (ii) estimating their contributions to the self part of the van Hove functions and hence to the QENS spectra, and (iii) determining the activation energies of the different motions involving the tagged hydrogens. PF12 is found to exhibit broader QENS spectra than PF8, signature of a more pronounced motions of the didodecyl chains as compared to dioctyl chains. This is in agreement with the outcome of our MD analysis: (i) confirming a lower glass transition temperature of PF12 compared to PF8, (ii) showing PF12 having a lower density than PF8, and (iii) highlighting lower activation energies of the motions of PF12 in comparison with PF8. This study helped gaining insights into the temperature-induced side chains dynamics of the PF8 and PF12 conjugated polymers influencing their stability, and thus could practically impact the performance of the associated optoelectronic active layer.


title: Transparent AI Disclosure Obligations: Who, What, When, Where, Why, How

abstract: Advances in Generative Artificial Intelligence (AI) are resulting in AI-generated media output that is (nearly) indistinguishable from human-created content. This can drastically impact users and the media sector, especially given global risks of misinformation. While the currently discussed European AI Act aims at addressing these risks through Article 52's AI transparency obligations, its interpretation and implications remain unclear. In this early work, we adopt a participatory AI approach to derive key questions based on Article 52's disclosure obligations. We ran two workshops with researchers, designers, and engineers across disciplines (N=16), where participants deconstructed Article 52's relevant clauses using the 5W1H framework. We contribute a set of 149 questions clustered into five themes and 18 sub-themes. We believe these can not only help inform future legal developments and interpretations of Article 52, but also provide a starting point for Human-Computer Interaction research to (re-)examine disclosure transparency from a human-centered AI lens.


title: Noise-induced transitions past the onset of a steady symmetry-breaking bifurcation: the case of the sudden expansion

abstract: We consider fluid flows, governed by the Navier-Stokes equations, subject to a steady symmetry-breaking bifurcation and forced by a weak noise acting on a slow time scale. By generalizing the multiple-scale weakly nonlinear expansion technique employed in the literature for the response of the Duffing oscillator, we rigorously derive a stochastically forced Stuart-Landau equation for the dominant symmetry-breaking mode. The probability density function of the solution, and of the escape time from one attractor to the other, are then determined by solving the associated Fokker-Planck equation. The validity of this reduced order model is tested on the flow past a sudden expansion, for a given Reynolds number and different noise amplitudes. At a very low numerical cost, the statistics obtained from the amplitude equation accurately reproduce those of long-time direct numerical simulations.


title: Entanglement and logarithmic spirals in a quantum spin-1 many-body system with competing dimer and trimer interactions

abstract: Spontaneous symmetry breaking (SSB) with type-B Goldstone modes is investigated in the macroscopically degenerate phase for a quantum spin-1 many-body system with competing dimer and trimer interactions. The SSB involves three distinct patterns. The first occurs at the dimer point, with the pattern from staggered ${\rm SU}(3)$ to ${\rm U}(1)\times{\rm U}(1)$. The second occurs at the trimer point, with the pattern from uniform ${\rm SU}(3)$ to ${\rm U}(1)\times{\rm U}(1)$. The third occurs in the dimer-trimer regime, with the pattern from uniform ${\rm SU}(2)$ to ${\rm U}(1)$. The number of type-B Goldstone modes is thus two, two and one for the three patterns, respectively. The ground state degeneracies arising from the three patterns are exponential with the system size, which may be recognized as sequences of integers relevant to self-similar logarithmic spirals. This in turn is attributed to the presence of an emergent symmetry operation tailored to a specific degenerate ground state. As a consequence, the residual entropy is non-zero, which measures the disorder present in a unit cell of highly degenerate ground state generated from a generalized highest weight state. An exact Schmidt decomposition exists for the highly degenerate ground states, thus exposing the self-similarities underlying an abstract fractal, described by the fractal dimension. The latter is extracted from performing a universal finite system-size scaling analysis of the entanglement entropy, which is identical to the number of type-B Goldstone modes. The model under investigation thus accommodates an exotic scale invariant quantum state of matter.


title: In-context Exploration-Exploitation for Reinforcement Learning

abstract: In-context learning is a promising approach for online policy learning of offline reinforcement learning (RL) methods, which can be achieved at inference time without gradient optimization. However, this method is hindered by significant computational costs resulting from the gathering of large training trajectory sets and the need to train large Transformer models. We address this challenge by introducing an In-context Exploration-Exploitation (ICEE) algorithm, designed to optimize the efficiency of in-context policy learning. Unlike existing models, ICEE performs an exploration-exploitation trade-off at inference time within a Transformer model, without the need for explicit Bayesian inference. Consequently, ICEE can solve Bayesian optimization problems as efficiently as Gaussian process biased methods do, but in significantly less time. Through experiments in grid world environments, we demonstrate that ICEE can learn to solve new RL tasks using only tens of episodes, marking a substantial improvement over the hundreds of episodes needed by the previous in-context learning method.


title: Orbital relaxation length from first-principles scattering calculations

abstract: The orbital Hall effect generates a current of orbital angular momentum perpendicular to a charge current. Experiments suggest that this orbital current decays on a long length scale that is of the order of the spin flip diffusion length or longer. We examine this suggestion using first-principles quantum mechanical scattering calculations to study the decay of orbital currents injected from an orbitally-polarized lead into thermally disordered bulk systems of selected transition metals. We find that the decay occurs over only a few atomic layers. On this length scale the orbital current may be converted into a spin current if the spin Hall angle is sufficiently large, as for Pt. In Cu, Cr and V with small spin Hall angles, the conversion into a spin current is negligible in the bulk and significant conversion only occurs at interfaces.


title: NeuPAN: Direct Point Robot Navigation with End-to-End Model-based Learning

abstract: Navigating a nonholonomic robot in a cluttered environment requires extremely accurate perception and locomotion for collision avoidance. This paper presents NeuPAN: a real-time, highly-accurate, map-free, robot-agnostic, and environment-invariant robot navigation solution. Leveraging a tightly-coupled perception-locomotion framework, NeuPAN has two key innovations compared to existing approaches: 1) it directly maps raw points to a learned multi-frame distance space, avoiding error propagation from perception to control; 2) it is interpretable from an end-to-end model-based learning perspective, enabling provable convergence. The crux of NeuPAN is to solve a high-dimensional end-to-end mathematical model with various point-level constraints using the plug-and-play (PnP) proximal alternating-minimization network (PAN) with neurons in the loop. This allows NeuPAN to generate real-time, end-to-end, physically-interpretable motions directly from point clouds, which seamlessly integrates data- and knowledge-engines, where its network parameters are adjusted via back propagation. We evaluate NeuPAN on car-like robot, wheel-legged robot, and passenger autonomous vehicle, in both simulated and real-world environments. Experiments demonstrate that NeuPAN outperforms various benchmarks, in terms of accuracy, efficiency, robustness, and generalization capability across various environments, including the cluttered sandbox, office, corridor, and parking lot. We show that NeuPAN works well in unstructured environments with arbitrary-shape undetectable objects, making impassable ways passable.


title: Constructing Variables Using Classifiers as an Aid to Regression: An Empirical Assessment

abstract: This paper proposes a method for the automatic creation of variables (in the case of regression) that complement the information contained in the initial input vector. The method works as a pre-processing step in which the continuous values of the variable to be regressed are discretized into a set of intervals which are then used to define value thresholds. Then classifiers are trained to predict whether the value to be regressed is less than or equal to each of these thresholds. The different outputs of the classifiers are then concatenated in the form of an additional vector of variables that enriches the initial vector of the regression problem. The implemented system can thus be considered as a generic pre-processing tool. We tested the proposed enrichment method with 5 types of regressors and evaluated it in 33 regression datasets. Our experimental results confirm the interest of the approach.


title: Reduction of Quantum Principal Bundles over non affine bases

abstract: In this paper we develop the theory of reduction of quantum principal bundles over projective bases. We show how the sheaf theoretic approach can be effectively applied to certain relevant examples as the Klein model for the projective spaces; in particular we study in the algebraic setting the reduction of the principal bundle $\mathrm{GL}(n) \to \mathrm{GL}(n)/P= \mathbf{P}^{n-1}(\mathbb{C})$ to the Levi subgroup $G_0$ inside the maximal parabolic subgroup $P$ of $\mathrm{GL}(n)$. We characterize reductions in the sheaf theoretic setting.


title: HDRTransDC: High Dynamic Range Image Reconstruction with Transformer Deformation Convolution

abstract: High Dynamic Range (HDR) imaging aims to generate an artifact-free HDR image with realistic details by fusing multi-exposure Low Dynamic Range (LDR) images. Caused by large motion and severe under-/over-exposure among input LDR images, HDR imaging suffers from ghosting artifacts and fusion distortions. To address these critical issues, we propose an HDR Transformer Deformation Convolution (HDRTransDC) network to generate high-quality HDR images, which consists of the Transformer Deformable Convolution Alignment Module (TDCAM) and the Dynamic Weight Fusion Block (DWFB). To solve the ghosting artifacts, the proposed TDCAM extracts long-distance content similar to the reference feature in the entire non-reference features, which can accurately remove misalignment and fill the content occluded by moving objects. For the purpose of eliminating fusion distortions, we propose DWFB to spatially adaptively select useful information across frames to effectively fuse multi-exposed features. Extensive experiments show that our method quantitatively and qualitatively achieves state-of-the-art performance.


title: The Power of Noise: Toward a Unified Multi-modal Knowledge Graph Representation Framework

abstract: The advancement of Multi-modal Pre-training highlights the necessity for a robust Multi-Modal Knowledge Graph (MMKG) representation learning framework. This framework is crucial for integrating structured knowledge into multi-modal Large Language Models (LLMs) at scale, aiming to alleviate issues like knowledge misconceptions and multi-modal hallucinations. In this work, to evaluate models' ability to accurately embed entities within MMKGs, we focus on two widely researched tasks: Multi-modal Knowledge Graph Completion (MKGC) and Multi-modal Entity Alignment (MMEA). Building on this foundation, we propose a novel SNAG method that utilizes a Transformer-based architecture equipped with modality-level noise masking for the robust integration of multi-modal entity features in KGs. By incorporating specific training objectives for both MKGC and MMEA, our approach achieves SOTA performance across a total of ten datasets (three for MKGC and seven for MEMA), demonstrating its robustness and versatility. Besides, SNAG can not only function as a standalone model but also enhance other existing methods, providing stable performance improvements. Our code and data are available at: https://github.com/zjukg/SNAG.


title: Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?

abstract: Instruction-tuned Large Language Models (LLMs) show impressive results in numerous practical applications, but they lack essential safety features that are common in other areas of computer science, particularly an explicit separation of instructions and data. This makes them vulnerable to manipulations such as indirect prompt injections and generally unsuitable for safety-critical tasks. Surprisingly, there is currently no established definition or benchmark to quantify this phenomenon. In this work, we close this gap by introducing a formal measure for instruction-data separation and an empirical variant that is calculable from a model's outputs. We also present a new dataset, SEP, that allows estimating the measure for real-world models. Our results on various LLMs show that the problem of instruction-data separation is real: all models fail to achieve high separation, and canonical mitigation techniques, such as prompt engineering and fine-tuning, either fail to substantially improve separation or reduce model utility. The source code and SEP dataset are openly accessible at https://github.com/egozverev/Shold-It-Be-Executed-Or-Processed.


title: Relativistic Roche problem for stars in precessing orbits around a spinning black hole

abstract: Tidal disruptions of stars on the equatorial plane orbiting Kerr black holes have been widely studied. However thus far, there have been fewer studies of stars in inclined precessing orbits around a Kerr black hole. In this paper, we use the tensor virial equations to show the presence of possible resonances in these systems for typical physical parameters of black hole-neutron star binaries in close orbits or of a white dwarf/an ordinary star orbiting a supermassive black hole. This suggests the presence of a new instability before the tidal disruption limit is encountered in such systems.


title: Medical Image Synthesis via Fine-Grained Image-Text Alignment and Anatomy-Pathology Prompting

abstract: Data scarcity and privacy concerns limit the availability of high-quality medical images for public use, which can be mitigated through medical image synthesis. However, current medical image synthesis methods often struggle to accurately capture the complexity of detailed anatomical structures and pathological conditions. To address these challenges, we propose a novel medical image synthesis model that leverages fine-grained image-text alignment and anatomy-pathology prompts to generate highly detailed and accurate synthetic medical images. Our method integrates advanced natural language processing techniques with image generative modeling, enabling precise alignment between descriptive text prompts and the synthesized images' anatomical and pathological details. The proposed approach consists of two key components: an anatomy-pathology prompting module and a fine-grained alignment-based synthesis module. The anatomy-pathology prompting module automatically generates descriptive prompts for high-quality medical images. To further synthesize high-quality medical images from the generated prompts, the fine-grained alignment-based synthesis module pre-defines a visual codebook for the radiology dataset and performs fine-grained alignment between the codebook and generated prompts to obtain key patches as visual clues, facilitating accurate image synthesis. We validate the superiority of our method through experiments on public chest X-ray datasets and demonstrate that our synthetic images preserve accurate semantic information, making them valuable for various medical applications.


title: The metallicity gradients of star-forming regions store information of the assembly history of galaxies

abstract: The variations in metallicity and spatial patterns within star-forming regions of galaxies result from diverse physical processes unfolding throughout their evolutionary history, with a particular emphasis in recent events. Analysing MaNGA and \textsc{eagle} galaxies, we discovered an additional dependence of the mass-metallicity relation (MZR) on metallicity gradients ($\nabla_{{\rm (O/H)}}$). Two regimes emerged for low and high stellar mass galaxies, distinctly separated at approximately ${\rm M_{\star}} >10^{9.75}$. Low-mass galaxies with strong positive $\nabla_{{\rm (O/H)}}$ appear less enriched than the MZR median, while those with strong negative gradients are consistently more enriched in both simulated and observed samples. Interestingly, low-mass galaxies with strong negative $\nabla_{{\rm (O/H)}}$ exhibit high star-forming activity, regardless of stellar surface density or $\nabla_{{\rm (O/H)}}$. In contrast, a discrepancy arises for massive galaxies between MaNGA and \textsc{eagle} datasets. The latter exhibit a notable anticorrelation between specific star formation rate and stellar surface density, independent of $\nabla_{{\rm (O/H)}}$, while MaNGA galaxies show this trend mainly for strong positive $\nabla_{{\rm (O/H)}}$. Further investigation indicates that galaxies with strong negative gradients tend to host smaller central black holes in observed datasets, a trend not replicated in simulations. These findings suggest disparities in metallicity recycling and mixing history between observations and simulations, particularly in massive galaxies with varying metallicity gradients. These distinctions could contribute to a more comprehensive understanding of the underlying physics.


title: Stochastic Cortical Self-Reconstruction

abstract: Magnetic resonance imaging (MRI) is critical for diagnosing neurodegenerative diseases, yet accurately assessing mild cortical atrophy remains a challenge due to its subtlety. Automated cortex reconstruction, paired with healthy reference ranges, aids in pinpointing pathological atrophy, yet their generalization is limited by biases from image acquisition and processing. We introduce the concept of stochastic cortical self-reconstruction (SCSR) that creates a subject-specific healthy reference by taking MRI-derived thicknesses as input and, therefore, implicitly accounting for potential confounders. SCSR randomly corrupts parts of the cortex and self-reconstructs them from the remaining information. Trained exclusively on healthy individuals, repeated self-reconstruction generates a stochastic reference cortex for assessing deviations from the norm. We present three implementations of this concept: XGBoost applied on parcels, and two autoencoders on vertex level -- one based on a multilayer perceptron and the other using a spherical U-Net. These models were trained on healthy subjects from the UK Biobank and subsequently evaluated across four public Alzheimer's datasets. Finally, we deploy the model on clinical in-house data, where deviation maps' high spatial resolution aids in discriminating between four types of dementia.


title: ACFIX: Guiding LLMs with Mined Common RBAC Practices for Context-Aware Repair of Access Control Vulnerabilities in Smart Contracts

abstract: Smart contracts are susceptible to various security issues, among which access control (AC) vulnerabilities are particularly critical. While existing research has proposed multiple detection tools, the automatic and appropriate repair of AC vulnerabilities in smart contracts remains a challenge. Unlike commonly supported vulnerability types by existing repair tools, such as reentrancy, which are usually fixed by template-based approaches, the main obstacle of AC lies in identifying the appropriate roles or permissions amid a long list of non-AC-related source code to generate proper patch code, a task that demands human-level intelligence. Leveraging recent advancements in large language models (LLMs), we employ the state-of-the-art GPT-4 model and enhance it with a novel approach called ACFIX. The key insight is that we can mine common AC practices for major categories of code functionality and use them to guide LLMs in fixing code with similar functionality. To this end, ACFIX involves both offline and online phases. First, during the offline phase, ACFIX mines a taxonomy of common Role-based Access Control (RBAC) practices from 344,251 on-chain contracts, categorizing 49 role-permission pairs from the top 1,000 pairs mined. Second, during the online phase, ACFIX tracks AC-related elements across the contract and uses this context information along with a Chain-of-Thought pipeline to guide LLMs in identifying the most appropriate role-permission pair for the subject contract and subsequently generating a suitable patch. This patch will then undergo a validity and effectiveness check. To evaluate ACFIX, we built the first benchmark dataset of 118 real-world AC vulnerabilities, and our evaluation revealed that ACFIX successfully repaired 94.92% of them. This represents a significant improvement compared to the baseline GPT-4, which achieved only 52.54%.


title: Advanced Channel Coding Designs for Index-Modulated Fluid Antenna Systems

abstract: The concept of fluid antennas (FAs) has emerged as a promising solution to enhance the spectral efficiency of wireless networks, achieved by introducing additional degrees of freedom, including reconfigurability and flexibility. In this paper, we investigate the use of index-modulated (IM) transmissions within the framework of FA systems, where an FA position is activated during each transmission interval. This approach is motivated by the common characteristics exhibited by FAs and IM transmissions, which entails the use of a single radio-frequency chain. From this perspective, we derive a closed-form expression for the bit error rate of IM-FAs considering spatial correlation, and demonstrating superior performance compared to conventional IM systems. To enhance the performance of IM-FAs in correlated conditions, channel coding techniques are applied. We first analyze a set partition coding (SPC) scheme for IM-FAs to spatially separate the FA ports, and provide a tight performance bound over correlated channels. Furthermore, the spatial SPC scheme is extended to turbo-coded modulation where the performance is analyzed for low and high signal-to-noise ratios. Our results reveal that through the implementation of channel coding techniques designed for FAs and IM transmission, the performance of coded IM-FAs exhibits notable enhancements, particularly in high correlation scenarios.


title: RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback

abstract: Large language models (LLMs) demonstrate exceptional performance in numerous tasks but still heavily rely on knowledge stored in their parameters. Moreover, updating this knowledge incurs high training costs. Retrieval-augmented generation (RAG) methods address this issue by integrating external knowledge. The model can answer questions it couldn't previously by retrieving knowledge relevant to the query. This approach improves performance in certain scenarios for specific tasks. However, if irrelevant texts are retrieved, it may impair model performance. In this paper, we propose Retrieval Augmented Iterative Self-Feedback (RA-ISF), a framework that iteratively decomposes tasks and processes them in three submodules to enhance the model's problem-solving capabilities. Experiments show that our method outperforms existing benchmarks, performing well on models like GPT3.5, Llama2, significantly enhancing factual reasoning capabilities and reducing hallucinations.


title: Inverse Garment and Pattern Modeling with a Differentiable Simulator

abstract: The capability to generate simulation-ready garment models from 3D shapes of clothed humans will significantly enhance the interpretability of captured geometry of real garments, as well as their faithful reproduction in the virtual world. This will have notable impact on fields like shape capture in social VR, and virtual try-on in the fashion industry. To align with the garment modeling process standardized by the fashion industry as well as cloth simulation softwares, it is required to recover 2D patterns. This involves an inverse garment design problem, which is the focus of our work here: Starting with an arbitrary target garment geometry, our system estimates an animatable garment model by automatically adjusting its corresponding 2D template pattern, along with the material parameters of the physics-based simulation (PBS). Built upon a differentiable cloth simulator, the optimization process is directed towards minimizing the deviation of the simulated garment shape from the target geometry. Moreover, our produced patterns meet manufacturing requirements such as left-to-right-symmetry, making them suited for reverse garment fabrication. We validate our approach on examples of different garment types, and show that our method faithfully reproduces both the draped garment shape and the sewing pattern.


title: Hybrid optimal control with mixed-integer Lagrangian methods

abstract: Models involving hybrid systems are versatile in their application, but difficult to handle and optimize efficiently due to their combinatorial nature. This work presents a method to cope with hybrid optimal control problems which, in contrast to decomposition techniques, does not require relaxing the integrality constraints. Based on the discretize-then-optimize approach, our scheme addresses mixed-integer nonlinear problems under mild assumptions. The proposed numerical algorithm builds upon the augmented Lagrangian framework, whose subproblems are handled using successive mixed-integer linearizations with trust regions. We validate the performance of the numerical routine with extensive investigations using several hybrid optimal control problems from different fields of application. Promising preliminary results are presented for a motion planning task with hysteresis and drag, a Lotka-Volterra fishing problem, and a facility location design problem.


title: Towards an educational tool for supporting neonatologists in the delivery room

abstract: Nowadays, there is evidence that several factors may increase the risk, for an infant, to require stabilisation or resuscitation manoeuvres at birth. However, this risk factors are not completely known, and a universally applicable model for predicting high-risk situations is not available yet. Considering both these limitations and the fact that the need for resuscitation at birth is a rare event, periodic training of the healthcare personnel responsible for newborn caring in the delivery room is mandatory. In this paper, we propose a machine learning approach for identifying risk factors and their impact on the birth event from real data, which can be used by personnel to progressively increase and update their knowledge. Our final goal will be the one of designing a user-friendly mobile application, able to improve the recognition rate and the planning of the appropriate interventions on high-risk patients.


title: ExoCubed: A Riemann-Solver based Cubed-Sphere Dynamic Core for Planetary Atmospheres

abstract: The computational fluid dynamics on a sphere is relevant to global simulations of geophysical fluid dynamics. Using the conventional spherical-polar (or lat-lon) grid results in a singularity at the poles, with orders of magnitude smaller cell sizes at the poles in comparison to the equator. To address this problem, we developed a general circulation model (dynamic core) with a gnomonic equiangular cubed-sphere configuration. This model is developed based on the Simulating Nonhydrostatic Atmospheres on Planets (SNAP) model, using a finite volume numerical scheme with a Riemann-solver-based dynamic core and the vertical implicit correction (VIC) scheme. This change of the horizontal configuration gives a 20-time acceleration of global simulations compared to the lat-lon grid with a similar number of cells at medium resolution. We presented standard tests ranging from 2D shallow-water models to 3D general circulation tests, including earth-like planets and shallow hot Jupiters, to validate the accuracy of the model. The method described in this article is generic to transform any existing finite-volume hydrodynamic model in the Cartesian geometry to the spherical geometry.


title: DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation

abstract: World models have demonstrated superiority in autonomous driving, particularly in the generation of multi-view driving videos. However, significant challenges still exist in generating customized driving videos. In this paper, we propose DriveDreamer-2, which builds upon the framework of DriveDreamer and incorporates a Large Language Model (LLM) to generate user-defined driving videos. Specifically, an LLM interface is initially incorporated to convert a user's query into agent trajectories. Subsequently, a HDMap, adhering to traffic regulations, is generated based on the trajectories. Ultimately, we propose the Unified Multi-View Model to enhance temporal and spatial coherence in the generated driving videos. DriveDreamer-2 is the first world model to generate customized driving videos, it can generate uncommon driving videos (e.g., vehicles abruptly cut in) in a user-friendly manner. Besides, experimental results demonstrate that the generated videos enhance the training of driving perception methods (e.g., 3D detection and tracking). Furthermore, video generation quality of DriveDreamer-2 surpasses other state-of-the-art methods, showcasing FID and FVD scores of 11.2 and 55.7, representing relative improvements of 30% and 50%.


title: DiaLoc: An Iterative Approach to Embodied Dialog Localization

abstract: Multimodal learning has advanced the performance for many vision-language tasks. However, most existing works in embodied dialog research focus on navigation and leave the localization task understudied. The few existing dialog-based localization approaches assume the availability of entire dialog prior to localizaiton, which is impractical for deployed dialog-based localization. In this paper, we propose DiaLoc, a new dialog-based localization framework which aligns with a real human operator behavior. Specifically, we produce an iterative refinement of location predictions which can visualize current pose believes after each dialog turn. DiaLoc effectively utilizes the multimodal data for multi-shot localization, where a fusion encoder fuses vision and dialog information iteratively. We achieve state-of-the-art results on embodied dialog-based localization task, in single-shot (+7.08% in Acc5@valUnseen) and multi-shot settings (+10.85% in Acc5@valUnseen). DiaLoc narrows the gap between simulation and real-world applications, opening doors for future research on collaborative localization and navigation.


title: SonoTraceLab -- A Raytracing-Based Acoustic Modelling System for Simulating Echolocation Behavior of Bats

abstract: Echolocation is the prime sensing modality for many species of bats, who show the intricate ability to perform a plethora of tasks in complex and unstructured environments. Understanding this exceptional feat of sensorimotor interaction is a key aspect into building more robust and performant man-made sonar sensors. In order to better understand the underlying perception mechanisms it is important to get a good insight into the nature of the reflected signals that the bat perceives. While ensonification experiments are in important way to better understand the nature of these signals, they are as time-consuming to perform as they are informative. In this paper we present SonoTraceLab, an open-source software package for simulating both technical as well as biological sonar systems in complex scenes. Using simulation approaches can drastically increase insights into the nature of biological echolocation systems, while reducing the time- and material complexity of performing them.


title: Structure and dielectric properties of BFN-KN solid solutions synthesized through solution combustion route

abstract: We demonstrate that the solution combustion reaction (SCR) route is suitable for the synthesis of phase pure (x)BaFe0.5Nb0.5O3-(1-x)KNbO3 (x = 0, 0.2, 0.4, 0.6, 0.8, 1) (BFN-KN) solid solutions due to atomic level of mixing of precursors than that of the solid-state reaction (SSR) route. A variation in composition 'x' of our double perovskite samples leads to a gradual variation in the structural disorder associated with the disorder in the distribution in the cationic positions, the lattice strain, and the defects at the grain boundaries. With the increase in the BFN content in the solid solutions, a decrease in bandgap and a corresponding change in the color of the samples are observed. Furthermore, three distinct characteristic features in the frequency-dependent polarization behavior in our samples are observed at different frequencies. These features observed to be sustaining up to gradually increasing frequencies are assigned to (1) the interfacial polarization originating due to the structural disorder present at the grain boundaries, (2) the cationic positions leading to tilting/expansion of oxygen octahedra, and (3) the ionic size mismatch leading to strain distribution. The results are well supported by the results obtained for the microstructural, structural, and optical properties of our samples. Hence, our work provides a better understanding of the dielectric polarization behavior of double perovskites.


title: On equivariant embeddings of hyperbolic surfaces into hyperbolic 3-manifolds

abstract: We consider the problem of when a closed hyperbolic surface admits a totally geodesic embedding into a closed hyperbolic 3-manifold, and in particular equivariant versions of such embeddings. In a previous paper we considered orientation-preserving actions on orientable surfaces; in the present paper, we consider large orientation-reversing actions on orientable surfaces, and also large actions on nonorientable surfaces.


title: The Berge-F\"uredi conjecture on the chromatic index of hypergraphs with large hyperedges

abstract: This paper is concerned with two conjectures which are intimately related. The first is a generalization to hypergraphs of Vizing's Theorem on the chromatic index of a graph and the second is the well-known conjecture of Erd\H{o}s, Faber and Lov\'asz which deals with the problem of coloring a family of cliques intersecting in at most one vertex. We are led to study a special class of uniform and linear hypergraphs for which a number of properties are established.


title: Human-Exoskeleton Interaction Portrait

abstract: Human-robot physical interaction contains crucial information for optimizing user experience, enhancing robot performance, and objectively assessing user adaptation. This study introduces a new method to evaluate human-robot co-adaptation in lower limb exoskeletons by analyzing muscle activity and interaction torque as a two-dimensional random variable. We introduce the Interaction Portrait (IP), which visualizes this variable's distribution in polar coordinates. We applied this metric to compare a recent torque controller (HTC) based on kinematic state feedback and a novel feedforward controller (AMTC) with online learning, proposed herein, against a time-based controller (TBC) during treadmill walking at varying speeds. Compared to TBC, both HTC and AMTC significantly lower users' normalized oxygen uptake, suggesting enhanced user-exoskeleton coordination. IP analysis reveals this improvement stems from two distinct co-adaptation strategies, unidentifiable by traditional muscle activity or interaction torque analyses alone. HTC encourages users to yield control to the exoskeleton, decreasing muscular effort but increasing interaction torque, as the exoskeleton compensates for user dynamics. Conversely, AMTC promotes user engagement through increased muscular effort and reduced interaction torques, aligning it more closely with rehabilitation and gait training applications. IP phase evolution provides insight into each user's interaction strategy development, showcasing IP analysis's potential in comparing and designing novel controllers to optimize human-robot interaction in wearable robots.


title: Suppressing Correlated Noise in Quantum Computers via Context-Aware Compiling

abstract: Coherent errors, and especially those that occur in correlation among a set of qubits, are detrimental for large-scale quantum computing. Correlations in noise can occur as a result of spatial and temporal configurations of instructions executing on the quantum processor. In this paper, we perform a detailed experimental characterization of many of these error sources, and theoretically connect them to the physics of superconducting qubits and gate operations. Equipped with this knowledge, we devise compiler strategies to suppress these errors using dynamical decoupling or error compensation into the rest of the circuit. Importantly, these strategies are successful when the context at each layer of computation is taken into account: how qubits are connected, what crosstalk terms exist on the device, and what gates or idle periods occur in that layer. Our context-aware compiler thus suppresses some dominant sources of error, making further error mitigation or error correction substantially less expensive. For example, our experiments show an increase of 18.5\% in layer fidelity for a candidate 10-qubit circuit layer compared to context-unaware suppression. Owing to the exponential nature of error mitigation, these improvements due to error suppression translate to several orders of magnitude reduction of sampling overhead for a circuit consisting of a moderate number of layers.


title: Vibrational Dynamics and Spectroscopy of Water at Porous g-C$_{3}$N$_{4}$ and C$_{2}$N Materials

abstract: In this work, the vibrational dynamics and spectroscopy of deuterated water molecules (D$_{2}$O) mimicking dense water layers at room temperature on the surfaces of two different C/N based materials with different N content and pore size, namely graphitic C$_{3}$N$_{4}$ (g-C$_{3}$N$_{4}$) and C$_{2}$N are studied using Ab Initio Molecular Dynamics (AIMD). In particular, Time-Dependent vibrational Sum-Frequency Generation spectra (TD-vSFG) of the OD modes and also time-averaged vSFG spectra and OD frequency distributions are computed.


title: Quantifying the Sensitivity of Inverse Reinforcement Learning to Misspecification

abstract: Inverse reinforcement learning (IRL) aims to infer an agent's preferences (represented as a reward function $R$) from their behaviour (represented as a policy $\pi$). To do this, we need a behavioural model of how $\pi$ relates to $R$. In the current literature, the most common behavioural models are optimality, Boltzmann-rationality, and causal entropy maximisation. However, the true relationship between a human's preferences and their behaviour is much more complex than any of these behavioural models. This means that the behavioural models are misspecified, which raises the concern that they may lead to systematic errors if applied to real data. In this paper, we analyse how sensitive the IRL problem is to misspecification of the behavioural model. Specifically, we provide necessary and sufficient conditions that completely characterise how the observed data may differ from the assumed behavioural model without incurring an error above a given threshold. In addition to this, we also characterise the conditions under which a behavioural model is robust to small perturbations of the observed policy, and we analyse how robust many behavioural models are to misspecification of their parameter values (such as e.g.\ the discount rate). Our analysis suggests that the IRL problem is highly sensitive to misspecification, in the sense that very mild misspecification can lead to very large errors in the inferred reward function.


title: Surface-aware Mesh Texture Synthesis with Pre-trained 2D CNNs

abstract: Mesh texture synthesis is a key component in the automatic generation of 3D content. Existing learning-based methods have drawbacks -- either by disregarding the shape manifold during texture generation or by requiring a large number of different views to mitigate occlusion-related inconsistencies. In this paper, we present a novel surface-aware approach for mesh texture synthesis that overcomes these drawbacks by leveraging the pre-trained weights of 2D Convolutional Neural Networks (CNNs) with the same architecture, but with convolutions designed for 3D meshes. Our proposed network keeps track of the oriented patches surrounding each texel, enabling seamless texture synthesis and retaining local similarity to classical 2D convolutions with square kernels. Our approach allows us to synthesize textures that account for the geometric content of mesh surfaces, eliminating discontinuities and achieving comparable quality to 2D image synthesis algorithms. We compare our approach with state-of-the-art methods where, through qualitative and quantitative evaluations, we demonstrate that our approach is more effective for a variety of meshes and styles, while also producing visually appealing and consistent textures on meshes.


title: Concurrent Speaker Detection: A multi-microphone Transformer-Based Approach

abstract: We present a deep-learning approach for the task of Concurrent Speaker Detection (CSD) using a modified transformer model. Our model is designed to handle multi-microphone data but can also work in the single-microphone case. The method can classify audio segments into one of three classes: 1) no speech activity (noise only), 2) only a single speaker is active, and 3) more than one speaker is active. We incorporate a Cost-Sensitive (CS) loss and a confidence calibration to the training procedure. The approach is evaluated using three real-world databases: AMI, AliMeeting, and CHiME 5, demonstrating an improvement over existing approaches.


title: Development of a Reliable and Accessible Caregiving Language Model (CaLM)

abstract: Unlike professional caregivers, family caregivers often assume this role without formal preparation or training. Because of this, there is an urgent need to enhance the capacity of family caregivers to provide quality care. Large language models can potentially be used as a foundation technology for supporting caregivers as educational tools or as adjunct to care. This study aimed to develop a reliable Caregiving Language Model (CaLM) by using FMs and a caregiving knowledge base, develop an accessible CaLM using a small FM that requires fewer computing resources, and evaluate the performance of the model compared to a large FM. We developed CaLM using the Retrieval Augmented Generation (RAG) framework combined with FM fine-tuning for improving the quality of FM answers by grounding the model on a caregiving knowledge base. We used two small FMs as candidates for the FM of CaLM (LLaMA-2 and Falcon with 7B parameters) and larger FM GPT-3.5 as a benchmark. We developed the caregiving knowledge base by gathering various types of documents from the Internet. In this study, we focused on caregivers of individuals with Alzheimer's Disease Related Dementias. We evaluated the models' performance using the benchmark metrics commonly used in evaluating language models and their reliability to provide accurate references with the answers. The RAG framework improved the performance of all FMs used in this study across all measures. As expected, the large FM performed better than small FMs across all metrics. The most interesting result is that small fine-tuned FMs with RAG performed significantly better than GPT 3.5 across all metrics. The fine-tuned LLaMA-2 small FM performed better than GPT 3.5 (even with RAG) in returning references with the answers. The study shows that reliable and accessible CaLM can be developed by using small FMs with a knowledge base specific to the caregiving domain.


title: Estimation of parameters and local times in a discretely observed threshold diffusion model

abstract: We consider a simple mean reverting diffusion process, with piecewise constant drift and diffusion coefficients, discontinuous at a fixed threshold. We discuss estimation of drift and diffusion parameters from discrete observations of the process, with a generalized moment estimator and a maximum likelihood estimator. We develop the asymptotic theory of the estimators when the time horizon of the observations goes to infinity, considering both cases of a fixed time lag (low frequency) and a vanishing time lag (high frequency) between consecutive observations. In the setting of low frequency observations and infinite time horizon we also study the convergence of three local time estimators, that are already known to converge to the local time in the setting of high frequency observations and fixed time horizon. We find that these estimators can behave differently, depending on the assumptions on the time lag between observations.


title: Radial Tully-Fisher relation and the local variance of Hubble parameter

abstract: Utilizing the well-established Radial Tully-Fisher (RTF) relation observed in a `large' (843) sample of local galaxies, we report the maximum allowed variance in the Hubble parameter, $H_0$. We estimate the total intrinsic scatter in the magnitude of the RTF relation(s) implementing a cosmological model-independent cosmographic expansion. We find that the maximum allowed local variation in our baseline analysis, using 4 RTF relations in the galaxy sample is $\Delta H_0/H_0 \lesssim 3 \%$ at a $95\%$ C.L. significance. Which is implied form a constraint of $\Delta H_0/H_0 = 0.54^{+1.32}_{-1.37} \%$ estimated at $D_{\rm{L}}\sim 10\, [\rm{Mpc}]$. Using only one `best-constrained' radial bin we report a conservative $95\%$ C.L. limit of $\Delta H_0/H_0 \lesssim 4 \%$. Through our estimate of maximum variation, we propose a novel method to validate several late-time/local modifications put forth to alleviate the $H_0$ tension. We find that within the range of the current galaxy sample redshift distribution $10 \, [\rm{Mpc}] \le D_{\rm{L}} \le 140\, [\rm{Mpc}]$, it is highly unlikely to obtain a variation of $\Delta H_0/H_0 \sim 9\%$, necessary to alleviate the $H_0$-tension. However, we also elaborate on the possible alternative inferences when the innermost radial bin is included in the analysis. Alongside the primary analysis of fitting the individual RTF relations independently, we propose and perform a joint analysis of the RTF relations useful to create a pseudo-standardizable sample of galaxies. We also test for the spatial variation of $H_0$, finding that the current samples' galaxies distributed only in the southern hemisphere support the null hypothesis of isotropy, within the allowed noise levels.


title: A Geospatial Approach to Predicting Desert Locust Breeding Grounds in Africa

abstract: Desert locust swarms present a major threat to agriculture and food security. Addressing this challenge, our study develops an operationally-ready model for predicting locust breeding grounds, which has the potential to enhance early warning systems and targeted control measures. We curated a dataset from the United Nations Food and Agriculture Organization's (UN-FAO) locust observation records and analyzed it using two types of spatio-temporal input features: remotely-sensed environmental and climate data as well as multi-spectral earth observation images. Our approach employed custom deep learning models (three-dimensional and LSTM-based recurrent convolutional networks), along with the geospatial foundational model Prithvi recently released by Jakubik et al., 2023. These models notably outperformed existing baselines, with the Prithvi-based model, fine-tuned on multi-spectral images from NASA's Harmonized Landsat and Sentinel-2 (HLS) dataset, achieving the highest accuracy, F1 and ROC-AUC scores (83.03%, 81.53% and 87.69%, respectively). A significant finding from our research is that multi-spectral earth observation images alone are sufficient for effective locust breeding ground prediction without the need to explicitly incorporate climatic or environmental features.


title: Quantum thermodynamics of driven-dissipative condensates

abstract: Polariton condensates occur away from thermal equilibrium, in an open system where heat and particles are continually exchanged with reservoirs. These phenomena have been extensively analyzed in terms of kinetic equations. Based on the collection of knowledge about polariton kinetics provided by these simulations and by experimental works, we constructed a few-level model that captures the main processes involved in the buildup of a ground-state population of polaritons. This allows condensation to be understood as the output of a thermal machine and exposes the thermodynamic constraints on its occurrence. The model consists of a three-level system interacting with a field and connected to a hot and a cold thermal reservoir that represent a non-resonant pump and the lattice phonons. This subsystem can drive a condensate, through polariton-polariton scattering, which produces work in the form of coherent light emission from the microcavity. We obtain a phase diagram as a function of the temperatures of the two baths and investigate the possible types of phase transition that lead to the condensate phase.


title: Real-Time Simulated Avatar from Head-Mounted Sensors

abstract: We present SimXR, a method for controlling a simulated avatar from information (headset pose and cameras) obtained from AR / VR headsets. Due to the challenging viewpoint of head-mounted cameras, the human body is often clipped out of view, making traditional image-based egocentric pose estimation challenging. On the other hand, headset poses provide valuable information about overall body motion, but lack fine-grained details about the hands and feet. To synergize headset poses with cameras, we control a humanoid to track headset movement while analyzing input images to decide body movement. When body parts are seen, the movements of hands and feet will be guided by the images; when unseen, the laws of physics guide the controller to generate plausible motion. We design an end-to-end method that does not rely on any intermediate representations and learns to directly map from images and headset poses to humanoid control signals. To train our method, we also propose a large-scale synthetic dataset created using camera configurations compatible with a commercially available VR headset (Quest 2) and show promising results on real-world captures. To demonstrate the applicability of our framework, we also test it on an AR headset with a forward-facing camera.


title: Single sided multiplier Hopf algebras

abstract: Let $A$ be a non-degenerate algebra over the complex numbers and $\Delta$ a homomorphism from $A$ to the multiplier algebra $M(A\otimes A)$. Consider the linear maps $T_1$ and $T_2$ from $A\otimes A$ to $M(A\otimes A)$ defined by \begin{equation*} T_1(a\otimes b)=\Delta(a)(1\otimes b) \qquad\text{and}\qquad T_2(c\otimes a)=(c\otimes 1)\Delta(a). \end{equation*} The pair $(A,\Delta)$ is a multiplier Hopf algebra if these two maps have range in $A\otimes A$ and are bijections from $A\otimes A$ to itself. In our recent paper on the Larson-Sweedler theorem, single sided multiplier Hopf algebras emerge in a natural way. For this case, instead of requiring the above for the maps $T_1$ and $T_2$, we now have this property for the maps $T_1$ and $T_4$ or for $T_2$ and $T_3$ where \begin{equation*} T_3(a\otimes b)=(1\otimes b)\Delta(a) \qquad\text{and}\qquad T_4(c\otimes a)=\Delta(a)(c\otimes 1). \end{equation*} As it turns out, also for these single sided multiplier Hopf algebras, the existence of a unique counit and antipode can be proven. In fact, rather surprisingly, using the properties of the antipode, one can actually show that for a single sided multiplier Hopf algebra all four canonical maps are bijections from $A\otimes A$ to itself. In other words, $(A,\Delta)$ is automatically a regular multiplier Hopf algebra. We take the advantage of this approach to reconsider some of the known results for a regular multiplier Hopf algebra.


title: Rigid Poisson suspensions without roots

abstract: Examples of rigid Poisson suspensions without roots are presented. The discrete rational component in spectrum of an ergodic automorphism S prevents some roots from existing. If S is tensorly multiplied by an ergodic automorphism of the space with a sigma-finite measure, discrete spectrum disappears in this product, but the memory of it can remain in the form of the absence of roots. In additional conditions, this effect is inherited by the Poisson suspension over the product.


title: On the Preservation of Africa's Cultural Heritage in the Age of Artificial Intelligence

abstract: In this paper we delve into the historical evolution of data as a fundamental element in communication and knowledge transmission. The paper traces the stages of knowledge dissemination from oral traditions to the digital era, highlighting the significance of languages and cultural diversity in this progression. It also explores the impact of digital technologies on memory, communication, and cultural preservation, emphasizing the need for promoting a culture of the digital (rather than a digital culture) in Africa and beyond. Additionally, it discusses the challenges and opportunities presented by data biases in AI development, underscoring the importance of creating diverse datasets for equitable representation. We advocate for investing in data as a crucial raw material for fostering digital literacy, economic development, and, above all, cultural preservation in the digital age.


title: QUASAR: QUality and Aesthetics Scoring with Advanced Representations

abstract: This paper introduces a new data-driven, non-parametric method for image quality and aesthetics assessment, surpassing existing approaches and requiring no prompt engineering or fine-tuning. We eliminate the need for expressive textual embeddings by proposing efficient image anchors in the data. Through extensive evaluations of 7 state-of-the-art self-supervised models, our method demonstrates superior performance and robustness across various datasets and benchmarks. Notably, it achieves high agreement with human assessments even with limited data and shows high robustness to the nature of data and their pre-processing pipeline. Our contributions offer a streamlined solution for assessment of images while providing insights into the perception of visual information.


title: Exploring Unique Quasinormal Modes of a Massive Scalar Field in Brane-World Scenarios

abstract: We compute precise values of quasinormal modes of a massive scalar field in the background of the Schwarzschild-like brane-localised black holes. It is shown that the quasinormal spectrum of the massive field differs qualitatively from that previously known for other black hole models, due to the presence of two kinds of modes: those whose damping rate vanishes as the mass of the field $\mu$ increases up to some critical value, and those whose real oscillation frequency vanishes at a certain value of $\mu$. While the first type of modes, which are arbitrarily long-lived, are recognized in various four-dimensional backgrounds as quasi-resonances, the second type is a novel feature for asymptotically flat black holes. When $Re (\omega)$ reaches zero, the fundamental mode disappears from the spectrum and the first overtone becomes the fundamental mode. We also demonstrate that quasi-resonances may not exist for brane-localised black holes immersed in $D\geq 6$ - dimensional bulk.


title: Exact Multi-Point Correlations in the Stochastic Heat Equation for Strictly Sublinear Coordinates

abstract: We consider the Stochastic Heat Equation (SHE) in $(1+1)$ dimensions with delta Dirac initial data and spacetime white noise. We prove exact large-time asymptotics for multi-point correlations of the SHE for strictly sublinear space coordinates. The sublinear condition is optimal, in the sense that different asymptotics are known to occur when the space coordinates grow linearly [Lin 2023, Theorem 1.1]. Lastly, a notable feature of our result is that it confirms the connection between multi-point correlations in the SHE and the ground state of the Hamiltonian of the delta-Bose gas.


title: Learning with Noisy Foundation Models

abstract: Foundation models are usually pre-trained on large-scale datasets and then adapted to downstream tasks through tuning. However, the large-scale pre-training datasets, often inaccessible or too expensive to handle, can contain label noise that may adversely affect the generalization of the model and pose unexpected risks. This paper stands out as the first work to comprehensively understand and analyze the nature of noise in pre-training datasets and then effectively mitigate its impacts on downstream tasks. Specifically, through extensive experiments of fully-supervised and image-text contrastive pre-training on synthetic noisy ImageNet-1K, YFCC15M, and CC12M datasets, we demonstrate that, while slight noise in pre-training can benefit in-domain (ID) performance, where the training and testing data share a similar distribution, it always deteriorates out-of-domain (OOD) performance, where training and testing distributions are significantly different. These observations are agnostic to scales of pre-training datasets, pre-training noise types, model architectures, pre-training objectives, downstream tuning methods, and downstream applications. We empirically ascertain that the reason behind this is that the pre-training noise shapes the feature space differently. We then propose a tuning method (NMTune) to affine the feature space to mitigate the malignant effect of noise and improve generalization, which is applicable in both parameter-efficient and black-box tuning manners. We additionally conduct extensive experiments on popular vision and language models, including APIs, which are supervised and self-supervised pre-trained on realistic noisy data for evaluation. Our analysis and results demonstrate the importance of this novel and fundamental research direction, which we term as Noisy Model Learning.


title: Semantic Residual Prompts for Continual Learning

abstract: Prompt-tuning methods for Continual Learning (CL) freeze a large pre-trained model and focus training on a few parameter vectors termed prompts. Most of these methods organize these vectors in a pool of key-value pairs, and use the input image as query to retrieve the prompts (values). However, as keys are learned while tasks progress, the prompting selection strategy is itself subject to catastrophic forgetting, an issue often overlooked by existing approaches. For instance, prompts introduced to accommodate new tasks might end up interfering with previously learned prompts. To make the selection strategy more stable, we ask a foundational model (CLIP) to select our prompt within a two-level adaptation mechanism. Specifically, the first level leverages standard textual prompts for the CLIP textual encoder, leading to stable class prototypes. The second level, instead, uses these prototypes along with the query image as keys to index a second pool. The retrieved prompts serve to adapt a pre-trained ViT, granting plasticity. In doing so, we also propose a novel residual mechanism to transfer CLIP semantics to the ViT layers. Through extensive analysis on established CL benchmarks, we show that our method significantly outperforms both state-of-the-art CL approaches and the zero-shot CLIP test. Notably, our findings hold true even for datasets with a substantial domain gap w.r.t. the pre-training knowledge of the backbone model, as showcased by experiments on satellite imagery and medical datasets.


title: On the Generalization Ability of Unsupervised Pretraining

abstract: Recent advances in unsupervised learning have shown that unsupervised pre-training, followed by fine-tuning, can improve model generalization. However, a rigorous understanding of how the representation function learned on an unlabeled dataset affects the generalization of the fine-tuned model is lacking. Existing theoretical research does not adequately account for the heterogeneity of the distribution and tasks in pre-training and fine-tuning stage. To bridge this gap, this paper introduces a novel theoretical framework that illuminates the critical factor influencing the transferability of knowledge acquired during unsupervised pre-training to the subsequent fine-tuning phase, ultimately affecting the generalization capabilities of the fine-tuned model on downstream tasks. We apply our theoretical framework to analyze generalization bound of two distinct scenarios: Context Encoder pre-training with deep neural networks and Masked Autoencoder pre-training with deep transformers, followed by fine-tuning on a binary classification task. Finally, inspired by our findings, we propose a novel regularization method during pre-training to further enhances the generalization of fine-tuned model. Overall, our results contribute to a better understanding of unsupervised pre-training and fine-tuning paradigm, and can shed light on the design of more effective pre-training algorithms.


title: Exploring Large Language Models and Hierarchical Frameworks for Classification of Large Unstructured Legal Documents

abstract: Legal judgment prediction suffers from the problem of long case documents exceeding tens of thousands of words, in general, and having a non-uniform structure. Predicting judgments from such documents becomes a challenging task, more so on documents with no structural annotation. We explore the classification of these large legal documents and their lack of structural information with a deep-learning-based hierarchical framework which we call MESc; "Multi-stage Encoder-based Supervised with-clustering"; for judgment prediction. Specifically, we divide a document into parts to extract their embeddings from the last four layers of a custom fine-tuned Large Language Model, and try to approximate their structure through unsupervised clustering. Which we use in another set of transformer encoder layers to learn the inter-chunk representations. We analyze the adaptability of Large Language Models (LLMs) with multi-billion parameters (GPT-Neo, and GPT-J) with the hierarchical framework of MESc and compare them with their standalone performance on legal texts. We also study their intra-domain(legal) transfer learning capability and the impact of combining embeddings from their last layers in MESc. We test these methods and their effectiveness with extensive experiments and ablation studies on legal documents from India, the European Union, and the United States with the ILDC dataset and a subset of the LexGLUE dataset. Our approach achieves a minimum total performance gain of approximately 2 points over previous state-of-the-art methods.


title: Last Iterate Convergence of Incremental Methods and Applications in Continual Learning

abstract: Incremental gradient methods and incremental proximal methods are a fundamental class of optimization algorithms used for solving finite sum problems, broadly studied in the literature. Yet, when it comes to their convergence guarantees, nonasymptotic (first-order or proximal) oracle complexity bounds have been obtained fairly recently, almost exclusively applying to the average iterate. Motivated by applications in continual learning, we obtain the first convergence guarantees for the last iterate of both incremental gradient and incremental proximal methods, in general convex smooth (for both) and convex Lipschitz (for the proximal variants) settings. Our oracle complexity bounds for the last iterate nearly match (i.e., match up to a square-root-log or a log factor) the best known oracle complexity bounds for the average iterate, for both classes of methods. We further obtain generalizations of our results to weighted averaging of the iterates with increasing weights, which can be seen as interpolating between the last iterate and the average iterate guarantees. Additionally, we discuss how our results can be generalized to variants of studied incremental methods with permuted ordering of updates. Our results generalize last iterate guarantees for incremental methods compared to state of the art, as such results were previously known only for overparameterized linear models, which correspond to convex quadratic problems with infinitely many solutions.


title: COOD: Combined out-of-distribution detection using multiple measures for anomaly & novel class detection in large-scale hierarchical classification

abstract: High-performing out-of-distribution (OOD) detection, both anomaly and novel class, is an important prerequisite for the practical use of classification models. In this paper, we focus on the species recognition task in images concerned with large databases, a large number of fine-grained hierarchical classes, severe class imbalance, and varying image quality. We propose a framework for combining individual OOD measures into one combined OOD (COOD) measure using a supervised model. The individual measures are several existing state-of-the-art measures and several novel OOD measures developed with novel class detection and hierarchical class structure in mind. COOD was extensively evaluated on three large-scale (500k+ images) biodiversity datasets in the context of anomaly and novel class detection. We show that COOD outperforms individual, including state-of-the-art, OOD measures by a large margin in terms of TPR@1% FPR in the majority of experiments, e.g., improving detecting ImageNet images (OOD) from 54.3% to 85.4% for the iNaturalist 2018 dataset. SHAP (feature contribution) analysis shows that different individual OOD measures are essential for various tasks, indicating that multiple OOD measures and combinations are needed to generalize. Additionally, we show that explicitly considering ID images that are incorrectly classified for the original (species) recognition task is important for constructing high-performing OOD detection methods and for practical applicability. The framework can easily be extended or adapted to other tasks and media modalities.


title: Ising model with non-reciprocal interactions

abstract: Effective interactions that violate Newton's third law of action-reaction symmetry are common in systems where interactions are mediated by a non-equilibrium environment. Extensive Monte Carlo simulations are carried out on a two-dimensional Ising model, where the interactions are modified non-reciprocally. We demonstrate that the critical temperature decreases as the non-reciprocity increases and this decrease depends only on the magnitude of non-reciprocity. Further, travelling spin waves due to the local fluctuations in magnetisation are observed and these spin waves travel opposite to the non-reciprocity vector.


title: Hierarchical Cutting of Complex Networks Performed by Random Walks

abstract: Several interesting approaches have been reported in the literature on complex networks, random walks, and hierarchy of graphs. While many of these works perform random walks on stable, fixed networks, in the present work we address the situation in which the connections traversed by each step of a uniformly random walks are progressively removed, yielding a successively less interconnected structure that may break into two components, therefore establishing a respective hierarchy. The sizes of each of these pairs of sliced networks, as well as the permanence of each connected component, are studied in the present work. Several interesting results are reported, including the tendency of geometrical networks sometimes to be broken into two components with comparable large sizes.


title: SiLVR: Scalable Lidar-Visual Reconstruction with Neural Radiance Fields for Robotic Inspection

abstract: We present a neural-field-based large-scale reconstruction system that fuses lidar and vision data to generate high-quality reconstructions that are geometrically accurate and capture photo-realistic textures. This system adapts the state-of-the-art neural radiance field (NeRF) representation to also incorporate lidar data which adds strong geometric constraints on the depth and surface normals. We exploit the trajectory from a real-time lidar SLAM system to bootstrap a Structure-from-Motion (SfM) procedure to both significantly reduce the computation time and to provide metric scale which is crucial for lidar depth loss. We use submapping to scale the system to large-scale environments captured over long trajectories. We demonstrate the reconstruction system with data from a multi-camera, lidar sensor suite onboard a legged robot, hand-held while scanning building scenes for 600 metres, and onboard an aerial robot surveying a multi-storey mock disaster site-building. Website: https://ori-drs.github.io/projects/silvr/


title: Anderson-Higgs amplitude mode in Josephson junctions

abstract: The Anderson-Higgs mode in a superconductor corresponds to a collective and coherent oscillation of the order parameter amplitude. We propose to detect this mode in a tunnel Josephson junction between two singlet s-wave diffusive superconductors. We find a strong enhancement of the tunneling current when the junction is pumped at the equilibrium gap frequency, corresponding to the activation of the Anderson-Higgs mode. By solving the Keldysh-Usadel equations, we obtain current peaks at specific bias voltages that can serve as signatures of the Anderson-Higgs mode.


title: Partially identified heteroskedastic SVARs

abstract: This paper studies the identification of Structural Vector Autoregressions (SVARs) exploiting a break in the variances of the structural shocks. Point-identification for this class of models relies on an eigen-decomposition involving the covariance matrices of reduced-form errors and requires that all the eigenvalues are distinct. This point-identification, however, fails in the presence of multiplicity of eigenvalues. This occurs in an empirically relevant scenario where, for instance, only a subset of structural shocks had the break in their variances, or where a group of variables shows a variance shift of the same amount. Together with zero or sign restrictions on the structural parameters and impulse responses, we derive the identified sets for impulse responses and show how to compute them. We perform inference on the impulse response functions, building on the robust Bayesian approach developed for set identified SVARs. To illustrate our proposal, we present an empirical example based on the literature on the global crude oil market where the identification is expected to fail due to multiplicity of eigenvalues.


title: Unveiling the Significance of Toddler-Inspired Reward Transition in Goal-Oriented Reinforcement Learning

abstract: Toddlers evolve from free exploration with sparse feedback to exploiting prior experiences for goal-directed learning with denser rewards. Drawing inspiration from this Toddler-Inspired Reward Transition, we set out to explore the implications of varying reward transitions when incorporated into Reinforcement Learning (RL) tasks. Central to our inquiry is the transition from sparse to potential-based dense rewards, which share optimal strategies regardless of reward changes. Through various experiments, including those in egocentric navigation and robotic arm manipulation tasks, we found that proper reward transitions significantly influence sample efficiency and success rates. Of particular note is the efficacy of the toddler-inspired Sparse-to-Dense (S2D) transition. Beyond these performance metrics, using Cross-Density Visualizer technique, we observed that transitions, especially the S2D, smooth the policy loss landscape, promoting wide minima that enhance generalization in RL models.


title: Linear independence for $C_\ell^{(1)}$ by using $C_{2\ell}^{(1)}$

abstract: In this note we prove linear independence of the combinatorial spanning set for standard $C_\ell^{(1)}$-module $L(k\Lambda_0)$ by establishing a connection with the combinatorial basis of Feigin-Stoyanovsky's type subspace $W(k\Lambda_0)$ of $C_{2\ell}^{(1)}$-module $L(k\Lambda_0)$. It should be noted that the proof of linear independence for the basis of $W(k\Lambda_0)$ is obtained by using simple currents and intertwining operators in the vertex operator algebra $L(k\Lambda_0)$.


title: Algebraic Bethe ansatz approach to the correlation functions of the one-dimensional bosons with attraction

abstract: We consider a model of a one-dimensional Bose gas with attraction. We study ground state equal-time correlation functions in this model using the algebraic Bethe ansatz. In cases of strong interaction or/and large-volume systems, we obtain very simple explicit formulas for correlations.

categories: math-ph cond-mat.quant-gas hep-th math.MP


title: Rates of convergence for holomorphic semigroups of finite shift

abstract: We study parabolic semigroups of finite shift in the unit disk with regard to the rate of convergence of their orbits to the Denjoy--Wolff point. We examine this rate in terms of Euclidean distance, hyperbolic distance and harmonic measure. In each case, we provide explicit examples to display the sharpness of the results. We further discuss the corresponding rates of convergence for parabolic semigroups of positive hyperbolic step and infinite shift.


title: A Holistic Framework Towards Vision-based Traffic Signal Control with Microscopic Simulation

abstract: Traffic signal control (TSC) is crucial for reducing traffic congestion that leads to smoother traffic flow, reduced idling time, and mitigated CO2 emissions. In this study, we explore the computer vision approach for TSC that modulates on-road traffic flows through visual observation. Unlike traditional feature-based approaches, vision-based methods depend much less on heuristics and predefined features, bringing promising potentials for end-to-end learning and optimization of traffic signals. Thus, we introduce a holistic traffic simulation framework called TrafficDojo towards vision-based TSC and its benchmarking by integrating the microscopic traffic flow provided in SUMO into the driving simulator MetaDrive. This proposed framework offers a versatile traffic environment for in-depth analysis and comprehensive evaluation of traffic signal controllers across diverse traffic conditions and scenarios. We establish and compare baseline algorithms including both traditional and Reinforecment Learning (RL) approaches. This work sheds insights into the design and development of vision-based TSC approaches and open up new research opportunities. All the code and baselines will be made publicly available.


title: Model Predictive Control Strategies for Electric Endurance Race Cars Accounting for Competitors Interactions

abstract: This paper presents model predictive control strategies for battery electric endurance race cars accounting for interactions with the competitors. In particular, we devise an optimization framework capturing the impact of the actions of the ego vehicle when interacting with competitors in a probabilistic fashion, jointly accounting for the optimal pit stop decision making, the charge times and the driving style in the course of the race. We showcase our method for a simulated 1h endurance race at the Zandvoort circuit, using real-life data of internal combustion engine race cars from a previous event. Our results show that optimizing both the race strategy as well as the decision making during the race is very important, resulting in a significant 21s advantage over an always overtake approach, whilst revealing the competitiveness of e-race cars w.r.t. conventional ones.


title: QED Effects on Kerr-Newman Black Hole Shadows

abstract: Incorporating first-order QED effects, we explore the shadows of Kerr-Newman black holes with a magnetic charge through the numerical backward ray-tracing method. Our investigation accounts for both the direct influence of the electromagnetic field on light rays and the distortion of the background spacetime metric due to QED corrections. We notice that the area of the shadow increases with the QED effect, mainly due to the fact that the photons move more slowly in the effective medium and become easier to be trapped by the black hole.


title: Admissibility of the Structural Rules in the Sequent Calculus with Equality

abstract: On the ground of a general theorem concerning the admissibility of the structural rules in sequent calculi with additional atomic rules, we develop a proof theoretic analysis for several extensions of the ${\bf G3[mic]}$ sequent calculi with rules for equality, including the one originally proposed by H.Wang. In the classical case we relate our results with the semantic tableau method for first order logic with equality. In particular we establish that, for languages without function symbols, in Fitting's alternative semantic tableau method, strictness (which does not allow the repetition of equalities which are modified) can be imposed together with the orientation of the replacement of equals. A significant progress is made toward extending that result to languages with function symbols although whether that is possible or not remains to be settled. We also briefly consider systems that, in the classical case, are related to the semantic tableau method in which one can expand branches by adding identities at will, obtaining that also in that case strictness can be imposed. Furthermore we discuss to what extent the strengthened form of the nonlengthening property of Orevkov known to hold for the sequent calculi with the structural rules applies also to the present context.


title: Process signature-driven high spatio-temporal resolution alignment of multimodal data

abstract: We present HiRA-Pro, a novel procedure to align, at high spatio-temporal resolutions, multimodal signals from real-world processes and systems that exhibit diverse transient, nonlinear stochastic dynamics, such as manufacturing machines. It is based on discerning and synchronizing the process signatures of salient kinematic and dynamic events in these disparate signals. HiRA-Pro addresses the challenge of aligning data with sub-millisecond phenomena, where traditional timestamp, external trigger, or clock-based alignment methods fall short. The effectiveness of HiRA-Pro is demonstrated in a smart manufacturing context, where it aligns data from 13+ channels acquired during 3D-printing and milling operations on an Optomec-LENS MTS 500 hybrid machine. The aligned data is then voxelized to generate 0.25 second aligned data chunks that correspond to physical voxels on the produced part. The superiority of HiRA-Pro is further showcased through case studies in additive manufacturing, demonstrating improved machine learning-based predictive performance due to precise multimodal data alignment. Specifically, testing classification accuracies improved by almost 35% with the application of HiRA-Pro, even with limited data, allowing for precise localization of artifacts. The paper also provides a comprehensive discussion on the proposed method, its applications, and comparative qualitative analysis with a few other alignment methods. HiRA-Pro achieves temporal-spatial resolutions of 10-1000 us and 100 um in order to generate datasets that register with physical voxels on the 3D-printed and milled part. These resolutions are at least an order of magnitude finer than the existing alignment methods that employ individual timestamps, statistical correlations, or common clocks, which achieve precision of hundreds of milliseconds.


title: Numerical simulation of individual coil placement -- A proof-of-concept study for the prediction of recurrence after aneurysm coiling

abstract: Rupture of intracranial aneurysms results in severe subarachnoidal hemorrhage, which is associated with high morbidity and mortality. Neurointerventional occlusion of the aneurysm through coiling has evolved to a therapeutical standard. The choice of the specific coil has an important influence on secondary regrowth requiring retreatment. Aneurysm occlusion was simulated either through virtual implantation of a preshaped 3D coil or with a porous media approach. In this study, we used a recently developed numerical approach to simulate aneurysm shapes in specific challenging aneurysm anatomies and correlated these with aneurysm recurrence 6 months after treatment. The simulation showed a great variety of coil shapes depending on the variability in possible microcatheter positions. Aneurysms with a later recurrence showed a tendency for more successful coiling attempts. Results revealed further trends suggesting lower simulated packing densities in aneurysms with reoccurrence. Simulated packing densities did not correlate with those calculated by conventional software, indicating the potential for our approach to offer additional predictive value. Our study, therefore, pioneers a comprehensive numerical model for simulating aneurysm coiling, providing insights into individualized treatment strategies and outcome prediction. Future directions involve expanding the model's capabilities to simulate intraprocedural outcomes and long-term predictions, aiming to refine occlusion quality criteria and validate prediction parameters in larger patient cohorts. This simulation framework holds promise for enhancing clinical decision-making and optimizing patient outcomes in endovascular aneurysm treatment.


title: Application of Quantum Tensor Networks for Protein Classification

abstract: We show that protein sequences can be thought of as sentences in natural language processing and can be parsed using the existing Quantum Natural Language framework into parameterized quantum circuits of reasonable qubits, which can be trained to solve various protein-related machine-learning problems. We classify proteins based on their subcellular locations, a pivotal task in bioinformatics that is key to understanding biological processes and disease mechanisms. Leveraging the quantum-enhanced processing capabilities, we demonstrate that Quantum Tensor Networks (QTN) can effectively handle the complexity and diversity of protein sequences. We present a detailed methodology that adapts QTN architectures to the nuanced requirements of protein data, supported by comprehensive experimental results. We demonstrate two distinct QTNs, inspired by classical recurrent neural networks (RNN) and convolutional neural networks (CNN), to solve the binary classification task mentioned above. Our top-performing quantum model has achieved a 94% accuracy rate, which is comparable to the performance of a classical model that uses the ESM2 protein language model embeddings. It's noteworthy that the ESM2 model is extremely large, containing 8 million parameters in its smallest configuration, whereas our best quantum model requires only around 800 parameters. We demonstrate that these hybrid models exhibit promising performance, showcasing their potential to compete with classical models of similar complexity.


title: Data Cubes in Hand: A Design Space of Tangible Cubes for Visualizing 3D Spatio-Temporal Data in Mixed Reality

abstract: Tangible interfaces in mixed reality (MR) environments allow for intuitive data interactions. Tangible cubes, with their rich interaction affordances, high maneuverability, and stable structure, are particularly well-suited for exploring multi-dimensional data types. However, the design potential of these cubes is underexplored. This study introduces a design space for tangible cubes in MR, focusing on interaction space, visualization space, sizes, and multiplicity. Using spatio-temporal data, we explored the interaction affordances of these cubes in a workshop (N=24). We identified unique interactions like rotating, tapping, and stacking, which are linked to augmented reality (AR) visualization commands. Integrating user-identified interactions, we created a design space for tangible-cube interactions and visualization. A prototype visualizing global health spending with small cubes was developed and evaluated, supporting both individual and combined cube manipulation. This research enhances our grasp of tangible interaction in MR, offering insights for future design and application in diverse data contexts.


title: Real-time Transformer-based Open-Vocabulary Detection with Efficient Fusion Head

abstract: End-to-end transformer-based detectors (DETRs) have shown exceptional performance in both closed-set and open-vocabulary object detection (OVD) tasks through the integration of language modalities. However, their demanding computational requirements have hindered their practical application in real-time object detection (OD) scenarios. In this paper, we scrutinize the limitations of two leading models in the OVDEval benchmark, OmDet and Grounding-DINO, and introduce OmDet-Turbo. This novel transformer-based real-time OVD model features an innovative Efficient Fusion Head (EFH) module designed to alleviate the bottlenecks observed in OmDet and Grounding-DINO. Notably, OmDet-Turbo-Base achieves a 100.2 frames per second (FPS) with TensorRT and language cache techniques applied. Notably, in zero-shot scenarios on COCO and LVIS datasets, OmDet-Turbo achieves performance levels nearly on par with current state-of-the-art supervised models. Furthermore, it establishes new state-of-the-art benchmarks on ODinW and OVDEval, boasting an AP of 30.1 and an NMS-AP of 26.86, respectively. The practicality of OmDet-Turbo in industrial applications is underscored by its exceptional performance on benchmark datasets and superior inference speed, positioning it as a compelling choice for real-time object detection tasks. Code: \url{https://github.com/om-ai-lab/OmDet}


title: Partner selection and evolution of out-group avoidance

abstract: The preferential treatment of in-group members is widely observed. This study examines this phenomenon in the domain of cooperation in social dilemmas using evolutionary agent-based models that consider the role of partner selection. The model considers a repeated prisoner's dilemma game, in which agents belong to one of two groups that are distinguished by the continuation probability of pair interactions. On the basis of the behavior in the last round and the group affiliation of the partner, each individual selects to cooperate, defect, or stop interactions and search for a different partner. The results of simulation demonstrated that agents adopt cooperative strategies, including tit-for-tat and out-for-tat, toward in-group members. By contrast, agents stop interactions immediately after pair formation without observing their partner's behavior when they are paired with an out-group individual. Higher continuation probability with in-group partners hinders interaction with out-group individuals. Our results imply the importance of avoidance in intergroup interactions in social dilemmas and might explain in-group favoritism without enmity toward out-groups.


title: Scalable multi-qubit intrinsic gates in quantum dot arrays

abstract: We study multi-qubit quantum gates intrinsic to an array of semiconductor quantum dots and investigate how they can be implemented in a scalable way. The intrinsic quantum gates refer to the class of natural-forming transformations in the qubit rotating-frame under direct exchange coupling, and can be recognized as an instruction set of spin-qubit chips. Adopting perturbative treatment, we can model the intrinsic gates by first-order dynamics in the coupling strength and develop a general formalism for identifying the multi-qubit intrinsic gates under arbitrary array connectivity. The advantageous applications of the intrinsic gates in quantum computing and quantum error correction are explored. Factors influencing the fidelities of the multi-qubit intrinsic gates are also discussed. To overcome the problem of inhomogeneous coupling, we propose a theoretical scheme in which single-qubit pulses are applied to dynamically calibrate the connecting bonds. This scheme can be further combined with periodic dynamical decoupling for robust implementations of multi-qubit gates in large-scale quantum computers.