title: Demonstration of fault-tolerant Steane quantum error correction

abstract: Encoding information redundantly using quantum error-correcting (QEC) codes allows one to overcome the inherent sensitivity to noise in quantum computers to ultimately achieve large-scale quantum computation. The Steane QEC method involves preparing an auxiliary logical qubit of the same QEC code used for the data register. The data and auxiliary registers are then coupled with a logical CNOT gate, enabling a measurement of the auxiliary register to reveal the error syndrome. This study presents the implementation of multiple rounds of fault-tolerant Steane QEC on a trapped-ion quantum computer. Various QEC codes are employed, and the results are compared to a previous experimental approach utilizing flag qubits. Our experimental findings show improved logical fidelities for Steane QEC. This establishes experimental Steane QEC as a competitive paradigm for fault-tolerant quantum computing.


title: Automatic channel selection and spatial feature integration for multi-channel speech recognition across various array topologies

abstract: Automatic Speech Recognition (ASR) has shown remarkable progress, yet it still faces challenges in real-world distant scenarios across various array topologies each with multiple recording devices. The focal point of the CHiME-7 Distant ASR task is to devise a unified system capable of generalizing various array topologies that have multiple recording devices and offering reliable recognition performance in real-world environments. Addressing this task, we introduce an ASR system that demonstrates exceptional performance across various array topologies. First of all, we propose two attention-based automatic channel selection modules to select the most advantageous subset of multi-channel signals from multiple recording devices for each utterance. Furthermore, we introduce inter-channel spatial features to augment the effectiveness of multi-frame cross-channel attention, aiding it in improving the capability of spatial information awareness. Finally, we propose a multi-layer convolution fusion module drawing inspiration from the U-Net architecture to integrate the multi-channel output into a single-channel output. Experimental results on the CHiME-7 corpus with oracle segmentation demonstrate that the improvements introduced in our proposed ASR system lead to a relative reduction of 40.1% in the Macro Diarization Attributed Word Error Rates (DA-WER) when compared to the baseline ASR system on the Eval sets.


title: SELM: Speech Enhancement Using Discrete Tokens and Language Models

abstract: Language models (LMs) have shown superior performances in various speech generation tasks recently, demonstrating their powerful ability for semantic context modeling. Given the intrinsic similarity between speech generation and speech enhancement, harnessing semantic information holds potential advantages for speech enhancement tasks. In light of this, we propose SELM, a novel paradigm for speech enhancement, which integrates discrete tokens and leverages language models. SELM comprises three stages: encoding, modeling, and decoding. We transform continuous waveform signals into discrete tokens using pre-trained self-supervised learning (SSL) models and a k-means tokenizer. Language models then capture comprehensive contextual information within these tokens. Finally, a detokenizer and HiFi-GAN restore them into enhanced speech. Experimental results demonstrate that SELM achieves comparable performance in objective metrics alongside superior results in subjective perception. Our demos are available https://honee-w.github.io/SELM/.


title: VNN: Verification-Friendly Neural Networks with Hard Robustness Guarantees

abstract: Machine learning techniques often lack formal correctness guarantees, evidenced by the widespread adversarial examples that plague most deep-learning applications. This lack of formal guarantees resulted in several research efforts that aim at verifying Deep Neural Networks (DNNs), with a particular focus on safety-critical applications. However, formal verification techniques still face major scalability and precision challenges. The over-approximation introduced during the formal verification process to tackle the scalability challenge often results in inconclusive analysis. To address this challenge, we propose a novel framework to generate Verification-Friendly Neural Networks (VNNs). We present a post-training optimization framework to achieve a balance between preserving prediction performance and verification-friendliness. Our proposed framework results in VNNs that are comparable to the original DNNs in terms of prediction performance, while amenable to formal verification techniques. This essentially enables us to establish robustness for more VNNs than their DNN counterparts, in a time-efficient manner.


title: Study of a longitudinally expanding plasma with the 2PI effective action

abstract: A central question in heavy-ion collisions is how the initial far-from-equilibrium medium evolves and thermalizes while it undergoes a rapid longitudinal expansion. In this work we use the two-particle irreducible (2PI) effective action for the first time to consider this question, focusing on $\phi^4$ scalar theory truncated at three loops. We calculate the momentum distribution of quasiparticles in the medium and show that isotropization takes place. We furthermore consider the thermal mass of quasiparticles and the importance of number-changing processes.


title: Attention-Based VR Facial Animation with Visual Mouth Camera Guidance for Immersive Telepresence Avatars

abstract: Facial animation in virtual reality environments is essential for applications that necessitate clear visibility of the user's face and the ability to convey emotional signals. In our scenario, we animate the face of an operator who controls a robotic Avatar system. The use of facial animation is particularly valuable when the perception of interacting with a specific individual, rather than just a robot, is intended. Purely keypoint-driven animation approaches struggle with the complexity of facial movements. We present a hybrid method that uses both keypoints and direct visual guidance from a mouth camera. Our method generalizes to unseen operators and requires only a quick enrolment step with capture of two short videos. Multiple source images are selected with the intention to cover different facial expressions. Given a mouth camera frame from the HMD, we dynamically construct the target keypoints and apply an attention mechanism to determine the importance of each source image. To resolve keypoint ambiguities and animate a broader range of mouth expressions, we propose to inject visual mouth camera information into the latent space. We enable training on large-scale speaking head datasets by simulating the mouth camera input with its perspective differences and facial deformations. Our method outperforms a baseline in quality, capability, and temporal consistency. In addition, we highlight how the facial animation contributed to our victory at the ANA Avatar XPRIZE Finals.


title: The Dual Characteristic-Galerkin Method

abstract: The Dual Characteristic-Galerkin method (DCGM) is conservative, precise and experimentally positive. We present the method and prove convergence and $L^2$-stability in the case of Neumann boundary conditions. In a 2D numerical finite element setting (FEM), the method is compared to Primal Characteristic-Galerkin (PCGM), Streamline upwinding (SUPG), the Dual Discontinuous Galerkin method (DDG) and centered FEM without upwinding. DCGM is difficult to implement numerically but, in the numerical context of this note, it is far superior to all others.


title: An algebraic multiscale method for spatial network models

abstract: In this work, we present a multiscale approach for the reliable coarse-scale approximation of spatial network models represented by a linear system of equations with respect to the nodes of a graph. The method is based on the ideas of the Localized Orthogonal Decomposition (LOD) strategy and is constructed in a fully algebraic way. This allows to apply the method to geometrically challenging objects such as corrugated cardboard. In particular, the method can also be applied to finite difference or finite element discretizations of elliptic partial differential equations, yielding an approximation with similar properties as the LOD in the continuous setting. We present a rigorous error analysis of the proposed method under suitable assumptions on the network. Moreover, numerical examples are presented that underline our theoretical results.


title: MORE: A Multimodal Object-Entity Relation Extraction Dataset with a Benchmark Evaluation

abstract: Extracting relational facts from multimodal data is a crucial task in the field of multimedia and knowledge graphs that feeds into widespread real-world applications. The emphasis of recent studies centers on recognizing relational facts in which both entities are present in one modality and supplementary information is used from other modalities. However, such works disregard a substantial amount of multimodal relational facts that arise across different modalities, such as one entity seen in a text and another in an image. In this paper, we propose a new task, namely Multimodal Object-Entity Relation Extraction, which aims to extract "object-entity" relational facts from image and text data. To facilitate research on this task, we introduce MORE, a new dataset comprising 21 relation types and 20,264 multimodal relational facts annotated on 3,559 pairs of textual news titles and corresponding images. To show the challenges of Multimodal Object-Entity Relation Extraction, we evaluated recent state-of-the-art methods for multimodal relation extraction and conducted a comprehensive experimentation analysis on MORE. Our results demonstrate significant challenges for existing methods, underlining the need for further research on this task. Based on our experiments, we identify several promising directions for future research. The MORE dataset and code are available at https://github.com/NJUNLP/MORE.


title: PPFM: Image denoising in photon-counting CT using single-step posterior sampling Poisson flow generative models

abstract: Diffusion and Poisson flow models have shown impressive performance in a wide range of generative tasks, including low-dose CT image denoising. However, one limitation in general, and for clinical applications in particular, is slow sampling. Due to their iterative nature, the number of function evaluations (NFE) required is usually on the order of $10-10^3$, both for conditional and unconditional generation. In this paper, we present posterior sampling Poisson flow generative models (PPFM), a novel image denoising technique for low-dose and photon-counting CT that produces excellent image quality whilst keeping NFE=1. Updating the training and sampling processes of Poisson flow generative models (PFGM)++, we learn a conditional generator which defines a trajectory between the prior noise distribution and the posterior distribution of interest. We additionally hijack and regularize the sampling process to achieve NFE=1. Our results shed light on the benefits of the PFGM++ framework compared to diffusion models. In addition, PPFM is shown to perform favorably compared to current state-of-the-art diffusion-style models with NFE=1, consistency models, as well as popular deep learning and non-deep learning-based image denoising techniques, on clinical low-dose CT images and clinical images from a prototype photon-counting CT system.


title: Two-electron interference in two-photon attosecond double ionization of neon

abstract: The pump-probe experiments enabled by X-ray free-electron lasers (XFEL) will allow us to directly observe correlated electronic motion with attosecond time resolution by detecting photoelectron pairs in coincidence. In helium, the transition between the non-sequential and sequential regime in two-photon double ionization (TPDI) is well explained by a virtual-sequential model. Much less is known, however, about the TPDI process in more complex atoms. Recently, we extended the virtual-sequential model to arbitrary light pulses [Chattopadhyay {\it et al.,} Phys. Rev. A~{\bf 108}, 013114 (2023)]. This extension employs multi-channel scattering states for the single ionization of both the neutral and the ionized target, which we initally applied to helium. In the present study, we show that our extended virtual-sequential model reproduces the qualitative features of the angularly integrated observables with available experimental results for neon, a considerably more complex target. We observe an intriguing feature of inverted two-particle interference in the joint energy distribution of $\mathrm{Ne}$ compared to $\mathrm{He}$. This phenomenon, attributable to the presence of a final doubly ionized state with triplet symmetry coupled to the two photoelectrons, should be observable with current experimental technologies.


title: The VISCACHA survey -- IX. The SMC Southern Bridge in 8D

abstract: The structure of the Small Magellanic Cloud (SMC) outside of its main body is characterised by tidal branches resulting from its interactions mainly with the Large Magellanic Cloud (LMC). Characterising the stellar populations in these tidal components helps to understand the dynamical history of this galaxy and of the Magellanic system in general. We provide full phase-space vector information for Southern Bridge clusters. We performed a photometric and spectroscopic analysis of twelve SMC clusters, doubling the number of SMC clusters with full phase-space vector information known to date. We reclassify the sample considering 3D distances and 3D velocities. We found that some of the clusters classified as Southern Bridge objects according to the projected 2D classification actually belong to the Main Body and Counter-Bridge in the background. The comparison of the kinematics of the genuine foreground Bridge clusters with those previously analysed in the same way reveals that Southern Bridge clusters are moving towards the LMC and share the kinematics of the Northern Bridge. Adding to our sample clusters from the literature with CaT metallicity determinations we compare the age-metallicity relation of the Southern Bridge with the one of the Northern Bridge. We reinforce the idea that both regions do not seem to have experienced the same chemical enrichment history and that there is a clear absence of clusters in the Northern Bridge older than 3Gyr and more metal-poor than -1.1, which would not seem to be due to a selection effect.


title: Benchmarking the Full-Order Model Optimization Based Imitation in the Humanoid Robot Reinforcement Learning Walk

abstract: When a gait of a bipedal robot is developed using deep reinforcement learning, reference trajectories may or may not be used. Each approach has its advantages and disadvantages, and the choice of method is up to the control developer. This paper investigates the effect of reference trajectories on locomotion learning and the resulting gaits. We implemented three gaits of a full-order anthropomorphic robot model with different reward imitation ratios, provided sim-to-sim control policy transfer, and compared the gaits in terms of robustness and energy efficiency. In addition, we conducted a qualitative analysis of the gaits by interviewing people, since our task was to create an appealing and natural gait for a humanoid robot. According to the results of the experiments, the most successful approach was the one in which the average value of rewards for imitation and adherence to command velocity per episode remained balanced throughout the training. The gait obtained with this method retains naturalness (median of 3.6 according to the user study) compared to the gait trained with imitation only (median of 4.0), while remaining robust close to the gait trained without reference trajectories.


title: Diagnosing and Rectifying Fake OOD Invariance: A Restructured Causal Approach

abstract: Invariant representation learning (IRL) encourages the prediction from invariant causal features to labels de-confounded from the environments, advancing the technical roadmap of out-of-distribution (OOD) generalization. Despite spotlights around, recent theoretical results verified that some causal features recovered by IRLs merely pretend domain-invariantly in the training environments but fail in unseen domains. The \emph{fake invariance} severely endangers OOD generalization since the trustful objective can not be diagnosed and existing causal surgeries are invalid to rectify. In this paper, we review a IRL family (InvRat) under the Partially and Fully Informative Invariant Feature Structural Causal Models (PIIF SCM /FIIF SCM) respectively, to certify their weaknesses in representing fake invariant features, then, unify their causal diagrams to propose ReStructured SCM (RS-SCM). RS-SCM can ideally rebuild the spurious and the fake invariant features simultaneously. Given this, we further develop an approach based on conditional mutual information with respect to RS-SCM, then rigorously rectify the spurious and fake invariant effects. It can be easily implemented by a small feature selection subnet introduced in the IRL family, which is alternatively optimized to achieve our goal. Experiments verified the superiority of our approach to fight against the fake invariant issue across a variety of OOD generalization benchmarks.


title: Conservation laws that depend on functions and PDE reduction: extending Noether $1\tfrac{1}{2}$

abstract: This paper develops methods for simplifying systems of partial differential equations that have families of conservation laws which depend on functions of the independent or dependent variables. In some cases, such methods can be combined with reduction using families of symmetries, giving a multiple reduction that is analogous to the double reduction of order for ordinary differential equations with variational symmetries. Applications are given, including a widely-used class of pseudoparabolic equations and several mean curvature equations.


title: U2-KWS: Unified Two-pass Open-vocabulary Keyword Spotting with Keyword Bias

abstract: Open-vocabulary keyword spotting (KWS), which allows users to customize keywords, has attracted increasingly more interest. However, existing methods based on acoustic models and post-processing train the acoustic model with ASR training criteria to model all phonemes, making the acoustic model under-optimized for the KWS task. To solve this problem, we propose a novel unified two-pass open-vocabulary KWS (U2-KWS) framework inspired by the two-pass ASR model U2. Specifically, we employ the CTC branch as the first stage model to detect potential keyword candidates and the decoder branch as the second stage model to validate candidates. In order to enhance any customized keywords, we redesign the U2 training procedure for U2-KWS and add keyword information by audio and text cross-attention into both branches. We perform experiments on our internal dataset and Aishell-1. The results show that U2-KWS can achieve a significant relative wake-up rate improvement of 41% compared to the traditional customized KWS systems when the false alarm rate is fixed to 0.5 times per hour.


title: Accurate and gate-efficient quantum ans\"atze for electronic states without adaptive optimisation

abstract: The ability of quantum computers to overcome the exponential memory scaling of many-body problems is expected to transform quantum chemistry. Quantum algorithms require accurate representations of electronic states on a quantum device, but current approximations struggle to combine chemical accuracy and gate-efficiency while preserving physical symmetries, and rely on measurement-intensive adaptive methods that tailor the wave function ansatz to each molecule. In this contribution, we present a symmetry-preserving and gate-efficient ansatz that provides chemically accurate molecular energies with a well-defined circuit structure. Our approach exploits local qubit connectivity, orbital optimisation, and connections with generalised valence bond theory to maximise the accuracy that is obtained with shallow quantum circuits. Numerical simulations for molecules with weak and strong electron correlation, including benzene, water, and the singlet-triplet gap in tetramethyleneethane, demonstrate that chemically accurate energies are achieved with as much as 84% fewer two-qubit gates compared to state-of-the-art adaptive ansatz techniques.


title: Discontinuous Galerkin methods for the Vlasov-Stokes' system

abstract: This paper develops and analyses semi-discrete numerical method for two dimensional Vlasov-Stokes' system with periodic boundary condition. The method is based on coupling of semi-discrete discontinuous Galerkin method for the Vlasov equation with discontinuous Galerkin scheme for the stationary incompressible Stokes' equation. The proposed method is both mass and momentum conservative. Since it is difficult to establish non-negativity of the discrete local density, the generalized discrete Stokes' operator become non-coercive and indefinite and under smallness condition on the discretization parameter, optimal error estimates are established with help of a modified the Stokes' projection to deal with Stokes' part and with the help of a special projection to tackle the Vlasov part. Finally, numerical experiments based on the dG method combined with a splitting algorithm are performed.


title: matvis: A matrix-based visibility simulator for fast forward modelling of many-element 21 cm arrays

abstract: Detection of the faint 21 cm line emission from the Cosmic Dawn and Epoch of Reionisation will require not only exquisite control over instrumental calibration and systematics to achieve the necessary dynamic range of observations but also validation of analysis techniques to demonstrate their statistical properties and signal loss characteristics. A key ingredient in achieving this is the ability to perform high-fidelity simulations of the kinds of data that are produced by the large, many-element, radio interferometric arrays that have been purpose-built for these studies. The large scale of these arrays presents a computational challenge, as one must simulate a detailed sky and instrumental model across many hundreds of frequency channels, thousands of time samples, and tens of thousands of baselines for arrays with hundreds of antennas. In this paper, we present a fast matrix-based method for simulating radio interferometric measurements (visibilities) at the necessary scale. We achieve this through judicious use of primary beam interpolation, fast approximations for coordinate transforms, and a vectorised outer product to expand per-antenna quantities to per-baseline visibilities, coupled with standard parallelisation techniques. We validate the results of this method, implemented in the publicly-available matvis code, against a high-precision reference simulator, and explore its computational scaling on a variety of problems.


title: Multi-antenna probing of absorbing regions inside and outside Cassiopeia A

abstract: Context. Cassiopeia A occupies an important place among supernova remnants (SNRs) in low-frequency radio astronomy. The analysis of its continuum spectrum from low frequency observations reveals the evolution of the SNR absorption properties over time and suggests a method for probing unshocked ejecta and the SNR interaction with the circumstellar medium (CSM). Aims. In this paper we present low-frequency measurements of the integrated spectrum of Cassiopeia A to find the typical values of free-free absorption parameters towards this SNR in the middle of 2023. We also add new results to track its slowly evolving and decreasing integrated flux density. Methods. We used the New Extension in Nan\c{c}ay Upgrading LOFAR (NenuFAR) and the Ukrainian Radio Interferometer of NASU (URAN-2, Poltava) for measuring the continuum spectrum of Cassiopeia A within the frequency range of 8-66 MHz. The radio flux density of Cassiopeia A has been obtained on June-July, 2023 with two sub-arrays for each radio telescope, used as a two-element correlation interferometer. Results. We measured magnitudes of emission measure, electron temperature and an average number of charges of the ions for both internal and external absorbing ionized gas towards Cassiopeia A from its integrated spectrum. Generally, their values are comparable to those presented by Stanislavsky et al. (2023), but their slight changes show the evolution of free-free absorption parameters in this SNR. Based on high accuracy of the measurements, we have detected the SNR-CSM interaction. Conclusions. The integrated flux-density spectrum of Cassiopeia A obtained with the NenuFAR and URAN-2 interferometric observations opens up new possibilities for continuous monitoring the ionized gas properties in and around Cassiopeia A to observe theevolution of unshocked ejecta and the SNR-CSM interaction in future studies.


title: Entropic uncertainty relations and entanglement detection from quantum designs

abstract: Uncertainty relations and quantum entanglement are pivotal concepts in quantum theory. Beyond their fundamental significance in shaping our understanding of the quantum world, they also underpin crucial applications in quantum information theory. In this article, we investigate entropic uncertainty relations and entanglement detection with an emphasis on quantum measurements with design structures. On the one hand, we derive improved R\'enyi entropic uncertainty relations for design-structured measurements, exploiting the property that the sum of powered (e.g., squared) probabilities of obtaining different measurement outcomes is now invariant under unitary transformations of the measured system and can be easily computed. On the other hand, the above property essentially imposes a state-independent upper bound, which is achieved at all pure states, on one's ability to predict local outcomes when performing a set of design-structured measurements on quantum systems. Realizing this, we also obtain criteria for detecting multi-partite entanglement with design-structured measurements.


title: Celestial Machine Learning: From Data to Mars and Beyond with AI Feynman

abstract: Can a machine or algorithm discover or learn Kepler's first law from astronomical sightings alone? We emulate Johannes Kepler's discovery of the equation of the orbit of Mars with the Rudolphine tables using AI Feynman, a physics-inspired tool for symbolic regression.


title: DreamTalk: When Expressive Talking Head Generation Meets Diffusion Probabilistic Models

abstract: Diffusion models have shown remarkable success in a variety of downstream generative tasks, yet remain under-explored in the important and challenging expressive talking head generation. In this work, we propose a DreamTalk framework to fulfill this gap, which employs meticulous design to unlock the potential of diffusion models in generating expressive talking heads. Specifically, DreamTalk consists of three crucial components: a denoising network, a style-aware lip expert, and a style predictor. The diffusion-based denoising network is able to consistently synthesize high-quality audio-driven face motions across diverse expressions. To enhance the expressiveness and accuracy of lip motions, we introduce a style-aware lip expert that can guide lip-sync while being mindful of the speaking styles. To eliminate the need for expression reference video or text, an extra diffusion-based style predictor is utilized to predict the target expression directly from the audio. By this means, DreamTalk can harness powerful diffusion models to generate expressive faces effectively and reduce the reliance on expensive style references. Experimental results demonstrate that DreamTalk is capable of generating photo-realistic talking faces with diverse speaking styles and achieving accurate lip motions, surpassing existing state-of-the-art counterparts.


title: Decoding Envelope and Frequency-Following EEG Responses to Continuous Speech Using Deep Neural Networks

abstract: The electroencephalogram (EEG) offers a non-invasive means by which a listener's auditory system may be monitored during continuous speech perception. Reliable auditory-EEG decoders could facilitate the objective diagnosis of hearing disorders, or find applications in cognitively-steered hearing aids. Previously, we developed decoders for the ICASSP Auditory EEG Signal Processing Grand Challenge (SPGC). These decoders aimed to solve the match-mismatch task: given a short temporal segment of EEG recordings, and two candidate speech segments, the task is to identify which of the two speech segments is temporally aligned, or matched, with the EEG segment. The decoders made use of cortical responses to the speech envelope, as well as speech-related frequency-following responses, to relate the EEG recordings to the speech stimuli. Here we comprehensively document the methods by which the decoders were developed. We extend our previous analysis by exploring the association between speaker characteristics (pitch and sex) and classification accuracy, and provide a full statistical analysis of the final performance of the decoders as evaluated on a heldout portion of the dataset. Finally, the generalisation capabilities of the decoders are characterised, by evaluating them using an entirely different dataset which contains EEG recorded under a variety of speech-listening conditions. The results show that the match-mismatch decoders achieve accurate and robust classification accuracies, and they can even serve as auditory attention decoders without additional training.


title: Semimartingale driven mechanics and reduction by symmetry for stochastic and dissipative dynamical systems

abstract: The recent interest in structure preserving stochastic Lagrangian and Hamiltonian systems raises questions regarding how such models are to be understood and the principles through which they are to be derived. By considering a mathematically sound extension of the Hamilton-Pontryagin principle, we derive a stochastic analogue of the Euler-Lagrange equations, driven by independent semimartingales. Using this as a starting point, we can apply symmetry reduction carefully to derive non-canonical stochastic Lagrangian / Hamiltonian systems, including the stochastic Euler-Poincar\'e / Lie-Poisson equations, studied extensively in the literature. Furthermore, we develop a framework to include dissipation that balances the structure-preserving noise in such a way that the overall stochastic dynamics preserves the Gibbs measure on the symplectic manifold, where the dynamics effectively take place. In particular, this leads to a new derivation of double-bracket dissipation by considering Lie group invariant stochastic dissipative dynamics, taking place on the cotangent bundle of the group.


title: Beyond Over-Protection: A Targeted Approach to Spectre Mitigation and Performance Optimization

abstract: Since the advent of Spectre attacks, researchers and practitioners have developed a range of hardware and software measures to counter transient execution attacks. A prime example of such mitigation is speculative load hardening in LLVM, which protects against leaks by tracking the speculation state and masking values during misspeculation. LLVM relies on static analysis to harden programs using slh that often results in over-protection, which incurs performance overhead. We extended an existing side-channel model validation framework, Scam-V, to check the vulnerability of programs to Spectre-PHT attacks and optimize the protection of programs using the slh approach. We illustrate the efficacy of Scam-V by first demonstrating that it can automatically identify Spectre vulnerabilities in real programs, e.g., fragments of crypto-libraries. We then develop an optimization mechanism that validates the necessity of slh hardening w.r.t. the target platform. Our experiments showed that hardening introduced by LLVM in most cases could be significantly improved when the underlying microarchitecture properties are considered.


title: Degenerations of 3-dimensional nilpotent associative algebras over an algebraically closed field

abstract: We determine the complete degeneration picture inside the variety of nilpotent associative algebras of dimension 3 over an algebraically closed field of characteristic not equal to 2. Comparing with the discussion in [Ivanova N.M. and Pallikaros C.A., Degenerations of complex associative algebras of dimension three via Lie and Jordan algebras, {\it Advances in Group Theory and Applications}, in press], for some of the arguments in the present article we needed to develop alternative techniques which are now valid over an arbitrary algebraically closed field.


title: The crucial role of Lagrange multipliers in a space-time symmetry preserving discretization scheme for IVPs

abstract: In a recently developed variational discretization scheme for second order initial value problems ( J. Comput. Phys. 498, 112652 (2024) ), it was shown that the Noether charge associated with time translation symmetry is exactly preserved in the interior of the simulated domain. The obtained solution also fulfils the naively discretized equations of motions inside the domain, except for the last two grid points. Here we provide an explanation for the deviations at the boundary as stemming from the Lagrange multipliers used to implement initial and connection conditions. We show explicitly that the Noether charge including the boundary corrections is exactly preserved at its continuum value over the whole simulation domain, including the boundary points.


title: In vivo learning-based control of microbial populations density in bioreactors

abstract: A key problem toward the use of microorganisms as bio-factories is reaching and maintaining cellular communities at a desired density and composition so that they can efficiently convert their biomass into useful compounds. Promising technological platforms for the real time, scalable control of cellular density are bioreactors. In this work, we developed a learning-based strategy to expand the toolbox of available control algorithms capable of regulating the density of a \textit{single} bacterial population in bioreactors. Specifically, we used a sim-to-real paradigm, where a simple mathematical model, calibrated using a few data, was adopted to generate synthetic data for the training of the controller. The resulting policy was then exhaustively tested in vivo using a low-cost bioreactor known as Chi.Bio, assessing performance and robustness. In addition, we compared the performance with more traditional controllers (namely, a PI and an MPC), confirming that the learning-based controller exhibits similar performance in vivo. Our work showcases the viability of learning-based strategies for the control of cellular density in bioreactors, making a step forward toward their use for the control of the composition of microbial consortia.


title: A note on the semistability of singular projective hypersurfaces

abstract: In this note, we give sufficient conditions for the (semi)stability of a hypersurface $H$ of $\mathbb{P}^N_k$ in terms of its degree $d$, the maximal multiplicity $\delta$ of its singularities, and the dimension $s$ of its singular locus. For instance, we show that $H$ is semistable when $d \geq \delta \min (N+1, s+3)$. The proof relies in particular on Benoist's lower bound for the dimension of the intersection of the singular locus $H_{\mathrm{sing}}$ of $H$ with some linear subspace of $\mathbb{P}^N_k$ associated to a one-parameter subgroup $\lambda$ of $\mathrm{SL}_{N+1, k}$, in terms of the numerical data in the Hilbert-Mumford criterion applied to $\lambda$ and to an equation $F_H$ of $H$.


title: A Comparative Evaluation of Additive Separability Tests for Physics-Informed Machine Learning

abstract: Many functions characterising physical systems are additively separable. This is the case, for instance, of mechanical Hamiltonian functions in physics, population growth equations in biology, and consumer preference and utility functions in economics. We consider the scenario in which a surrogate of a function is to be tested for additive separability. The detection that the surrogate is additively separable can be leveraged to improve further learning. Hence, it is beneficial to have the ability to test for such separability in surrogates. The mathematical approach is to test if the mixed partial derivative of the surrogate is zero; or empirically, lower than a threshold. We present and comparatively and empirically evaluate the eight methods to compute the mixed partial derivative of a surrogate function.


title: A merging interaction model explains human drivers' behaviour from input signals to decisions

abstract: One of the bottlenecks of automated driving technologies is safe and socially acceptable interactions with human-driven vehicles, for example during merging. Driver models that provide accurate predictions of joint and individual driver behaviour of high-level decisions, safety margins, and low-level control inputs are required to improve the interactive capabilities of automated driving. Existing driver models typically focus on one of these aspects. Unified models capturing all aspects are missing which hinders understanding of the principles that govern human traffic interactions. This in turn limits the ability of automated vehicles to resolve merging interactions. Here, we present a communication-enabled interaction model based on risk perception with the potential to capture merging interactions on all three levels. Our model accurately describes human behaviour in a simplified merging scenario, addressing both individual actions (such as velocity adjustments) and joint actions (such as the order of merging). Contrary to other interaction models, our model does not assume humans are rational and explicitly accounts for communication between drivers. Our results demonstrate that communication and risk-based decision-making explain observed human interactions on multiple levels. This explanation improves our understanding of the underlying mechanisms of human traffic interactions and poses a step towards interaction-aware automated driving.


title: Weyl formula and thermodynamics of geometric flow

abstract: We study the Weyl formula for the asymptotic number of eigenvalues of the Laplace-Beltrami operator with Dirichlet boundary condition on a Riemannian manifold in the context of geometric flows. Assuming the eigenvalues to be the energies of some associated statistical system, we show that geometric flows are directly related with the direction of increasing entropy chosen. For a closed Riemannian manifold we obtain a volume preserving flow of geometry being equivalent to the increment of Gibbs entropy function derived from the spectrum of Laplace-Beltrami operator. Resemblance with Arnowitt, Deser, and Misner (ADM) formalism of gravity is also noted by considering open Riemannian manifolds, directly equating the geometric flow parameter and the direction of increasing entropy as time direction.


title: Hypergraph-MLP: Learning on Hypergraphs without Message Passing

abstract: Hypergraphs are vital in modelling data with higher-order relations containing more than two entities, gaining prominence in machine learning and signal processing. Many hypergraph neural networks leverage message passing over hypergraph structures to enhance node representation learning, yielding impressive performances in tasks like hypergraph node classification. However, these message-passing-based models face several challenges, including oversmoothing as well as high latency and sensitivity to structural perturbations at inference time. To tackle those challenges, we propose an alternative approach where we integrate the information about hypergraph structures into training supervision without explicit message passing, thus also removing the reliance on it at inference. Specifically, we introduce Hypergraph-MLP, a novel learning framework for hypergraph-structured data, where the learning model is a straightforward multilayer perceptron (MLP) supervised by a loss function based on a notion of signal smoothness on hypergraphs. Experiments on hypergraph node classification tasks demonstrate that Hypergraph-MLP achieves competitive performance compared to existing baselines, and is considerably faster and more robust against structural perturbations at inference.


title: Convex ordering of solutions to one-dimensional SDEs

abstract: In this paper, we are interested in the propagation of convexity by the strong solution to a one-dimensional Brownian stochastic differential equation with coefficients Lipschitz in the spatial variable uniformly in the time variable and in the convex ordering between the solutions of two such equations. We prove that while these properties hold without further assumptions for convex functions of the processes at one instant only, an assumption almost amounting to spatial convexity of the diffusion coefficient is needed for the extension to convex functions at two instants. Under this spatial convexity of the diffusion coefficients, the two properties even hold for convex functionals of the whole path. For directionally convex functionals, the spatial convexity of the diffusion coefficient is no longer needed. Our method of proof consists in first establishing the results for time discretization schemes of Euler type and then transferring them to their limiting Brownian diffusions. We thus exhibit approximations which avoid {\em convexity arbitrages} by preserving convexity propagation and comparison and can be computed by Monte Carlo simulation.


title: RANRAC: Robust Neural Scene Representations via Random Ray Consensus

abstract: Learning-based scene representations such as neural radiance fields or light field networks, that rely on fitting a scene model to image observations, commonly encounter challenges in the presence of inconsistencies within the images caused by occlusions, inaccurately estimated camera parameters or effects like lens flare. To address this challenge, we introduce RANdom RAy Consensus (RANRAC), an efficient approach to eliminate the effect of inconsistent data, thereby taking inspiration from classical RANSAC based outlier detection for model fitting. In contrast to the down-weighting of the effect of outliers based on robust loss formulations, our approach reliably detects and excludes inconsistent perspectives, resulting in clean images without floating artifacts. For this purpose, we formulate a fuzzy adaption of the RANSAC paradigm, enabling its application to large scale models. We interpret the minimal number of samples to determine the model parameters as a tunable hyperparameter, investigate the generation of hypotheses with data-driven models, and analyze the validation of hypotheses in noisy environments. We demonstrate the compatibility and potential of our solution for both photo-realistic robust multi-view reconstruction from real-world images based on neural radiance fields and for single-shot reconstruction based on light-field networks. In particular, the results indicate significant improvements compared to state-of-the-art robust methods for novel-view synthesis on both synthetic and captured scenes with various inconsistencies including occlusions, noisy camera pose estimates, and unfocused perspectives. The results further indicate significant improvements for single-shot reconstruction from occluded images. Project Page: https://bennobuschmann.com/ranrac/


title: GSQA: An End-to-End Model for Generative Spoken Question Answering

abstract: In recent advancements in spoken question answering (QA), end-to-end models have made significant strides. However, previous research has primarily focused on extractive span selection. While this extractive-based approach is effective when answers are present directly within the input, it falls short in addressing abstractive questions, where answers are not directly extracted but inferred from the given information. To bridge this gap, we introduce the first end-to-end Generative Spoken Question Answering (GSQA) model that empowers the system to engage in abstractive reasoning. The challenge in training our GSQA model lies in the absence of a spoken abstractive QA dataset. We propose using text models for initialization and leveraging the extractive QA dataset to transfer knowledge from the text generative model to the spoken generative model. Experimental results indicate that our model surpasses the previous extractive model by 3% on extractive QA datasets. Furthermore, the GSQA model has only been fine-tuned on the spoken extractive QA dataset. Despite not having seen any spoken abstractive QA data, it can still closely match the performance of the cascade model. In conclusion, our GSQA model shows the potential to generalize to a broad spectrum of questions, thus further expanding the spoken question answering capabilities of abstractive QA. Our code is available at https://voidful.github.io/GSQA


title: Response functions and giant monopole resonances for light to medium-mass nuclei from the \textit{ab initio} symmetry-adapted no-core shell model

abstract: Using the \textit{ab initio} symmetry-adapted no-core shell model, we compute sum rules and response functions for light to medium-mass nuclei, starting from interactions that are derived in the chiral effective field theory. We investigate electromagnetic transitions of monopole, dipole and quadrupole nature for symmetric nuclei such as $^4$He, $^{16}$O, $^{20}$Ne and $^{40}$Ca. Furthermore, we study giant monopole resonance, which can provide information on the incompressibility of symmetric nuclear matter.


title: Keep the Faith: Faithful Explanations in Convolutional Neural Networks for Case-Based Reasoning

abstract: Explaining predictions of black-box neural networks is crucial when applied to decision-critical tasks. Thus, attribution maps are commonly used to identify important image regions, despite prior work showing that humans prefer explanations based on similar examples. To this end, ProtoPNet learns a set of class-representative feature vectors (prototypes) for case-based reasoning. During inference, similarities of latent features to prototypes are linearly classified to form predictions and attribution maps are provided to explain the similarity. In this work, we evaluate whether architectures for case-based reasoning fulfill established axioms required for faithful explanations using the example of ProtoPNet. We show that such architectures allow the extraction of faithful explanations. However, we prove that the attribution maps used to explain the similarities violate the axioms. We propose a new procedure to extract explanations for trained ProtoPNets, named ProtoPFaith. Conceptually, these explanations are Shapley values, calculated on the similarity scores of each prototype. They allow to faithfully answer which prototypes are present in an unseen image and quantify each pixel's contribution to that presence, thereby complying with all axioms. The theoretical violations of ProtoPNet manifest in our experiments on three datasets (CUB-200-2011, Stanford Dogs, RSNA) and five architectures (ConvNet, ResNet, ResNet50, WideResNet50, ResNeXt50). Our experiments show a qualitative difference between the explanations given by ProtoPNet and ProtoPFaith. Additionally, we quantify the explanations with the Area Over the Perturbation Curve, on which ProtoPFaith outperforms ProtoPNet on all experiments by a factor $>10^3$.


title: Quantum Algorithm for Solving the Advection Equation using Hamiltonian Simulation

abstract: A quantum algorithm for solving the advection equation by embedding the discrete time-marching operator into Hamiltonian simulations is presented. One-dimensional advection can be simulated directly since the central finite difference operator for first-order derivatives is anti-Hermitian. Here, this is extended to industrially relevant, multi-dimensional flows with realistic boundary conditions and arbitrary finite difference stencils. A single copy of the initial quantum state is required and the circuit depth grows linearly with the required number of time steps, the sparsity of the time-marching operator and the inverse of the allowable error. Statevector simulations of a scalar transported in a two-dimensional channel flow and lid-driven cavity configuration are presented as a proof of concept of the proposed approach.


title: RJUA-QA: A Comprehensive QA Dataset for Urology

abstract: We introduce RJUA-QA, a novel medical dataset for question answering (QA) and reasoning with clinical evidence, contributing to bridge the gap between general large language models (LLMs) and medical-specific LLM applications. RJUA-QA is derived from realistic clinical scenarios and aims to facilitate LLMs in generating reliable diagnostic and advice. The dataset contains 2,132 curated Question-Context-Answer pairs, corresponding about 25,000 diagnostic records and clinical cases. The dataset covers 67 common urological disease categories, where the disease coverage exceeds 97.6\% of the population seeking medical services in urology. Each data instance in RJUA-QA comprises: (1) a question mirroring real patient to inquiry about clinical symptoms and medical conditions, (2) a context including comprehensive expert knowledge, serving as a reference for medical examination and diagnosis, (3) a doctor response offering the diagnostic conclusion and suggested examination guidance, (4) a diagnosed clinical disease as the recommended diagnostic outcome, and (5) clinical advice providing recommendations for medical examination. RJUA-QA is the first medical QA dataset for clinical reasoning over the patient inquiries, where expert-level knowledge and experience are required for yielding diagnostic conclusions and medical examination advice. A comprehensive evaluation is conducted to evaluate the performance of both medical-specific and general LLMs on the RJUA-QA dataset. Our data is are publicly available at \url{https://github.com/alipay/RJU_Ant_QA}.


title: Drones Guiding Drones: Cooperative Navigation of a Less-Equipped Micro Aerial Vehicle in Cluttered Environments

abstract: Reliable deployment of Unmanned Aerial Vehicles (UAVs) in cluttered unknown environments requires accurate sensors for Global Navigation Satellite System (GNSS)-denied localization and obstacle avoidance. Such a requirement limits the usage of cheap and micro-scale vehicles with constrained payload capacity if industrial-grade reliability and precision are required. This paper investigates the possibility of offloading the necessity to carry heavy sensors to another member of the UAV team while preserving the desired capability of the smaller robot intended for exploring narrow passages. A novel cooperative guidance framework offloading the sensing requirements from a minimalistic secondary UAV to a superior primary UAV is proposed. The primary UAV constructs a dense occupancy map of the environment and plans collision-free paths for both UAVs to ensure reaching the desired secondary UAV's goals even in areas not accessible by the bigger robot. The primary UAV guides the secondary UAV to follow the planned path while tracking the UAV using Light Detection and Ranging (LiDAR)-based relative localization. The proposed approach was verified in real-world experiments with a heterogeneous team of a 3D LiDAR-equipped primary UAV and a micro-scale camera-equipped secondary UAV moving autonomously through unknown cluttered GNSS-denied environments with the proposed framework running fully on board the UAVs.


title: Physics-informed Neural Network Estimation of Material Properties in Soft Tissue Nonlinear Biomechanical Models

abstract: The development of biophysical models for clinical applications is rapidly advancing in the research community, thanks to their predictive nature and their ability to assist the interpretation of clinical data. However, high-resolution and accurate multi-physics computational models are computationally expensive and their personalisation involves fine calibration of a large number of parameters, which may be space-dependent, challenging their clinical translation. In this work, we propose a new approach which relies on the combination of physics-informed neural networks (PINNs) with three-dimensional soft tissue nonlinear biomechanical models, capable of reconstructing displacement fields and estimating heterogeneous patient-specific biophysical properties. The proposed learning algorithm encodes information from a limited amount of displacement and, in some cases, strain data, that can be routinely acquired in the clinical setting, and combines it with the physics of the problem, represented by a mathematical model based on partial differential equations, to regularise the problem and improve its convergence properties. Several benchmarks are presented to show the accuracy and robustness of the proposed method and its great potential to enable the robust and effective identification of patient-specific, heterogeneous physical properties, s.a. tissue stiffness properties. In particular, we demonstrate the capability of the PINN to detect the presence, location and severity of scar tissue, which is beneficial to develop personalised simulation models for disease diagnosis, especially for cardiac applications.

categories: cs.LG cs.NA math.NA physics.bio-ph physics.med-ph


title: Collaborating Foundation Models for Domain Generalized Semantic Segmentation

abstract: Domain Generalized Semantic Segmentation (DGSS) deals with training a model on a labeled source domain with the aim of generalizing to unseen domains during inference. Existing DGSS methods typically effectuate robust features by means of Domain Randomization (DR). Such an approach is often limited as it can only account for style diversification and not content. In this work, we take an orthogonal approach to DGSS and propose to use an assembly of CoLlaborative FOUndation models for Domain Generalized Semantic Segmentation (CLOUDS). In detail, CLOUDS is a framework that integrates FMs of various kinds: (i) CLIP backbone for its robust feature representation, (ii) generative models to diversify the content, thereby covering various modes of the possible target distribution, and (iii) Segment Anything Model (SAM) for iteratively refining the predictions of the segmentation model. Extensive experiments show that our CLOUDS excels in adapting from synthetic to real DGSS benchmarks and under varying weather conditions, notably outperforming prior methods by 5.6% and 6.7% on averaged miou, respectively. The code is available at : https://github.com/yasserben/CLOUDS


title: Optimization meets Machine Learning: An Exact Algorithm for Semi-Supervised Support Vector Machines

abstract: Support vector machines (SVMs) are well-studied supervised learning models for binary classification. In many applications, large amounts of samples can be cheaply and easily obtained. What is often a costly and error-prone process is to manually label these instances. Semi-supervised support vector machines (S3VMs) extend the well-known SVM classifiers to the semi-supervised approach, aiming at maximizing the margin between samples in the presence of unlabeled data. By leveraging both labeled and unlabeled data, S3VMs attempt to achieve better accuracy and robustness compared to traditional SVMs. Unfortunately, the resulting optimization problem is non-convex and hence difficult to solve exactly. In this paper, we present a new branch-and-cut approach for S3VMs using semidefinite programming (SDP) relaxations. We apply optimality-based bound tightening to bound the feasible set. Box constraints allow us to include valid inequalities, strengthening the lower bound. The resulting SDP relaxation provides bounds significantly stronger than the ones available in the literature. For the upper bound, instead, we define a local search exploiting the solution of the SDP relaxation. Computational results highlight the efficiency of the algorithm, showing its capability to solve instances with a number of data points 10 times larger than the ones solved in the literature.


title: End-to-End Training of Neural Networks for Automotive Radar Interference Mitigation

abstract: In this paper we propose a new method for training neural networks (NNs) for frequency modulated continuous wave (FMCW) radar mutual interference mitigation. Instead of training NNs to regress from interfered to clean radar signals as in previous work, we train NNs directly on object detection maps. We do so by performing a continuous relaxation of the cell-averaging constant false alarm rate (CA-CFAR) peak detector, which is a well-established algorithm for object detection using radar. With this new training objective we are able to increase object detection performance by a large margin. Furthermore, we introduce separable convolution kernels to strongly reduce the number of parameters and computational complexity of convolutional NN architectures for radar applications. We validate our contributions with experiments on real-world measurement data and compare them against signal processing interference mitigation methods.


title: Network Members Can Hide from Group Centrality Measures

abstract: Group centrality measures are a generalization of standard centrality, designed to quantify the importance of not just a single node (as is the case with standard measures) but rather that of a group of nodes. Some nodes may have an incentive to evade such measures, i.e., to hide their actual importance, in order to conceal their true role in the network. A number of studies have been proposed in the literature to understand how nodes can rewire the network in order to evade standard centrality, but no study has focused on group centrality to date. We close this gap by analyzing four group centrality measures: degree, closeness, betweenness, and GED-walk. We show that an optimal way to rewire the network can be computed efficiently given the former measure, but the problem is NP-complete given closeness and betweenness. Moreover, we empirically evaluate a number of hiding strategies, and show that an optimal way to hide from degree group centrality is also effective in practice against the other measures. Altogether, our results suggest that it is possible to hide from group centrality measures based solely on the local information available to the group members about the network topology.


title: Latent Diffusion Models with Image-Derived Annotations for Enhanced AI-Assisted Cancer Diagnosis in Histopathology

abstract: Artificial Intelligence (AI) based image analysis has an immense potential to support diagnostic histopathology, including cancer diagnostics. However, developing supervised AI methods requires large-scale annotated datasets. A potentially powerful solution is to augment training data with synthetic data. Latent diffusion models, which can generate high-quality, diverse synthetic images, are promising. However, the most common implementations rely on detailed textual descriptions, which are not generally available in this domain. This work proposes a method that constructs structured textual prompts from automatically extracted image features. We experiment with the PCam dataset, composed of tissue patches only loosely annotated as healthy or cancerous. We show that including image-derived features in the prompt, as opposed to only healthy and cancerous labels, improves the Fr\'echet Inception Distance (FID) from 178.8 to 90.2. We also show that pathologists find it challenging to detect synthetic images, with a median sensitivity/specificity of 0.55/0.55. Finally, we show that synthetic data effectively trains AI models.


title: PAC-Bayes Generalisation Bounds for Dynamical Systems Including Stable RNNs

abstract: In this paper, we derive a PAC-Bayes bound on the generalisation gap, in a supervised time-series setting for a special class of discrete-time non-linear dynamical systems. This class includes stable recurrent neural networks (RNN), and the motivation for this work was its application to RNNs. In order to achieve the results, we impose some stability constraints, on the allowed models. Here, stability is understood in the sense of dynamical systems. For RNNs, these stability conditions can be expressed in terms of conditions on the weights. We assume the processes involved are essentially bounded and the loss functions are Lipschitz. The proposed bound on the generalisation gap depends on the mixing coefficient of the data distribution, and the essential supremum of the data. Furthermore, the bound converges to zero as the dataset size increases. In this paper, we 1) formalize the learning problem, 2) derive a PAC-Bayesian error bound for such systems, 3) discuss various consequences of this error bound, and 4) show an illustrative example, with discussions on computing the proposed bound. Unlike other available bounds the derived bound holds for non i.i.d. data (time-series) and it does not grow with the number of steps of the RNN.


title: The rise and fall of light stops in the LHC top quark sample

abstract: We discuss the possibility that light new physics in the top quark sample at the LHC can be found by investigating with greater care well known kinematic distributions, such as the invariant mass $m_{b\ell}$ of the $b$-jet and the charged lepton in fully leptonic $t\bar{t}$ events. We demonstrate that new physics can be probed in the rising part of the already measured $m_{b\ell}$ distribution. To this end we analyze a concrete supersymmetric scenario with light right-handed stop quark, chargino and neutralino. The corresponding spectra are characterized by small mass differences, which make them not yet excluded by current LHC searches and give rise to a specific end-point in the shape of the $m_{b\ell}$ distribution. We argue that this sharp feature is general for models of light new physics that have so far escaped the LHC searches and can offer a precious handle for the implementation of robust searches that exploit, rather than suffer from, soft bottom quarks and leptons. Recasting public data on searches for new physics, we identify candidate models that are not yet excluded. For these models we study the $m_{b\ell}$ distribution and derive the expected signal yields, finding that there is untapped potential for discovery of new physics using the $m_{b\ell}$ distribution.


title: Transformation of the Gibbs measure of the cubic NLS and fractional NLS under an approximated Birkhoff map

abstract: We study the Gibbs measure associated to the periodic cubic nonlinear Schr\"odinger equation. We establish a change of variable formula for this measure under the first step of the Birkhoff normal form reduction. We also consider the case of fractional dispersion.


title: Better Foundations for Subjective Probability

abstract: How do we ascribe subjective probability? In decision theory, this question is often addressed by representation theorems, going back to Ramsey (1926), which tell us how to define or measure subjective probability by observable preferences. However, standard representation theorems make strong rationality assumptions, in particular expected utility maximization. How do we ascribe subjective probability to agents which do not satisfy these strong rationality assumptions? I present a representation theorem with weak rationality assumptions which can be used to define or measure subjective probability for partly irrational agents.


title: Part Representation Learning with Teacher-Student Decoder for Occluded Person Re-identification

abstract: Occluded person re-identification (ReID) is a very challenging task due to the occlusion disturbance and incomplete target information. Leveraging external cues such as human pose or parsing to locate and align part features has been proven to be very effective in occluded person ReID. Meanwhile, recent Transformer structures have a strong ability of long-range modeling. Considering the above facts, we propose a Teacher-Student Decoder (TSD) framework for occluded person ReID, which utilizes the Transformer decoder with the help of human parsing. More specifically, our proposed TSD consists of a Parsing-aware Teacher Decoder (PTD) and a Standard Student Decoder (SSD). PTD employs human parsing cues to restrict Transformer's attention and imparts this information to SSD through feature distillation. Thereby, SSD can learn from PTD to aggregate information of body parts automatically. Moreover, a mask generator is designed to provide discriminative regions for better ReID. In addition, existing occluded person ReID benchmarks utilize occluded samples as queries, which will amplify the role of alleviating occlusion interference and underestimate the impact of the feature absence issue. Contrastively, we propose a new benchmark with non-occluded queries, serving as a complement to the existing benchmark. Extensive experiments demonstrate that our proposed method is superior and the new benchmark is essential. The source codes are available at https://github.com/hh23333/TSD.


title: Tunable 2D Electron- and 2D Hole States Observed at Fe/SrTiO$_3$ Interfaces

abstract: Oxide electronics provide the key concepts and materials for enhancing silicon-based semiconductor technologies with novel functionalities. However, a basic but key property of semiconductor devices still needs to be unveiled in its oxidic counterparts: the ability to set or even switch between two types of carriers - either negatively (n) charged electrons or positively (p) charged holes. Here, we provide direct evidence for individually emerging n- or p-type 2D band dispersions in STO-based heterostructures using resonant photoelectron spectroscopy. The key to tuning the carrier character is the oxidation state of an adjacent Fe-based interface layer: For Fe and FeO, hole bands emerge in the empty band gap region of STO due to hybridization of Ti and Fe-derived states across the interface, while for Fe$_3$O$_4$ overlayers, an 2D electron system is formed. Unexpected oxygen vacancy characteristics arise for the hole-type interfaces, which as of yet had been exclusively assigned to the emergence of 2DESs. In general, this finding opens up the possibility to straightforwardly switch the type of conductivity at STO interfaces by the oxidation state of a redox overlayer. This will extend the spectrum of phenomena in oxide electronics, including the realization of combined n/p-type all-oxide transistors or logic gates.


title: IQNet: Image Quality Assessment Guided Just Noticeable Difference Prefiltering For Versatile Video Coding

abstract: Image prefiltering with just noticeable distortion (JND) improves coding efficiency in a visual lossless way by filtering the perceptually redundant information prior to compression. However, real JND cannot be well modeled with inaccurate masking equations in traditional approaches or image-level subject tests in deep learning approaches. Thus, this paper proposes a fine-grained JND prefiltering dataset guided by image quality assessment for accurate block-level JND modeling. The dataset is constructed from decoded images to include coding effects and is also perceptually enhanced with block overlap and edge preservation. Furthermore, based on this dataset, we propose a lightweight JND prefiltering network, IQNet, which can be applied directly to different quantization cases with the same model and only needs 3K parameters. The experimental results show that the proposed approach to Versatile Video Coding could yield maximum/average bitrate savings of 41\%/15\% and 53\%/19\% for all-intra and low-delay P configurations, respectively, with negligible subjective quality loss. Our method demonstrates higher perceptual quality and a model size that is an order of magnitude smaller than previous deep learning methods.


title: Deep Event Visual Odometry

abstract: Event cameras offer the exciting possibility of tracking the camera's pose during high-speed motion and in adverse lighting conditions. Despite this promise, existing event-based monocular visual odometry (VO) approaches demonstrate limited performance on recent benchmarks. To address this limitation, some methods resort to additional sensors such as IMUs, stereo event cameras, or frame-based cameras. Nonetheless, these additional sensors limit the application of event cameras in real-world devices since they increase cost and complicate system requirements. Moreover, relying on a frame-based camera makes the system susceptible to motion blur and HDR. To remove the dependency on additional sensors and to push the limits of using only a single event camera, we present Deep Event VO (DEVO), the first monocular event-only system with strong performance on a large number of real-world benchmarks. DEVO sparsely tracks selected event patches over time. A key component of DEVO is a novel deep patch selection mechanism tailored to event data. We significantly decrease the pose tracking error on seven real-world benchmarks by up to 97% compared to event-only methods and often surpass or are close to stereo or inertial methods. Code is available at https://github.com/tum-vision/DEVO


title: ProCoT: Stimulating Critical Thinking and Writing of Students through Engagement with Large Language Models (LLMs)

abstract: We introduce a novel writing method called Probing Chain-of-Thought (ProCoT), which potentially prevents students from cheating using a Large Language Model (LLM), such as ChatGPT, while enhancing their active learning. LLMs have disrupted education and many other fields. For fear of students cheating, many have resorted to banning their use. These LLMs are also known for hallucinations. We conduct studies with ProCoT in two different courses with 65 students. The students in each course were asked to prompt an LLM of their choice with one question from a set of four and required to affirm or refute statements in the LLM output by using peer-reviewed references. The results show two things: (1) ProCoT stimulates creative/critical thinking and writing of students through engagement with LLMs when we compare the LLM-only output to ProCoT output and (2) ProCoT can prevent cheating because of clear limitations in existing LLMs, particularly ChatGPT, when we compare students' ProCoT output to LLM ProCoT output. We also discover that most students prefer to give answers in fewer words than LLMs, which are typically verbose. The average word counts for students in the first course, ChatGPT (v3.5), and Phind (v8) are 208, 391 and 383, respectively.


title: Concept Prerequisite Relation Prediction by Using Permutation-Equivariant Directed Graph Neural Networks

abstract: This paper studies the problem of CPRP, concept prerequisite relation prediction, which is a fundamental task in using AI for education. CPRP is usually formulated into a link-prediction task on a relationship graph of concepts and solved by training the graph neural network (GNN) model. However, current directed GNNs fail to manage graph isomorphism which refers to the invariance of non-isomorphic graphs, reducing the expressivity of resulting representations. We present a permutation-equivariant directed GNN model by introducing the Weisfeiler-Lehman test into directed GNN learning. Our method is then used for CPRP and evaluated on three public datasets. The experimental results show that our model delivers better prediction performance than the state-of-the-art methods.


title: Contradicted by the Brain: Predicting Individual and Group Preferences via Brain-Computer Interfacing

abstract: We investigate inferring individual preferences and the contradiction of individual preferences with group preferences through direct measurement of the brain. We report an experiment where brain activity collected from 31 participants produced in response to viewing images is associated with their self-reported preferences. First, we show that brain responses present a graded response to preferences, and that brain responses alone can be used to train classifiers that reliably estimate preferences. Second, we show that brain responses reveal additional preference information that correlates with group preference, even when participants self-reported having no such preference. Our analysis of brain responses carries significant implications for researchers in general, as it suggests an individual's explicit preferences are not always aligned with the preferences inferred from their brain responses. These findings call into question the reliability of explicit and behavioral signals. They also imply that additional, multimodal sources of information may be necessary to infer reliable preference information.


title: Towards the full Heisenberg-Euler effective action at large $N$

abstract: We study the Heisenberg-Euler effective action in constant electromagnetic fields $\bar{F}$ for QED with $N$ charged particle flavors of the same mass and charge $e$ in the large $N$ limit characterized by sending $N\to\infty$ while keeping $Ne^2\sim e\bar{F}\sim N^0$ fixed. This immediately implies that contributions that scale with inverse powers of $N$ can be neglected and the resulting effective action scales linearly with $N$. Interestingly, due to the presence of one-particle reducible diagrams, even in this limit the Heisenberg-Euler effective action receives contributions of arbitrary loop order. In particular for the special cases of electric- and magnetic-like field configurations we construct an explicit expression for the associated effective Lagrangian that, upon extremization for two constant scalar coefficients, allows to evaluate its full, all-order result at arbitrarily large field strengths. We demonstrate that our manifestly nonperturbative expression correctly reproduces the known results for the Heisenberg-Euler effective action at large $N$, namely its all-loop strong field limit and its low-order perturbative expansion in powers of the fine-structure constant.


title: A new causal and stable theory of viscous chiral hydrodynamics

abstract: We construct the general theory of first-order relativistic hydrodynamics for a fluid exhibiting a chiral anomaly, including all possible viscous terms allowed by symmetry. Using standard techniques, we compute the necessary and sufficient conditions for this theory to be relativistically causal in the nonlinear regime and for thermal equilibria to be linearly stable. This is the first theory of first-order chiral hydrodynamics suitable for numerical simulations.


title: Improving Biomedical Entity Linking with Retrieval-enhanced Learning

abstract: Biomedical entity linking (BioEL) has achieved remarkable progress with the help of pre-trained language models. However, existing BioEL methods usually struggle to handle rare and difficult entities due to long-tailed distribution. To address this limitation, we introduce a new scheme $k$NN-BioEL, which provides a BioEL model with the ability to reference similar instances from the entire training corpus as clues for prediction, thus improving the generalization capabilities. Moreover, we design a contrastive learning objective with dynamic hard negative sampling (DHNS) that improves the quality of the retrieved neighbors during inference. Extensive experimental results show that $k$NN-BioEL outperforms state-of-the-art baselines on several datasets.


title: Neural networks for turbulent transport prediction in a simplified model of tokamak plasmas

abstract: The method of using neural networks (NNs) for turbulent transport prediction in a simplified model of tokamak plasmas is explored. The NNs are trained on a database obtained via test-particle simulations of a transport model in the slab-geometrical approximation. It consists of a five-dimensional input of transport model parameters and the radial diffusion coefficient as output. The NNs display fast and efficient convergence, a validation error below 2$\%$, and predictions in excellent agreement with the real data, obtained orders of magnitude faster than test-particle simulations. In comparison to a spline interpolation, the NN outperforms, exhibiting better predicting and extrapolating capabilities. We demonstrate the preciseness and efficiency of this method as a proof-of-concept, establishing a promising approach for future, more comprehensive research on the use of NNs for transport predictions in tokamak plasmas.


title: $\textit{Insights}$ into the phase-dependent cyclotron line feature in XTE J1946+274: An $\textit{AstroSat}$ and $\textit{Insight}$-HXMT view

abstract: XTE J1946+274 is a Be/X-ray binary with a 15.8s spin period and 172 d orbital period. Using $\textit{RXTE/PCA}$ data of the 1998 outburst, a cyclotron line around 37 keV was reported. The presence of this line, its dependence on the pulse phase, and its variation with luminosity have been of some debate since. In this work, we present the reanalysis of two $\textit{AstroSat}$ observations: one made during the rising phase of the 2018 outburst and the other during the declining phase of the 2021 outburst. We also present a new analysis of the $\textit{Insight}$-HXMT observations of the source at the peak of the 2018 outburst. We find the source to be spinning up over the course of the outburst and spinning down between the two outbursts. We report the presence of a higher cyclotron line energy using the 2018 $\textit{AstroSat}$ observation ($\sim 45$ keV) and 2018 $\textit{Insight}$-HXMT observation ($\sim$ 50 keV) and a line at $\sim$ 40 keV during the declining phase of the 2021 outburst using data from $\textit{AstroSat}$. We also investigate the pulse phase dependence of the cyclotron line parameters and find that the line is significantly detected in all the phases of both $\textit{AstroSat}$ observations, along with showing variation with the pulse phase. This differs from the previous results reported using $\textit{BeppoSAX}$ and $\textit{NuSTAR}$. We explain this behaviour of the cyclotron line to be due to photon spawning and different accretion column radii at the two poles of this neutron star.


title: Constructing new open-closed TQFTs from the interpolation of symmetric monoidal categories

abstract: For any symmetric monoidal category $\mathcal{D}$, Lauda and Pfeiffer showed the equivalence between the $\mathcal{D}$-valued open-closed 2-dimensional TQFTs and the so-called knowledgeable Frobenius algebras (KFAs) in $\mathcal{D}$. Each KFA in $\mathcal{D}=\mathbf{Vec}_{\mathbb{K}}$ provides a sequence of scalars indexed by the set $\mathbb{N}^2$ of diffeomorphism classes of connected endocobordisms of the empty set, given by evaluation by the associated TQFT on each such cobordism class. From an arbitrary sequence $\chi=(\chi_{g,w})_{g,w\in\mathbb{N}}$, we build a symmetric monoidal category $\mathcal{C}_{\chi}$ -- with unit object $\textbf{1}$ satisfying $\text{End}_{\mathcal{C}_{\chi}}(\textbf{1})\cong \mathbb{K}$ -- generated by a KFA object affording this sequence. We then determine which sequences $\chi$ produce semisimple abelian categories $\mathcal{C}_{\chi}$ with finite-dimensional hom-spaces. These form a family of categories interpolating the categories of representations of automorphism groups of certain KFAs in $\mathbf{Vec}_{\mathbb{K}}$.


title: Surveying the Whirlpool at Arcseconds with NOEMA (SWAN)- I. Mapping the HCN and N$_2$H$^+$ 3mm lines

abstract: We present the first results from "Surveying the Whirlpool at Arcseconds with NOEMA" (SWAN), an IRAM Northern Extended Millimetre Array (NOEMA)+30m large program that maps emission from several molecular lines at 90 and 110 GHz in the iconic nearby grand-design spiral galaxy M~51 at cloud-scale resolution ($\sim$3\arcsec=125\,pc). As part of this work, we have obtained the first sensitive cloud-scale map of N$_2$H$^+$(1-0) of the inner $\sim5\,\times 7\,$kpc of a normal star-forming galaxy, which we compare to HCN(1-0) and CO(1-0) emission to test their ability in tracing dense, star-forming gas. The average N$_2$H$^+$-to-HCN line ratio of our total FoV is $0.20\pm0.09$, with strong regional variations of a factor of $\gtrsim 2$ throughout the disk, including the south-western spiral arm and the center. The central $\sim1\,$kpc exhibits elevated HCN emission compared to N$_2$H$^+$, probably caused by AGN-driven excitation effects. We find that HCN and N$_2$H$^+$ are strongly super-linearily correlated in intensity ($\rho_\mathrm{Sp}\sim 0.8$), with an average scatter of $\sim0.14\,$dex over a span of $\gtrsim 1.5\,$dex in intensity. When excluding the central region, the data is best described by a power-law of exponent $1.2$, indicating that there is more N$_2$H$^+$ per unit HCN in brighter regions. Our observations demonstrate that the HCN-to-CO line ratio is a sensitive tracer of gas density in agreement with findings of recent Galactic studies which utilize N$_2$H$^+$. The peculiar line ratios present near the AGN and the scatter of the power-law fit in the disk suggest that in addition to a first-order correlation with gas density, second-order physics (such as optical depth, gas temperature) or chemistry (abundance variations) are encoded in the N$_2$H$^+$/CO, HCN/CO and N$_2$H$^+$/HCN ratios.


title: A strategy for B-physics observables in the continuum limit

abstract: In a somewhat forgotten paper [1] it was shown how to perform interpolations between relativistic and static computations in order to obtain results for heavy-light observables for masses from, say, $m_{\rm charm}$ to $m_{\rm bottom}$. All quantities are first continuum extrapolated and then interpolated in $1/m_h=1/m_{\rm heavy}$. Large volume computations are combined with finite volume ones where a relativistic bottom quark is accessible with small $am_{\rm bottom}$. We discuss how this strategy is extended to semi-leptonic form factors and other quantities of phenomenological interest. The essential point is to form quantities where the limit $m_h\to\infty$ is approached with power corrections O$(1/m_h)$ only. Perturbative corrections $\sim\alpha_s(m_h)^{\gamma+n}$ are cancelled in the construction of the observables. We also point out how such an approach can help to control systematics in semi-leptonic decays with just large volume data. First numerical results with $N_f = 2 + 1$ and lattice spacings down to 0.039 fm are presented in [2].


title: Structural Information Guided Multimodal Pre-training for Vehicle-centric Perception

abstract: Understanding vehicles in images is important for various applications such as intelligent transportation and self-driving system. Existing vehicle-centric works typically pre-train models on large-scale classification datasets and then fine-tune them for specific downstream tasks. However, they neglect the specific characteristics of vehicle perception in different tasks and might thus lead to sub-optimal performance. To address this issue, we propose a novel vehicle-centric pre-training framework called VehicleMAE, which incorporates the structural information including the spatial structure from vehicle profile information and the semantic structure from informative high-level natural language descriptions for effective masked vehicle appearance reconstruction. To be specific, we explicitly extract the sketch lines of vehicles as a form of the spatial structure to guide vehicle reconstruction. The more comprehensive knowledge distilled from the CLIP big model based on the similarity between the paired/unpaired vehicle image-text sample is further taken into consideration to help achieve a better understanding of vehicles. A large-scale dataset is built to pre-train our model, termed Autobot1M, which contains about 1M vehicle images and 12693 text information. Extensive experiments on four vehicle-based downstream tasks fully validated the effectiveness of our VehicleMAE. The source code and pre-trained models will be released at https://github.com/Event-AHU/VehicleMAE.


title: Machine learning applications in astrophysics: Photometric redshift estimation

abstract: Machine learning has rose to become an important research tool in the past decade, its application has been expanded to almost if not all disciplines known to mankind. Particularly, the use of machine learning in astrophysics research had a humble beginning in the early 1980s, it has rose and become widely used in many sub-fields today, driven by the vast availability of free astronomical data online. In this short review, we narrow our discussion to a single topic in astrophysics - the estimation of photometric redshifts of galaxies and quasars, where we discuss its background, significance, and how machine learning has been used to improve its estimation methods in the past 20 years. We also show examples of some recent machine learning photometric redshift work done in Malaysia, affirming that machine learning is a viable and easy way a developing nation can contribute towards general research in astronomy and astrophysics.


title: Review of Hubble tension solutions with new SH0ES and SPT-3G data

abstract: We present an updated analysis of eleven cosmological models that may help reduce the Hubble tension, which now reaches the $6\sigma$ level when considering the latest SH0ES measurement versus recent CMB and BAO data, assuming $\Lambda$CDM. Specifically, we look at five classical extensions of $\Lambda$CDM (with massive neutrinos, spatial curvature, free-streaming or self-interacting relativistic relics, or dynamical dark energy) and six elaborate models featuring either a time-varying electron mass, early dark energy or some non-trivial interactions in the neutrino sector triggered by a light Majoron. We improve over previous works in several ways. We include the latest data from the South Pole Telescope as well as the most recent measurement of the Hubble rate by the SH0ES collaboration. We treat the summed neutrino mass as a free parameter in most of our models, which reveals interesting degeneracies and constraints. We define additional metrics to assess the potential of a model to reduce or even solve the Hubble tension. We validate an emulator that uses active learning to train itself during each parameter inference run for any arbitrary model. We find that the time-varying electron mass and the Majoron models are now ruled out at more than $3\sigma$. Models with a time-varying electron mass and spatial curvature or with early dark energy reduce the tension to $1.0-2.9\sigma$. Nevertheless, none of the models considered in this work is favored with enough statistical significance to become the next concordance model of Cosmology.


title: On conservation laws for polyharmonic maps

abstract: This article provides an overview on various conservation laws for polyharmonic maps between Riemannian manifolds. Besides recalling that the variation of the energy for polyharmonic maps with respect to the domain metric gives rise to the stress-energy tensor, we also show how the presence of a Killing vector field on the target manifold leads to a conservation law. For harmonic and biharmonic maps we also point out a number of applications of such conservation laws.


title: Directed Acyclic Graph Based Blockchain Systems

abstract: Blockchain technology has been revolutionizing many fields since last decade. Its true potential is not practically utilized yet. In a very short period of time, it has evolved twice - Smart contracts and Directed Acyclic Graph (DAG). DAG based blockchains currently referred to as Blockchain 3.0 solves many issues in the current conventional blockchain technologies including transaction fees, transaction approval times and scalability. In this paper, we present a comparative analysis of blockchain implementations based on DAG including IOTA, NxT, Byteball, Nano, DAGCoin, Fantom, XDAG and Caixapay. We discuss limitations of both conventional and DAG based blockchains and suggest when to prefer DAG based blockchains.


title: Calibrated One Round Federated Learning with Bayesian Inference in the Predictive Space

abstract: Federated Learning (FL) involves training a model over a dataset distributed among clients, with the constraint that each client's dataset is localized and possibly heterogeneous. In FL, small and noisy datasets are common, highlighting the need for well-calibrated models that represent the uncertainty of predictions. The closest FL techniques to achieving such goals are the Bayesian FL methods which collect parameter samples from local posteriors, and aggregate them to approximate the global posterior. To improve scalability for larger models, one common Bayesian approach is to approximate the global predictive posterior by multiplying local predictive posteriors. In this work, we demonstrate that this method gives systematically overconfident predictions, and we remedy this by proposing $\beta$-Predictive Bayes, a Bayesian FL algorithm that interpolates between a mixture and product of the predictive posteriors, using a tunable parameter $\beta$. This parameter is tuned to improve the global ensemble's calibration, before it is distilled to a single model. Our method is evaluated on a variety of regression and classification datasets to demonstrate its superiority in calibration to other baselines, even as data heterogeneity increases. Code available at https://github.com/hasanmohsin/betaPredBayesFL


title: SMILE: Multimodal Dataset for Understanding Laughter in Video with Language Models

abstract: Despite the recent advances of the artificial intelligence, building social intelligence remains a challenge. Among social signals, laughter is one of the distinctive expressions that occurs during social interactions between humans. In this work, we tackle a new challenge for machines to understand the rationale behind laughter in video, Video Laugh Reasoning. We introduce this new task to explain why people laugh in a particular video and a dataset for this task. Our proposed dataset, SMILE, comprises video clips and language descriptions of why people laugh. We propose a baseline by leveraging the reasoning capacity of large language models (LLMs) with textual video representation. Experiments show that our baseline can generate plausible explanations for laughter. We further investigate the scalability of our baseline by probing other video understanding tasks and in-the-wild videos. We release our dataset, code, and model checkpoints on https://github.com/postech-ami/SMILE-Dataset.


title: Stable compensators in parallel to stabilize arbitrary proper rational SISO plants

abstract: We consider stabilization of linear time-invariant (LTI) and single input single output (SISO) plants in the frequency domain from a fresh perspective. Compensators that are themselves stable are sometimes preferred because they make starting the system easier. Such starting remains easy if there is a stable compensator in parallel with the plant rather than in a feedback loop. In such an arrangement, we explain why it is possible to stabilize all plants whose transfer functions are proper rational functions of the Laplace variable $s$. In our proposed architecture we have (i) an optional compensator $C_s(s)$ in series with the plant $P(s)$, (ii) a necessary compensator $C_p(s)$ in parallel with $C_s(s)P(s)$, along with (iii) a feedback gain $K$ for the combined new plant $C_s(s)P(s)+C_p(s)$. We show that stabilization with stable $C_s(s)$ and $C_p(s)$ is always possible. In our proposed solution the closed-loop plant is biproper and has all its zeros in the left half plane, so there is a $K_0$ such that the plant is stable for $K>K_0$. We are not aware of prior use of parallel compensators with such a goal. Our proposed architecture works even for plants that are impossible to stabilize with stable compensators in the usual single-loop feedback architecture. Several examples are provided.


title: On the locality of local neural operator in learning fluid dynamics

abstract: This paper launches a thorough discussion on the locality of local neural operator (LNO), which is the core that enables LNO great flexibility on varied computational domains in solving transient partial differential equations (PDEs). We investigate the locality of LNO by looking into its receptive field and receptive range, carrying a main concern about how the locality acts in LNO training and applications. In a large group of LNO training experiments for learning fluid dynamics, it is found that an initial receptive range compatible with the learning task is crucial for LNO to perform well. On the one hand, an over-small receptive range is fatal and usually leads LNO to numerical oscillation; on the other hand, an over-large receptive range hinders LNO from achieving the best accuracy. We deem rules found in this paper general when applying LNO to learn and solve transient PDEs in diverse fields. Practical examples of applying the pre-trained LNOs in flow prediction are presented to confirm the findings further. Overall, with the architecture properly designed with a compatible receptive range, the pre-trained LNO shows commendable accuracy and efficiency in solving practical cases.


title: Fragility, Robustness and Antifragility in Deep Learning

abstract: We propose a systematic analysis of deep neural networks (DNNs) based on a signal processing technique for network parameter removal, in the form of synaptic filters that identifies the fragility, robustness and antifragility characteristics of DNN parameters. Our proposed analysis investigates if the DNN performance is impacted negatively, invariantly, or positively on both clean and adversarially perturbed test datasets when the DNN undergoes synaptic filtering. We define three \textit{filtering scores} for quantifying the fragility, robustness and antifragility characteristics of DNN parameters based on the performances for (i) clean dataset, (ii) adversarial dataset, and (iii) the difference in performances of clean and adversarial datasets. We validate the proposed systematic analysis on ResNet-18, ResNet-50, SqueezeNet-v1.1 and ShuffleNet V2 x1.0 network architectures for MNIST, CIFAR10 and Tiny ImageNet datasets. The filtering scores, for a given network architecture, identify network parameters that are invariant in characteristics across different datasets over learning epochs. Vice-versa, for a given dataset, the filtering scores identify the parameters that are invariant in characteristics across different network architectures. We show that our synaptic filtering method improves the test accuracy of ResNet and ShuffleNet models on adversarial datasets when only the robust and antifragile parameters are selectively retrained at any given epoch, thus demonstrating applications of the proposed strategy in improving model robustness.


title: SeeThruFinger: See and Grasp Anything with a Soft Touch

abstract: We present SeeThruFinger, a soft robotic finger with an in-finger vision for multi-modal perception, including visual perception and tactile sensing, for geometrically adaptive and real-time reactive grasping. Multi-modal perception of intrinsic and extrinsic interactions is critical in building intelligent robots that learn. Instead of adding various sensors for different modalities, a preferred solution is to integrate them into one elegant and coherent design, which is a challenging task. This study leverages the Soft Polyhedral Network design as a robotic finger, capable of omni-directional adaptation with an unobstructed view of the finger's spatial deformation from the inside. By embedding a miniature camera underneath, we achieve the visual perception of the external environment by inpainting the finger mask using E2FGV, which can be used for object detection in the downstream tasks for grasping. After contacting the objects, we use real-time object segmentation algorithms, such as XMem, to track the soft finger's spatial deformations. We also learned a Supervised Variational Autoencoder to enable tactile sensing of 6D forces and torques for reactive grasp. As a result, we achieved multi-modal perception, including visual perception and tactile sensing, and soft, adaptive object grasping within a single vision-based soft finger design compatible with multi-fingered robotic grippers.


title: Dynamic control of the Bose-Einstein-like condensation transition in scalar active matter

abstract: The dynamics of a generic class of scalar active matter exhibiting a diffusivity edge is studied in a confining potential where the amplitude is governed by a time-dependent protocol. For such non-equilibrium systems, the diffusion coefficient vanishes when the single-particle density field reaches a critical threshold, inducing a condensation transition that is formally akin to Bose-Einstein condensation. We show that this transition arises even for systems that do not reach a steady state, leading to condensation in finite time. Since the transition can be induced for a fixed effective temperature by evolving the system, we effectively show that the temporal coordinate constitutes an alternative control parameter to tune the transition characteristics. For a constant-amplitude protocol, our generalised thermodynamics reduces in the steady-state limit to earlier results. Lastly, we show numerically that for periodic modulation of the potential amplitude, the condensation transition is reentrant.


title: Coherent beam combining of optical vortices

abstract: We experimentally demonstrate the power scaling of optical vortices by the coherent beam combining, encompassing topological charges ranging from l=1 to l=5 realized on the basis of a Yb-doped fiber short-pulsed laser system. The combining efficiency varies from 83.2 to 96.9% depending on the topological charge and beam pattern quality generated by the spatial light modulators. These results open a pathway to high-intensity optical vortices with enormous potential applications in science and industry by utilizing advances in light-matter interactions.