title: Advances of Deep Learning in Protein Science: A Comprehensive Survey

abstract: Protein representation learning plays a crucial role in understanding the structure and function of proteins, which are essential biomolecules involved in various biological processes. In recent years, deep learning has emerged as a powerful tool for protein modeling due to its ability to learn complex patterns and representations from large-scale protein data. This comprehensive survey aims to provide an overview of the recent advances in deep learning techniques applied to protein science. The survey begins by introducing the developments of deep learning based protein models and emphasizes the importance of protein representation learning in drug discovery, protein engineering, and function annotation. It then delves into the fundamentals of deep learning, including convolutional neural networks, recurrent neural networks, attention models, and graph neural networks in modeling protein sequences, structures, and functions, and explores how these techniques can be used to extract meaningful features and capture intricate relationships within protein data. Next, the survey presents various applications of deep learning in the field of proteins, including protein structure prediction, protein-protein interaction prediction, protein function prediction, etc. Furthermore, it highlights the challenges and limitations of these deep learning techniques and also discusses potential solutions and future directions for overcoming these challenges. This comprehensive survey provides a valuable resource for researchers and practitioners in the field of proteins who are interested in harnessing the power of deep learning techniques. By consolidating the latest advancements and discussing potential avenues for improvement, this review contributes to the ongoing progress in protein research and paves the way for future breakthroughs in the field.


title: System Identification Using Energy-Bounded Noise Models: A Full Characterization of Chebyshev Centers and Radii

abstract: This paper studies the identification of linear time-invariant systems using noisy input-output data in a set-membership framework. It is assumed that the noise sequence belongs to a bounded set, induced by a quadratic matrix inequality, that allows for capturing various energy-bounded noise models. In this framework, the identification problem is to find an estimation for the true system so that the worst-case estimation error with respect to a given norm is minimized. For such a problem, we present closed-form solutions with respect to arbitrary unitarily invariant matrix norms. Examples of these norms include the Frobenius norm, spectral norm, nuclear norm, Schatten p-norms, and Ky Fan k-norms.


title: Direction of slip modulates the perception of slip distance and slip speed

abstract: Purpose: The purpose of this study was to investigate the psychophysical understanding of the slip stimulus. We emphasized that the perception of slip and its characteristics, such as slip distance and slip speed depend on the interaction between slip direction, slip distance as well as slip speed. Methods: We developed a novel slip induction device to simulate the artificial sense of slip. We conducted a psychophysical experiment on eight healthy subjects. The experiment was designed to evaluate the effect of slip direction on slip perception as well as on the perception of slip distance and slip speed. A series of psychophysical questions were asked at the end of the slip stimulation to record the subjective responses of the participants. The average success rate (%) was used to quantify the subject responses. Results: We demonstrated that the perception of slip is independent of slip direction however, perception of slip distance and slip speed are significantly modulated by slip direction. We also observed that a significant interaction exists between slip distance and slip speed in the upward slip direction. It was also observed that the average success rate was significantly different for various combinations of slip distance and slip speed in the upward slip direction. Conclusions: Our study clearly establishes a significant interaction between the slip direction, slip distance, and slip speed for psychophysical understanding of the perception of slip distance and slip speed.


title: Extreme wave skewing and dispersion spectra of anisotropic elastic plates

abstract: Guided wave dispersion is commonly assessed by Fourier analysis of the field along a line, resulting in frequency-wavenumber dispersion curves. In anisotropic plates, a point source can generate multiple dispersion branches pertaining to the same modal surface, which arise due to the angle between the power flux and the wave vector. We show that this phenomenon is particularly pronounced near zero-group-velocity points, entailing up to six contributions along a given direction. Stationary phase points accurately describe the measurements conducted on a monocrystalline silicon plate.


title: Looking Ahead to Avoid Being Late: Solving Hard-Constrained Traveling Salesman Problem

abstract: Many real-world problems can be formulated as a constrained Traveling Salesman Problem (TSP). However, the constraints are always complex and numerous, making the TSPs challenging to solve. When the number of complicated constraints grows, it is time-consuming for traditional heuristic algorithms to avoid illegitimate outcomes. Learning-based methods provide an alternative to solve TSPs in a soft manner, which also supports GPU acceleration to generate solutions quickly. Nevertheless, the soft manner inevitably results in difficulty solving hard-constrained problems with learning algorithms, and the conflicts between legality and optimality may substantially affect the optimality of the solution. To overcome this problem and to have an effective solution against hard constraints, we proposed a novel learning-based method that uses looking-ahead information as the feature to improve the legality of TSP with Time Windows (TSPTW) solutions. Besides, we constructed TSPTW datasets with hard constraints in order to accurately evaluate and benchmark the statistical performance of various approaches, which can serve the community for future research. With comprehensive experiments on diverse datasets, MUSLA outperforms existing baselines and shows generalizability potential.


title: Ducci on $\mathbb{Z}_m^n$ and the Maximum Length for $n$ Odd

abstract: Define the Ducci function $D: \mathbb{Z}_m^n \to \mathbb{Z}_m^n$ so $D(x_1,x_2, ...,x_n)=(x_1+x_2 \;\text{mod} \; m, x_2+x_3 \; \text{mod} \; m, ..., x_n+x_1 \; \text{mod} \; m)$. In this paper, we will prove that for $n$ odd and $m=2^lm_1$ where $m_1$ is odd, then the largest the length of a tuple can be is $l$ and $K(\mathbb{Z}_m^n)=\{(x_1, x_2, ..., x_n) \in \mathbb{Z}_m^n \; \mid \; x_1+x_2+ \cdots +x_n \equiv 0 \; \text{mod} \; 2^l\}$.


title: Quantum tomography of molecules using ultrafast electron diffraction

abstract: We propose a quantum tomography (QT) approach to retrieve the temporally evolving reduced density matrix in elecotronic state basis, where the populations and coherence between ground state and excited state are reconstructed from the ultrafast electron diffraction signal. In order to showcase the capability of the proposed QT approach, we simulate the nuclear wavepacket dynamics and ultrafast electron diffraction of photoexcited pyrrole molecules using ab initio quantum chemical CASSCF method. From simulated time-resolved diffraction data, we retrieve the evolving density matrix in a crude diabatic representation basis and reveal the symmetry of the excited pyrrole wavepacket. Our QT approach opens the route to make quantum version of "molecular movie" that covers the electronic degree of freedom, and equips ultrafast electron diffraction with the power to reveal the coherence between electronic states, relaxation and dynamics of population transfer.


title: GAN-based Massive MIMO Channel Model Trained on Measured Data

abstract: Wireless channel models are a commonly used tool for the development of wireless telecommunication systems and standards. The currently prevailing geometry-based stochastic channel models (GSCMs) were manually specified for certain environments in a manual process requiring extensive domain knowledge, on the basis of channel measurement campaigns. By taking into account the stochastic distribution of certain channel properties like Rician k-factor, path loss or delay spread, they model the distribution of channel realizations. Instead of this manual process, a generative machine learning model like a generative adversarial network (GAN) may be used to automatically learn the distribution of channel statistics. Subsequently, the GAN's generator may be viewed as a channel model that can replace conventional stochastic or raytracer-based models. We propose a GAN architecture for a massive MIMO channel model, and train it on measurement data produced by a distributed massive MIMO channel sounder.


title: Revisiting Theoretical Guarantees of Direct-Search Methods

abstract: Optimizing a function without using derivatives is a challenging paradigm, that precludes from using classical algorithms from nonlinear optimization and may thus seem intractable other than by using heuristics. However, the field of derivative-free optimization has succeeded in producing algorithms that do not rely on derivatives and yet are endowed with convergence guarantees. One class of such methods, called direct search, is particularly popular thanks to its simplicity of implementation, even though its theoretical underpinnings are not always easy to grasp. In this work, we survey contemporary direct-search algorithms from a theoretical viewpoint, with the aim of highlighting the key theoretical features of these methods. Our study goes beyond the classical, textbook cases and tackles the presence of nonsmoothness, noise, and constraints in the problem at hand. In addition to reviewing classical results in the field, we provide new perspectives on existing results, as well as novel proofs that illustrate the versatility of direct-search schemes.


title: Modularity in Argyres-Douglas Theories with $a=c$

abstract: We consider a family of Argyres-Douglas theories, which are 4D $\mathcal N=2$ strongly coupled superconformal field theories (SCFTs) but share many features with 4D $\mathcal N=4 $ super-Yang-Mills theories. In particular, the two central charges of these theories are the same, namely $a=c$. We derive a simple and illuminating formula for the Schur index of these theories, which factorizes into the product of a Casimir term and a term referred to as the Schur partition function. While the former is controlled by the anomaly, the latter is identified with the vacuum character of the corresponding chiral algebra and is expected to satisfy the modular linear differential equation. Our simple expression for the Schur partition function, which can be regarded as the generalization of MacMahon's generalized sum-of-divisor function, allows one to numerically compute the series expansions efficiently, and furthermore find the corresponding modular linear differential equation. In a special case where the chiral algebra is known, we are able to derive the corresponding modular linear differential equation using Zhu's recursion relation. We further study the solutions to the modular linear differential equations and discuss their modular transformations. As an application, we study the high temperature limit or the Cardy-like limit of the Schur index using its simple expression and modular properties, thus shedding light on the 1/4-BPS microstates of genuine $\mathcal N=2$ SCFTs with $a=c$ and their dual quantum gravity via the AdS/CFT correspondence.


title: A Characterization of Weighted Homogeneous Polynomials via the Discriminant

abstract: If a bivariate polynomial is weighted homogeneous, then its discriminant is a monomial. Over fields of characteristic $0$, we show that if one adds another simple condition, this becomes an equivalence. We also give a third equivalent condition which is stated geometrically.


title: Fine-tuning a Multiple Instance Learning Feature Extractor with Masked Context Modelling and Knowledge Distillation

abstract: The first step in Multiple Instance Learning (MIL) algorithms for Whole Slide Image (WSI) classification consists of tiling the input image into smaller patches and computing their feature vectors produced by a pre-trained feature extractor model. Feature extractor models that were pre-trained with supervision on ImageNet have proven to transfer well to this domain, however, this pre-training task does not take into account that visual information in neighboring patches is highly correlated. Based on this observation, we propose to increase downstream MIL classification by fine-tuning the feature extractor model using \textit{Masked Context Modelling with Knowledge Distillation}. In this task, the feature extractor model is fine-tuned by predicting masked patches in a bigger context window. Since reconstructing the input image would require a powerful image generation model, and our goal is not to generate realistically looking image patches, we predict instead the feature vectors produced by a larger teacher network. A single epoch of the proposed task suffices to increase the downstream performance of the feature-extractor model when used in a MIL scenario, even capable of outperforming the downstream performance of the teacher model, while being considerably smaller and requiring a fraction of its compute.


title: ChatASU: Evoking LLM's Reflexion to Truly Understand Aspect Sentiment in Dialogues

abstract: Aspect Sentiment Understanding (ASU) in interactive scenarios (e.g., Question-Answering and Dialogue) has attracted ever-more interest in recent years and achieved important progresses. However, existing studies on interactive ASU largely ignore the coreference issue for opinion targets (i.e., aspects), while this phenomenon is ubiquitous in interactive scenarios especially dialogues, limiting the ASU performance. Recently, large language models (LLMs) shows the powerful ability to integrate various NLP tasks with the chat paradigm. In this way, this paper proposes a new Chat-based Aspect Sentiment Understanding (ChatASU) task, aiming to explore LLMs' ability in understanding aspect sentiments in dialogue scenarios. Particularly, this ChatASU task introduces a sub-task, i.e., Aspect Chain Reasoning (ACR) task, to address the aspect coreference issue. On this basis, we propose a Trusted Self-reflexion Approach (TSA) with ChatGLM as backbone to ChatASU. Specifically, this TSA treats the ACR task as an auxiliary task to boost the performance of the primary ASU task, and further integrates trusted learning into reflexion mechanisms to alleviate the LLMs-intrinsic factual hallucination problem in TSA. Furthermore, a high-quality ChatASU dataset is annotated to evaluate TSA, and extensive experiments show that our proposed TSA can significantly outperform several state-of-the-art baselines, justifying the effectiveness of TSA to ChatASU and the importance of considering the coreference and hallucination issues in ChatASU.


title: DiffSF: Diffusion Models for Scene Flow Estimation

abstract: Scene flow estimation is an essential ingredient for a variety of real-world applications, especially for autonomous agents, such as self-driving cars and robots. While recent scene flow estimation approaches achieve a reasonable accuracy, their applicability to real-world systems additionally benefits from a reliability measure. Aiming at improving accuracy while additionally providing an estimate for uncertainty, we propose DiffSF that combines transformer-based scene flow estimation with denoising diffusion models. In the diffusion process, the ground truth scene flow vector field is gradually perturbed by adding Gaussian noise. In the reverse process, starting from randomly sampled Gaussian noise, the scene flow vector field prediction is recovered by conditioning on a source and a target point cloud. We show that the diffusion process greatly increases the robustness of predictions compared to prior approaches resulting in state-of-the-art performance on standard scene flow estimation benchmarks. Moreover, by sampling multiple times with different initial states, the denoising process predicts multiple hypotheses, which enables measuring the output uncertainty, allowing our approach to detect a majority of the inaccurate predictions. The code is available at https://github.com/ZhangYushan3/DiffSF.


title: Swift monitoring of GK Persei during the 2018 dwarf nova outburst

abstract: The old nova and intermediate polar (IP) GK Persei underwent one of its recurrent dwarf nova (DN) outbursts in 2018. We proposed monitoring it in UV and X-rays with the Neil Gehrels Swift Observatory, starting less than six days after the eruption, until 16 days after the eruption ended. For the first time we could follow the decay to minimum light UV and X-rays. We present the timing and spectral analysis, comparing the results with the previous outbursts and with the quiescent status. We confirm the spin modulation in X-rays with a period 351.325(9) s, only in the 2-10 keV range. The period was not detected in the 0.3-2 keV range and in the UV band, suggesting that the soft portion of the X-ray spectrum in GK Per does not originate near the poles, but in a wind or circumstellar material. The amplitude of the modulation was less prominent than in 2015, a fact that seems correlated with a lower average mass accretion rate. The spectral fits are consistent with a mass accretion rate increasing by a factor of 2 from rise to maximum and decreasing during the return to minimum, following the trend of the modulation amplitude. The maximum plasma temperature is higher than the Swift XRT energy range of 0.3-10 keV, thus it is not well constrained, but our spectral fits indicate that it may have varied irregularly during the outburst.


title: OccFusion: Depth Estimation Free Multi-sensor Fusion for 3D Occupancy Prediction

abstract: 3D occupancy prediction based on multi-sensor fusion, crucial for a reliable autonomous driving system, enables fine-grained understanding of 3D scenes. Previous fusion-based 3D occupancy predictions relied on depth estimation for processing 2D image features. However, depth estimation is an ill-posed problem, hindering the accuracy and robustness of these methods. Furthermore, fine-grained occupancy prediction demands extensive computational resources. We introduce OccFusion, a multi-modal fusion method free from depth estimation, and a corresponding point cloud sampling algorithm for dense integration of image features. Building on this, we propose an active training method and an active coarse to fine pipeline, enabling the model to adaptively learn more from complex samples and optimize predictions specifically for challenging areas such as small or overlapping objects. The active methods we propose can be naturally extended to any occupancy prediction model. Experiments on the OpenOccupancy benchmark show our method surpasses existing state-of-the-art (SOTA) multi-modal methods in IoU across all categories. Additionally, our model is more efficient during both the training and inference phases, requiring far fewer computational resources. Comprehensive ablation studies demonstrate the effectiveness of our proposed techniques.


title: Consecutive Model Editing with Batch alongside HooK Layers

abstract: As the typical retraining paradigm is unacceptably time- and resource-consuming, researchers are turning to model editing in order to seek an effective, consecutive, and batch-supportive way to edit the model behavior directly. Despite all these practical expectations, existing model editing methods fail to realize all of them. Furthermore, the memory demands for such succession-supportive model editing approaches tend to be prohibitive, frequently necessitating an external memory that grows incrementally over time. To cope with these challenges, we propose COMEBA-HK, a model editing method that is both consecutive and batch-supportive. COMEBA-HK is memory-friendly as it only needs a small amount of it to store several hook layers with updated weights. Experimental results demonstrate the superiority of our method over other batch-supportive model editing methods under both single-round and consecutive batch editing scenarios. Extensive analyses of COMEBA-HK have been conducted to verify the stability of our method over 1) the number of consecutive steps and 2) the number of editing instance.


title: Causality and extremes

abstract: In this work, we summarize the state-of-the-art methods in causal inference for extremes. In a non-exhaustive way, we start by describing an extremal approach to quantile treatment effect where the treatment has an impact on the tail of the outcome. Then, we delve into two primary causal structures for extremes, offering in-depth insights into their identifiability. Additionally, we discuss causal structure learning in relation to these two models as well as in a model-agnostic framework. To illustrate the practicality of the approaches, we apply and compare these different methods using a Seine network dataset. This work concludes with a summary and outlines potential directions for future research.


title: Degradation Resilient LiDAR-Radar-Inertial Odometry

abstract: Enabling autonomous robots to operate robustly in challenging environments is necessary in a future with increased autonomy. For many autonomous systems, estimation and odometry remains a single point of failure, from which it can often be difficult, if not impossible, to recover. As such robust odometry solutions are of key importance. In this work a method for tightly-coupled LiDAR-Radar-Inertial fusion for odometry is proposed, enabling the mitigation of the effects of LiDAR degeneracy by leveraging a complementary perception modality while preserving the accuracy of LiDAR in well-conditioned environments. The proposed approach combines modalities in a factor graph-based windowed smoother with sensor information-specific factor formulations which enable, in the case of degeneracy, partial information to be conveyed to the graph along the non-degenerate axes. The proposed method is evaluated in real-world tests on a flying robot experiencing degraded conditions including geometric self-similarity as well as obscurant occlusion. For the benefit of the community we release the datasets presented: https://github.com/ntnu-arl/lidar_degeneracy_datasets.


title: Entropic van der Corput's Difference Theorem

abstract: We prove an entropy version of van der Corput's difference theorem: the entropy of a sequence is equal to the entropy of its differences. This reveals a potential correspondence between the theory of uniform distribution mod 1 and entropy. As applications, we establish the corresponding entropy versions for several other results on uniform distribution.


title: WatChat: Explaining perplexing programs by debugging mental models

abstract: Often, a good explanation for a program's unexpected behavior is a bug in the programmer's code. But sometimes, an even better explanation is a bug in the programmer's mental model of the language they are using. Instead of merely debugging our current code ("giving the programmer a fish"), what if our tools could directly debug our mental models ("teaching the programmer to fish")? In this paper, we apply ideas from computational cognitive science to do exactly that. Given a perplexing program, we use program synthesis techniques to automatically infer potential misconceptions that might cause the user to be surprised by the program's behavior. By analyzing these misconceptions, we provide succinct, useful explanations of the program's behavior. Our methods can even be inverted to synthesize pedagogical example programs for diagnosing and correcting misconceptions in students.


title: Ultimate Performance of Biomedical Ablation

abstract: Microwave ablation is a therapeutic procedure to eliminate abnormal tissue within a body selectively. There are two types of ablations; the thermal one aims to raise the temperature at the target, while the non-thermal one induces a temporarily high electric field at the target to disrupt cellular membrane integrity. This work identifies the fundamental bounds of the efficiency for each type of ablation and the sources to achieve them. For both types, the bounds exceed the performance of existing solutions by tenfold, showing a large room for improvement. Finally, the optimal source for thermal ablation is physically realized with an 11 x 11 dipole array, the performance of which closely approaches the bound.


title: Estimating time-varying exposure effects through continuous-time modelling in Mendelian randomization

abstract: Mendelian randomization is an instrumental variable method that utilizes genetic information to investigate the causal effect of a modifiable exposure on an outcome. In most cases, the exposure changes over time. Understanding the time-varying causal effect of the exposure can yield detailed insights into mechanistic effects and the potential impact of public health interventions. Recently, a growing number of Mendelian randomization studies have attempted to explore time-varying causal effects. However, the proposed approaches oversimplify temporal information and rely on overly restrictive structural assumptions, limiting their reliability in addressing time-varying causal problems. This paper considers a novel approach to estimate time-varying effects through continuous-time modelling by combining functional principal component analysis and weak-instrument-robust techniques. Our method effectively utilizes available data without making strong structural assumptions and can be applied in general settings where the exposure measurements occur at different timepoints for different individuals. We demonstrate through simulations that our proposed method performs well in estimating time-varying effects and provides reliable inference results when the time-varying effect form is correctly specified. The method could theoretically be used to estimate arbitrarily complex time-varying effects. However, there is a trade-off between model complexity and instrument strength. Estimating complex time-varying effects requires instruments that are unrealistically strong. We illustrate the application of this method in a case study examining the time-varying effects of systolic blood pressure on urea levels.


title: A scalable method to model large suspensions of colloidal phoretic particles with arbitrary shapes

abstract: Phoretic colloids self-propel thanks to surface flows generated in response to surface gradients (thermal, electrical, or chemical), that are self-induced and/or generated by other particles. Here we present a scalable and versatile framework to model chemical and hydrodynamic interactions in large suspensions of arbitrarily shaped phoretic particles, accounting for thermal fluctuations at all Damkholer numbers. Our approach, inspired by the Boundary Element Method (BEM), employs second-layer formulations, regularised kernels and a grid optimisation strategy to solve the coupled Laplace-Stokes equations with reasonable accuracy at a fraction of the computational cost associated with BEM. As demonstrated by our large-scale simulations, the capabilities of our method enable the exploration of new physical phenomena that, to our knowledge, have not been previously addressed by numerical simulations.


title: Explaining Pre-Trained Language Models with Attribution Scores: An Analysis in Low-Resource Settings

abstract: Attribution scores indicate the importance of different input parts and can, thus, explain model behaviour. Currently, prompt-based models are gaining popularity, i.a., due to their easier adaptability in low-resource settings. However, the quality of attribution scores extracted from prompt-based models has not been investigated yet. In this work, we address this topic by analyzing attribution scores extracted from prompt-based models w.r.t. plausibility and faithfulness and comparing them with attribution scores extracted from fine-tuned models and large language models. In contrast to previous work, we introduce training size as another dimension into the analysis. We find that using the prompting paradigm (with either encoder-based or decoder-based models) yields more plausible explanations than fine-tuning the models in low-resource settings and Shapley Value Sampling consistently outperforms attention and Integrated Gradients in terms of leading to more plausible and faithful explanations.


title: Manin triples and bialgebras of Left-Alia algebras associated to invariant theory

abstract: A left-Alia algebra is a vector space together with a bilinear map satisfying symmetric Jocobi identity. Motivated by invariant theory, we first construct a class of left-Alia algebras induced by twisted derivations. Then, we introduce the notion of Manin triples and bialgebras of left-Alia algebras. Via specific matched pairs of left-Alia algebras, we figure out the equivalence between Manin triples and bialgebras of left-Alia algebras.


title: Embedded Deployment of Semantic Segmentation in Medicine through Low-Resolution Inputs

abstract: When deploying neural networks in real-life situations, the size and computational effort are often the limiting factors. This is especially true in environments where big, expensive hardware is not affordable, like in embedded medical devices, where budgets are often tight. State-of-the-art proposed multiple different lightweight solutions for such use cases, mostly by changing the base model architecture, not taking the input and output resolution into consideration. In this paper, we propose our architecture that takes advantage of the fact that in hardware-limited environments, we often refrain from using the highest available input resolutions to guarantee a higher throughput. Although using lower-resolution input leads to a significant reduction in computing and memory requirements, it may also incur reduced prediction quality. Our architecture addresses this problem by exploiting the fact that we can still utilize high-resolution ground-truths in training. The proposed model inputs lower-resolution images and high-resolution ground truths, which can improve the prediction quality by 5.5% while adding less than 200 parameters to the model. %reducing the frames per second only from 25 to 20. We conduct an extensive analysis to illustrate that our architecture enhances existing state-of-the-art frameworks for lightweight semantic segmentation of cancer in MRI images. We also tested the deployment speed of state-of-the-art lightweight networks and our architecture on Nvidia's Jetson Nano to emulate deployment in resource-constrained embedded scenarios.


title: Theoretical estimation of stimulated and spontaneous Raman signals in Raman microscopy

abstract: As a highly sensitive vibrational imaging method, stimulated Raman scattering (SRS) microscopy is finding various applications, while its theoretical treatment seems still under development. Here we present a theoretical estimation of spontaneous Raman signal and SRS signal from Raman scattering cross section, irrespective of the numerical aperture of the objective lens. We confirm a reasonable agreement between our theory with a recently proposed treatment based on the stimulated Raman scattering cross section. Furthermore, we point out that the acceleration factor of SRS can be interpreted as the number of Stokes photons in the vibrational coherence time.


title: A study of the Kuramoto model for synchronization phenomena based on degenerate Kolmogorov-Fokker-Planck equations

abstract: We study a nonlinear partial differential equation that arises when introducing inertial effects in the Kuramoto model. Based on the known theory of degenerate Kolmogorov operators, we prove existence, uniqueness and a priori estimates of the solution to the relevant Cauchy problem. Moreover, a stable numerical operator, which is consistent with the degenerate Kolmogorov operator, is introduced in order to produce numerical solutions. Finally, numerical experiments show how the synchronization phenomena depend on the parameters of the Kuramoto model with inertia.


title: Disentangling the Timescales of a Complex System: A Bayesian Approach to Temporal Network Analysis

abstract: Changes in the timescales at which complex systems evolve are essential to predicting critical transitions and catastrophic failures. Disentangling the timescales of the dynamics governing complex systems remains a key challenge. With this study, we introduce an integrated Bayesian framework based on temporal network models to address this challenge. We focus on two methodologies: change point detection for identifying shifts in system dynamics, and a spectrum analysis for inferring the distribution of timescales. Applied to synthetic and empirical datasets, these methologies robustly identify critical transitions and comprehensively map the dominant and subsidiaries timescales in complex systems. This dual approach offers a powerful tool for analyzing temporal networks, significantly enhancing our understanding of dynamic behaviors in complex systems.

categories: stat.ME cs.SI math.PR physics.data-an physics.soc-ph


title: Federated Learning Method for Preserving Privacy in Face Recognition System

abstract: The state-of-the-art face recognition systems are typically trained on a single computer, utilizing extensive image datasets collected from various number of users. However, these datasets often contain sensitive personal information that users may hesitate to disclose. To address potential privacy concerns, we explore the application of federated learning, both with and without secure aggregators, in the context of both supervised and unsupervised face recognition systems. Federated learning facilitates the training of a shared model without necessitating the sharing of individual private data, achieving this by training models on decentralized edge devices housing the data. In our proposed system, each edge device independently trains its own model, which is subsequently transmitted either to a secure aggregator or directly to the central server. To introduce diverse data without the need for data transmission, we employ generative adversarial networks to generate imposter data at the edge. Following this, the secure aggregator or central server combines these individual models to construct a global model, which is then relayed back to the edge devices. Experimental findings based on the CelebA datasets reveal that employing federated learning in both supervised and unsupervised face recognition systems offers dual benefits. Firstly, it safeguards privacy since the original data remains on the edge devices. Secondly, the experimental results demonstrate that the aggregated model yields nearly identical performance compared to the individual models, particularly when the federated model does not utilize a secure aggregator. Hence, our results shed light on the practical challenges associated with privacy-preserving face image training, particularly in terms of the balance between privacy and accuracy.


title: An implicit algorithm for simulating the dynamics of small dust grains with smoothed particle hydrodynamics

abstract: We present an implicit method for solving the diffusion equation for the evolution of the dust fraction in the terminal velocity approximation using dust-as-mixture smoothed particle hydrodynamics (SPH). The numerical scheme involves casting the dust diffusion equation into implicit form, rearranging into its resolvent cubic equation and solving analytically. This method is relevant for small grains that are tightly coupled to the gas, such as sub-micron dust grains in the interstellar medium or millimetre-sized dust grains in protoplanetary discs. The method avoids problems with the variable used to evolve the dust fraction becoming negative when evolved explicitly and is fast and accurate, avoiding the need for dust stopping time limiters and significantly reducing computational expense. Whilst this method is an improvement over using the explicit terminal velocity approximation method, as with any dust-as-mixture method it still fails to give accurate solutions in the limit of large (weakly coupled) grains.


title: VLM-PL: Advanced Pseudo Labeling Approach for Class Incremental Object Detection via Vision-Language Model

abstract: In the field of Class Incremental Object Detection (CIOD), creating models that can continuously learn like humans is a major challenge. Pseudo-labeling methods, although initially powerful, struggle with multi-scenario incremental learning due to their tendency to forget past knowledge. To overcome this, we introduce a new approach called Vision-Language Model assisted Pseudo-Labeling (VLM-PL). This technique uses Vision-Language Model (VLM) to verify the correctness of pseudo ground-truths (GTs) without requiring additional model training. VLM-PL starts by deriving pseudo GTs from a pre-trained detector. Then, we generate custom queries for each pseudo GT using carefully designed prompt templates that combine image and text features. This allows the VLM to classify the correctness through its responses. Furthermore, VLM-PL integrates refined pseudo and real GTs from upcoming training, effectively combining new and old knowledge. Extensive experiments conducted on the Pascal VOC and MS COCO datasets not only highlight VLM-PL's exceptional performance in multi-scenario but also illuminate its effectiveness in dual-scenario by achieving state-of-the-art results in both.


title: Attempting to Prove the Riemann Hypothesis through the Reflection Formula

abstract: The Riemann Hypothesis, originally proposed by the eminent mathematician Bernard Riemann in 1859, remains one of the most profound challenges in number theory. It posits that all non-trivial zeros of the Riemann zeta function {\zeta}(s) are concentrated precisely along the critical line where the real part equals 1/2. In this paper, our aim is to present an attempt to prove this conjecture. Our approach relies on the use of the reflection formula. By applying this tool with precision and insight, we can conclusively establish that {\xi}(s)^2 (Riemann's {\xi}-function) is valid only when Re(s)=1/2. As a direct consequence of this determination, we can assert that every zero of both {\xi}(s)^2 and {\xi}(s) has a real part equal to 1/2. This, in turn, leads us to the tentative conclusion that the real part of all non-trivial zeros of the zeta function is consistently 1/2.


title: Higher Contiguity Distance

abstract: In this paper, we introduce the higher analogues of contiguity distance and its relations with simplicial Lusternik-Schnirelmann category and discrete topological complexity. Also we study the effects of geometric realisation and barycentric subdivision in the sense that how the geometric realisation of the simplicial maps and the induced simplicial maps on barycentric subdivisions affects higher contiguity distance.


title: Extended Sobolev scale for vector bundles, and its applications

abstract: We introduce an extended Sobolev scale for vector bundles over smooth closed manifolds and investigate its interpolation properties. This scale is built on the base of the inner product H\"ormander spaces whose order of regularity is given by an arbitrary positive function OR-varying at infinity in the sense of Avakumovi\'c. We prove that this scale is obtained by the interpolation with a function parameter between inner product Sobolev spaces, is closed with respect to the interpolation with a function parameter, and consists of all Hilbert spaces that are interpolation spaces between inner product Sobolev spaces. We also show that the spaces belonging to the scale introduced does not depend (up to equivalence of norms) on the choice of local charts on manifold and local trivializations of the bundle. Moreover, we prove embedding theorems and a duality theorem for this scale. We consider an elliptic pseudodifferential operators acting between vector bundles of the same rank on the extended Sobolev scale. We prove that this operator is bounded and Fredholm on pairs of appropriate H\"ormander spaces. An a priori estimate is established for the solutions and their local regularity is investigated. We also find new sufficient conditions for the solutions to have continuous derivatives of a given order.


title: Formal Verification of Unknown Stochastic Systems via Non-parametric Estimation

abstract: A novel data-driven method for formal verification is proposed to study complex systems operating in safety-critical domains. The proposed approach is able to formally verify discrete-time stochastic dynamical systems against temporal logic specifications only using observation samples and without the knowledge of the model, and provide a probabilistic guarantee on the satisfaction of the specification. We first propose the theoretical results for using non-parametric estimation to estimate an asymptotic upper bound for the \emph{Lipschitz constant} of the stochastic system, which can determine a finite abstraction of the system. Our results prove that the asymptotic convergence rate of the estimation is $O(n^{-\frac{1}{3+d}})$, where $d$ is the dimension of the system and $n$ is the data scale. We then construct interval Markov decision processes using two different data-driven methods, namely non-parametric estimation and empirical estimation of transition probabilities, to perform formal verification against a given temporal logic specification. Multiple case studies are presented to validate the effectiveness of the proposed methods.


title: Multiple Instance Learning with random sampling for Whole Slide Image Classification

abstract: In computational pathology, random sampling of patches during training of Multiple Instance Learning (MIL) methods is computationally efficient and serves as a regularization strategy. Despite its promising benefits, questions concerning performance trends for varying sample sizes and its influence on model interpretability remain. Addressing these, we reach an optimal performance enhancement of 1.7% using thirty percent of patches on the CAMELYON16 dataset, and 3.7% with only eight samples on the TUPAC16 dataset. We also find interpretability effects are strongly dataset-dependent, with interpretability impacted on CAMELYON16, while remaining unaffected on TUPAC16. This reinforces that both the performance and interpretability relationships with sampling are closely task-specific. End-to-end training with 1024 samples reveals improvements across both datasets compared to pre-extracted features, further highlighting the potential of this efficient approach.


title: Enhancing Plausibility Evaluation for Generated Designs with Denoising Autoencoder

abstract: A great interest has arisen in using Deep Generative Models (DGM) for generative design. When assessing the quality of the generated designs, human designers focus more on structural plausibility, e.g., no missing component, rather than visual artifacts, e.g., noises in the images. Meanwhile, commonly used metrics such as Fr\'echet Inception Distance (FID) may not evaluate accurately as they tend to penalize visual artifacts instead of structural implausibility. As such, FID might not be suitable to assess the performance of DGMs for a generative design task. In this work, we propose to encode the input designs with a simple Denoising Autoencoder (DAE) and measure the distribution distance in the latent space thereof. We experimentally test our DAE-based metrics with FID and other state-of-the-art metrics on three data sets: compared to FID and some more recent works, e.g., FD$_\text{DINO-V2}$ and topology distance, DAE-based metrics can effectively detect implausible structures and are more consistent with structural inspection by human experts.


title: Hybridized Convolutional Neural Networks and Long Short-Term Memory for Improved Alzheimer's Disease Diagnosis from MRI Scans

abstract: Brain-related diseases are more sensitive than other diseases due to several factors, including the complexity of surgical procedures, high costs, and other challenges. Alzheimer's disease is a common brain disorder that causes memory loss and the shrinking of brain cells. Early detection is critical for providing proper treatment to patients. However, identifying Alzheimer's at an early stage using manual scanning of CT or MRI scans is challenging. Therefore, researchers have delved into the exploration of computer-aided systems, employing Machine Learning and Deep Learning methodologies, which entail the training of datasets to detect Alzheimer's disease. This study aims to present a hybrid model that combines a CNN model's feature extraction capabilities with an LSTM model's detection capabilities. This study has applied the transfer learning called VGG16 in the hybrid model to extract features from MRI images. The LSTM detects features between the convolution layer and the fully connected layer. The output layer of the fully connected layer uses the softmax function. The training of the hybrid model involved utilizing the ADNI dataset. The trial findings revealed that the model achieved a level of accuracy of 98.8%, a sensitivity rate of 100%, and a specificity rate of 76%. The proposed hybrid model outperforms its contemporary CNN counterparts, showcasing a superior performance.


title: Using Gaussian Processes to detect AGN flares

abstract: A key feature of active galactic nuclei (AGN) is their variability across all wavelengths. Typically, AGN vary by a few tenths of a magnitude or more over periods lasting from hours to years. By contrast, extreme variability of AGN -- large luminosity changes that are a significant departure from the baseline variability -- are known as AGN flares. These events are rare and their timescales poorly constrained, with most of the literature focusing on individual events. It has been suggested that extreme AGN variability including flares can provide insights into the accretion processes in the disk. With surveys such as the Legacy Survey of Space and Time (LSST) promising millions of transient detections per night in the coming decade, there is a need for fast and efficient classification of AGN flares. The problem with the systematic detection of AGN flares is the requirement to detect them against a stochastically variable baseline; the ability to define a signal as a significant departure from the ever-present variability is a statistical challenge. Recently, Gaussian Processes (GPs) have revolutionised the analysis of time-series data in many areas of astronomical research. They have, however, seen limited uptake within the field of transient detection and classification. Here we investigate the efficacy of Gaussian Processes to detect AGN flares in both simulated and real optical light curves. We show that GP analysis can successfully detect AGN flares with a false-positive rate of less than seven per cent, and we present examples of AGN light curves that show extreme variability.


title: Representation-graded Bredon homology of elementary abelian 2-groups

abstract: We calculate the representation-graded Bredon homology rings of all elementary abelian 2-groups with coefficients in the constant mod-2 Mackey functor. We show that these rings are domains, and we exhibit minimal presentations as quotients of the polynomial algebra on the pre-Euler and inverse Thom classes of all nontrivial characters, subject to an explicit finite list of relations arising from orientability properties. Two corollaries of our presentation are the calculation, originally due to Holler and Kriz, of the geometric fixed point rings, and a strengthening of a calculation of Balmer and Gallauer of the localized twisted cohomology ring.


title: Modeling of progressive high-cycle fatigue in composite laminates accounting for local stress ratios

abstract: A numerical framework for simulating progressive failure under high-cycle fatigue loading is validated against experiments of composite quasi-isotropic open-hole laminates. Transverse matrix cracking and delamination are modeled with a mixed-mode fatigue cohesive zone model, covering crack initiation and propagation. Furthermore, XFEM is used for simulating transverse matrix cracks and splits at arbitrary locations. An adaptive cycle jump approach is employed for efficiently simulating high-cycle fatigue while accounting for local stress ratio variations in the presence of thermal residual stresses. The cycle jump scheme is integrated in the XFEM framework, where the local stress ratio is used to determine the insertion of cracks and to propagate fatigue damage. The fatigue cohesive zone model is based on S-N curves and requires static material properties and only a few fatigue parameters, calibrated on simple fracture testing specimens. The simulations demonstrate a good correspondence with experiments in terms of fatigue life and damage evolution.


title: Optimized detection modality for double resonance alignment based optical magnetometer

abstract: In this work, we present a comprehensive and comparative analysis of two detection modalities, i.e., polarization rotation and absorption measurement of light, for a double resonance alignment based optical magnetometer (DRAM). We derive algebraic expressions for magnetometry signals based on multipole moments description. Experiments are carried out using a room-temperature paraffin-coated Caesium vapour cell and measuring either the polarization rotation or absorption of the transmitted laser light. A detailed experimental analysis of the resonance spectra is performed to validate the theoretical findings for various input parameters. The results signify the use of a single isotropic relaxation rate thus simplifying the data analysis for optimization of the DRAM. The sensitivity measurements are performed and reveal that the polarization rotation detection mode yields larger signals and better sensitivity than absorption measurement of light.


title: Variational Inference of Parameters in Opinion Dynamics Models

abstract: Despite the frequent use of agent-based models (ABMs) for studying social phenomena, parameter estimation remains a challenge, often relying on costly simulation-based heuristics. This work uses variational inference to estimate the parameters of an opinion dynamics ABM, by transforming the estimation problem into an optimization task that can be solved directly. Our proposal relies on probabilistic generative ABMs (PGABMs): we start by synthesizing a probabilistic generative model from the ABM rules. Then, we transform the inference process into an optimization problem suitable for automatic differentiation. In particular, we use the Gumbel-Softmax reparameterization for categorical agent attributes and stochastic variational inference for parameter estimation. Furthermore, we explore the trade-offs of using variational distributions with different complexity: normal distributions and normalizing flows. We validate our method on a bounded confidence model with agent roles (leaders and followers). Our approach estimates both macroscopic (bounded confidence intervals and backfire thresholds) and microscopic ($200$ categorical, agent-level roles) more accurately than simulation-based and MCMC methods. Consequently, our technique enables experts to tune and validate their ABMs against real-world observations, thus providing insights into human behavior in social systems via data-driven analysis.


title: Applying Non-negative Matrix Factorization with Covariates to the Longitudinal Data as Growth Curve Model

abstract: Using Non-negative Matrix Factorization (NMF), the observed matrix can be approximated by the product of the basis and coefficient matrices. Moreover, if the coefficient vectors are explained by the covariates for each individual, the coefficient matrix can be written as the product of the parameter matrix and the covariate matrix, and additionally described in the framework of Non-negative Matrix tri-Factorization (tri-NMF) with covariates. Consequently, this is equal to the mean structure of the Growth Curve Model (GCM). The difference is that the basis matrix for GCM is given by the analyst, whereas that for NMF with covariates is unknown and optimized. In this study, we applied NMF with covariance to longitudinal data and compared it with GCM. We have also published an R package that implements this method, and we show how to use it through examples of data analyses including longitudinal measurement, spatiotemporal data and text data. In particular, we demonstrate the usefulness of Gaussian kernel functions as covariates.


title: Path eccentricity of $k$-AT-free graphs and application on graphs with the consecutive ones property

abstract: The central path problem is a variation on the single facility location problem. The aim is to find, in a given connected graph $G$, a path $P$ minimizing its eccentricity, which is the maximal distance from $P$ to any vertex of the graph $G$. The path eccentricity of $G$ is the minimal eccentricity achievable over all paths in $G$. In this article we consider the path eccentricity of the class of the $k$-AT-free graphs. They are graphs in which any set of three vertices contains a pair for which every path between them uses at least one vertex of the closed neighborhood at distance $k$ of the third. We prove that they have path eccentricity bounded by $k$. Moreover, we answer a question of G\'omez and Guti\'errez asking if there is a relation between path eccentricity and the consecutive ones property. The latter is the property for a binary matrix to admit a permutation of the rows placing the 1's consecutively on the columns. It was already known that graphs whose adjacency matrices have the consecutive ones property have path eccentricity at most 1, and that the same remains true when the augmented adjacency matrices (with ones on the diagonal) has the consecutive ones property. We generalize these results as follow. We study graphs whose adjacency matrices can be made to satisfy the consecutive ones property after changing some values on the diagonal, and show that those graphs have path eccentricity at most 2, by showing that they are 2-AT-free.


title: Onset of Spin Entanglement in Doped Carbon Nanotubes Studied by EPR

abstract: Nanoscale semiconductors with isolated spin impurities have been touted as promising materials for their potential use at the intersection of quantum, spin, and information technologies. Electron paramagnetic resonance (EPR) studies of spins in semiconducting carbon nanotubes have overwhelmingly focused on spins more strongly localized by $\rm sp^3$-type lattice defects. However, the creation of such impurities is irreversible and requires specific reactions to generate them. Shallow charge impurities, on the other hand, are more readily and widely produced by simple redox chemistry, but have not yet been investigated for their spin properties. Here we use EPR to study p-doped (6,5) semiconducting single-wall carbon nanotubes (s-SWNTs) and elucidate the role of impurity-impurity interactions in conjunction with exchange and correlation effects for the spin behavior of this material. A quantitative comparison of the EPR signals with phenomenological modeling combined with configuration interaction electronic structure calculations of impurity pairs shows that orbital overlap, combined with exchange and correlation effects, causes the EPR signal to disappear due to spin entanglement for doping levels corresponding to impurity spacings of $14\,\rm nm$ (at 30 K). This transition is predicted to shift to higher doping levels with increasing temperature and to lower levels with increasing screening, providing an opportunity for improved spin control in doped s-SWNTs.


title: Physical properties of extreme emission-line galaxies at $z\sim 4-9$ from the JWST CEERS survey

abstract: Extreme emission line galaxies (EELGs) are typically characterized by high equivalent widths (EWs) which are driven by elevated specific star formation rates (sSFR) in low-mass galaxies with subsolar metallicities and little dust. Such extreme systems are rare in the local universe, but the number density of EELGs increases with redshift. Such starburst galaxies are currently presumed to be the main drivers of hydrogen reionization over 5.5<z<15, which serves to motivate many of the searches for high-z EELGs. We aim to characterize the physical properties of a sample of ~730 EELGs at 4<z<9 photometrically selected from the CEERS survey using JWST/NIRCam. We validate our method and demonstrate the main physical properties of a subset of EELGs using NIRSpec spectra. We create synthetic NIRCam observations of EELGs using empirical templates based on ~2000 local metal-poor starbursts to select EELGs based on color-color criteria. We study their properties based on SED fitting and flux excess from emission lines in the photometric filters. Our sample has a mean stellar mass of $10^{7.84}$Msun with high sSFRs with a mean value of $10^{-7.03}$ yr$^{-1}$. We consider a delayed-$\tau$ model for the star formation history and find our sample of EELGs are young with a mean value of the time after the onset of star formation of 45Myr. We find that they have similar line ratios to local metal-poor starbursts with high log([OIII]/H$\beta$)>0.4-1 which indicates that star formation may be the dominant source of ionization. Based on the photometric fluxes, we find an increase of EW([OIII]+H$\beta$) with sSFR and $\Sigma_{SFR}$, and a decrease with age and stellar mass. The sample of EELGs can reach $\Sigma_{SFR}>$10Msun yr$^{-1}$kpc$^{-2}$ which indicate they are strong candidates of LyC leakers. Another indirect indicator is the high values of O32>5 that can be reached for some galaxies in the sample.


title: Super-adiabatic Temperature Gradient at Jupiter's Equatorial Zone and Implications for the Water Abundance

abstract: The temperature structure of a giant planet was traditionally thought to be an adiabat assuming convective mixing homogenizes entropy. The only in-situ measurement made by the Galileo Probe detected a near-adiabatic temperature structure within one of Jupiter's 5$\mu$m hot spots with small but definite local departures from adiabaticity. We analyze Juno's microwave observations near Jupiter's equator (0 ~ 5$^o$N) and find that the equatorial temperature structure is best characterized by a stable super-adiabatic temperature profile rather than an adiabatic one. Water is the only substance with sufficient abundance to alter the atmosphere's mean molecular weight and prevent dynamic instability if a super-adiabatic temperature gradient exists. Thus, from the super-adiabaticity, our results indicate a water concentration (or the oxygen to hydrogen ratio) of about 4.9 times solar with a possible range of 1.5 ~ 8.3 times solar in Jupiter's equatorial region.


title: A conditional lower bound for the Tur\'an number of spheres

abstract: We consider the hypergraph Tur\'an problem of determining $\mathrm{ex}(n, S^d)$, the maximum number of facets in a $d$-dimensional simplicial complex on $n$ vertices that does not contain a simplicial $d$-sphere (a homeomorph of $S^d$) as a subcomplex. We show that if there is an affirmative answer to a question of Gromov about sphere enumeration in high dimensions, then $\mathrm{ex}(n, S^d) \geq \Omega(n^{d + 1 - (d + 1)/(2^{d + 1} - 2)})$. Furthermore, this lower bound holds unconditionally for 2-LC spheres, which includes all shellable spheres and therefore all polytopes. We also prove an upper bound on $\mathrm{ex}(n, S^d)$ of $O(n^{d + 1 - 1/2^{d - 1}})$ using a simple induction argument. We conjecture that the upper bound can be improved to match the conditional lower bound.


title: The Impact of Quantization on the Robustness of Transformer-based Text Classifiers

abstract: Transformer-based models have made remarkable advancements in various NLP areas. Nevertheless, these models often exhibit vulnerabilities when confronted with adversarial attacks. In this paper, we explore the effect of quantization on the robustness of Transformer-based models. Quantization usually involves mapping a high-precision real number to a lower-precision value, aiming at reducing the size of the model at hand. To the best of our knowledge, this work is the first application of quantization on the robustness of NLP models. In our experiments, we evaluate the impact of quantization on BERT and DistilBERT models in text classification using SST-2, Emotion, and MR datasets. We also evaluate the performance of these models against TextFooler, PWWS, and PSO adversarial attacks. Our findings show that quantization significantly improves (by an average of 18.68%) the adversarial accuracy of the models. Furthermore, we compare the effect of quantization versus that of the adversarial training approach on robustness. Our experiments indicate that quantization increases the robustness of the model by 18.80% on average compared to adversarial training without imposing any extra computational overhead during training. Therefore, our results highlight the effectiveness of quantization in improving the robustness of NLP models.


title: Tagged particle fluctuations for TASEP with dynamics restricted by a moving wall

abstract: We consider the totally asymmetric simple exclusion process on $\Z$ with step initial condition and with the presence of a rightward-moving wall that prevents the particles from jumping. This model was first studied in [Borodin-Bufetov-Ferrari'21]. We extend their work by determining the limiting distribution of a tagged particle in the case where the wall has influence on its fluctuations in neighbourhoods of multiple macroscopic times.


title: Stability-Certified On-Policy Data-Driven LQR via Recursive Learning and Policy Gradient

abstract: In this paper, we investigate a data-driven framework to solve Linear Quadratic Regulator (LQR) problems when the dynamics is unknown, with the additional challenge of providing stability certificates for the overall learning and control scheme. Specifically, in the proposed on-policy learning framework, the control input is applied to the actual (unknown) linear system while iteratively optimized. We propose a learning and control procedure, termed RELEARN LQR, that combines a recursive least squares method with a direct policy search based on the gradient method. The resulting scheme is analyzed by modeling it as a feedback-interconnected nonlinear dynamical system. A Lyapunov-based approach, exploiting averaging and singular perturbations theory for nonlinear systems, allows us to provide formal stability guarantees for the whole interconnected scheme. The effectiveness of the proposed strategy is corroborated by numerical simulations, where RELEARN LQR is deployed on an aircraft control problem, with both static and drifting parameters.


title: Exploring the Links between the Fundamental Lemma and Kernel Regression

abstract: Generalizations and variations of the fundamental lemma by Willems et al. are an active topic of recent research. In this note, we explore and formalize the links between kernel regression and known nonlinear extensions of the fundamental lemma. Applying a transformation to the usual linear equation in Hankel matrices, we arrive at an alternative implicit kernel representation of the system trajectories while keeping the requirements on persistency of excitation. We show that this representation is equivalent to the solution of a specific kernel regression problem. We explore the possible structures of the underlying kernel as well as the system classes to which they correspond.


title: Frequency-Adaptive Dilated Convolution for Semantic Segmentation

abstract: Dilated convolution, which expands the receptive field by inserting gaps between its consecutive elements, is widely employed in computer vision. In this study, we propose three strategies to improve individual phases of dilated convolution from the view of spectrum analysis. Departing from the conventional practice of fixing a global dilation rate as a hyperparameter, we introduce Frequency-Adaptive Dilated Convolution (FADC), which dynamically adjusts dilation rates spatially based on local frequency components. Subsequently, we design two plug-in modules to directly enhance effective bandwidth and receptive field size. The Adaptive Kernel (AdaKern) module decomposes convolution weights into low-frequency and high-frequency components, dynamically adjusting the ratio between these components on a per-channel basis. By increasing the high-frequency part of convolution weights, AdaKern captures more high-frequency components, thereby improving effective bandwidth. The Frequency Selection (FreqSelect) module optimally balances high- and low-frequency components in feature representations through spatially variant reweighting. It suppresses high frequencies in the background to encourage FADC to learn a larger dilation, thereby increasing the receptive field for an expanded scope. Extensive experiments on segmentation and object detection consistently validate the efficacy of our approach. The code is publicly available at https://github.com/Linwei-Chen/FADC.


title: On the Certification of the Kinematics of 3-DOF Spherical Parallel Manipulators

abstract: This paper aims to study a specific kind of parallel robot: Spherical Parallel Manipulators (SPM) that are capable of unlimited rolling. A focus is made on the kinematics of such mechanisms, especially taking into account uncertainties (e.g. on conception & fabrication parameters, measures) and their propagations. Such considerations are crucial if we want to control our robot correctly without any undesirable behavior in its workspace (e.g. effects of singularities). In this paper, we will consider two different approaches to study the kinematics and the singularities of the robot of interest: symbolic and semi-numerical. By doing so, we can compute a singularity-free zone in the work- and joint spaces, considering given uncertainties on the parameters. In this zone, we can use any control law to inertially stabilize the upper platform of the robot.


title: Atomistic investigation of deformation and fracture of individual structural components of metal matrix composites

abstract: This paper focuses on the development of the atomistic framework for determining the lower scale mechanical parameters of single components of a metal matrix composite for final application to a micromechanical damage model. Here, the deformation and failure behavior of NiAl-Al$_2$O$_3$ interfaces and their components, metal and ceramic, are analyzed in depth using molecular statics calculations. A number of atomistic simulations of strength tests, uniaxial tensile, uniaxial compressive and simple shear, have been performed in order to obtain a set of stiffness tensors and strain-stress characteristics up to failure for 30 different crystalline and amorphous systems. Characteristic points on the strain-stress curves in the vicinity of failure are further analyzed at the atomistic level, using local measures of lattice disorder. Numerical results are discussed in the context of composite damage at upper microscopic scale based on images of the fracture surface of NiAl-Al$_2$O$_3$ composites.


title: Limit Laws for Critical Dispersion on Complete Graphs

abstract: We consider a synchronous process of particles moving on the vertices of a graph $G$, introduced by Cooper, McDowell, Radzik, Rivera and Shiraga (2018). Initially, $M$ particles are placed on a vertex of $G$. In subsequent time steps, all particles that are located on a vertex inhabited by at least two particles jump independently to a neighbour chosen uniformly at random. The process ends at the first step when no vertex is inhabited by more than one particle; we call this (random) time step the dispersion time. In this work we study the case where $G$ is the complete graph on $n$ vertices and the number of particles is $M=n/2+\alpha n^{1/2} + o(n^{1/2})$, $\alpha\in \mathbb{R}$. This choice of $M$ corresponds to the critical window of the process, with respect to the dispersion time. We show that the dispersion time, if rescaled by $n^{-1/2}$, converges in $p$-th mean, as $n\rightarrow \infty$ and for any $p \in \mathbb{R}$, to a continuous and almost surely positive random variable $T_\alpha$. We find that $T_\alpha$ is the absorption time of a standard logistic branching process, thoroughly investigated by Lambert (2005), and we determine its expectation. In particular, in the middle of the critical window we show that $\mathbb{E}[T_0] = \pi^{3/2}/\sqrt{7}$, and furthermore we formulate explicit asymptotics when $|\alpha|$ gets large that quantify the transition into and out of the critical window. We also study the (random) total number of jumps that are performed by the particles until the dispersion time is reached. In particular, we prove that it centers around $\frac{2}{7}n\ln n$ and that it has variations linear in $n$, whose distribution we can describe explicitly.


title: Regularized Principal Spline Functions to Mitigate Spatial Confounding

abstract: This paper proposes a new approach to address the problem of unmeasured confounding in spatial designs. Spatial confounding occurs when some confounding variables are unobserved and not included in the model, leading to distorted inferential results about the effect of an exposure on an outcome. We show the relationship existing between the confounding bias of a non-spatial model and that of a semi-parametric model that includes a basis matrix to represent the unmeasured confounder conditional on the exposure. This relationship holds for any basis expansion, however it is shown that using the semi-parametric approach guarantees a reduction in the confounding bias only under certain circumstances, which are related to the spatial structures of the exposure and the unmeasured confounder, the type of basis expansion utilized, and the regularization mechanism. To adjust for spatial confounding, and therefore try to recover the effect of interest, we propose a Bayesian semi-parametric regression model, where an expansion matrix of principal spline basis functions is used to approximate the unobserved factor, and spike-and-slab priors are imposed on the respective expansion coefficients in order to select the most important bases. From the results of an extensive simulation study, we conclude that our proposal is able to reduce the confounding bias with respect to the non-spatial model, and it also seems more robust to bias amplification than competing approaches.


title: Anisotropic effects in two-dimensional materials

abstract: Among a huge variety of known two-dimensional materials, some of them have anisotropic crystal structures; examples include so different systems as a few-layer black phoshphorus (phosphorene), beryllium nitride BeN$_4$, van der Waals magnet CrSBr, rhenium dichalgogenides ReX$_2$. As a consequence, their optical and electronic properties turn out to be highly anisotropic as well. In some cases, the anisotropy results not just in a smooth renormalization of observable properties in comparison with the isotropic case but in the appearance of dramatically new physics. The examples are hyperbolic plasmons and excitons, strongly anisotropic ordering of adatoms at the surface of two-dimensional or van der Waals materials, essential change of transport and superconducting properties. Here, we present a systematic review of electronic structure, transport and optical properties of several representative groups of anisotropic two-dimensional materials including semiconductors, anisotropic Dirac and semi-Dirac materials, as well as superconductors.


title: Multiple correlations of spectra for higher rank Anosov representations

abstract: We describe multiple correlations of Jordan and Cartan spectra for any finite number of Anosov representations of a finitely generated group. This extends our previous work on correlations of length and displacement spectra for rank one convex cocompact representations. Examples include correlations of the Hilbert length spectra for convex projective structures on a closed surface as well as correlations of eigenvalue gaps and singular value gaps for Hitchin representations. We relate the correlation problem to the counting problem for Jordan and Cartan projections of an Anosov subgroup with respect to a family of carefully chosen truncated {\it hypertubes}, rather than in tubes as in our previous work. Hypertubes go to infinity in a linear subspace of directions, while tubes go to infinity in a single direction and this feature presents a novel difficulty in this higher rank correlation problem.


title: Intrinsic mirror symmetry and Frobenius structure theorem via Gromov-Witten theory of root stacks

abstract: Using recent results of Battistella, Nabijou, Ranganathan and the author, we compare candidate mirror algebras associated with certain log Calabi-Yau pairs constructed by Gross-Siebert using log Gromov-Witten theory and Tseng-You using orbifold Gromov- Witten theory of root stacks. Although the structure constants used to defined these mirror algebras do not typically agree, we show that any given structure constant involved in the construction the algebra of Gross and Siebert can be computed in terms of structure constants of the algebra of Tseng and You after a sequence of log blowups. Using this relation, we provide another proof of associativity of the log mirror algebra, and a proof of the weak Frobenius Structure Theorem in full generality. Along the way, we introduce a class of twisted punctured Gromov-Witten invariants of generalized root stacks induced by log \'etale modifications, and use this to study the behavior of log Gromov-Witten invariants under ramified base change.


title: Scalable Software as a Service Architecture

abstract: This paper explores the architecture of Software as a Service (SaaS) platforms, emphasizing scalability and maintainability. SaaS, a flexible software distribution model suitable for individuals and organizations, has become prevalent with the advent of Cloud services. This paper aims to provide a high-level design reference for establishing a scalable and maintainable SaaS architecture.


title: Online Contention Resolution Schemes for Network Revenue Management and Combinatorial Auctions

abstract: In the Network Revenue Management (NRM) problem, products composed of up to L resources are sold to stochastically arriving customers. We take a randomized rounding approach to NRM, motivated by developments in Online Contention Resolution Schemes (OCRS). The goal is to take a fractional solution to NRM that satisfies the resource constraints in expectation, and implement it in an online policy that satisfies the resource constraints in any state, while (approximately) preserving all of the sales that were prescribed by the fractional solution. OCRS cannot be naively applied to NRM or revenue management problems in general, because customer substitution induces a negative correlation in products being demanded. We start by deriving an OCRS that achieves a guarantee of 1/(1+L) for NRM with customer substitution, matching a common benchmark in the literature. We then show how to beat this benchmark for all integers L>1 assuming no substitution, i.e., in the standard OCRS setting. By contrast, we show that this benchmark is unbeatable using OCRS or any fractional relaxation if there is customer substitution, for all integers L that are the power of a prime number. Finally, we show how to beat 1/(1+L) even with customer substitution, if the products comprise one item from each of up to L groups. Our results have corresponding implications for Online Combinatorial Auctions, in which buyers bid for bundles of up to L items, and buyers being single-minded is akin to no substitution. Our final result also beats 1/(1+L) for Prophet Inequality on the intersection of L partition matroids. All in all, our paper provides a unifying framework for applying OCRS to these problems, delineating the impact of substitution, and establishing a separation between the guarantees achievable with vs. without substitution under general resource constraints parametrized by L.


title: Self-Supervised Multiple Instance Learning for Acute Myeloid Leukemia Classification

abstract: Automated disease diagnosis using medical image analysis relies on deep learning, often requiring large labeled datasets for supervised model training. Diseases like Acute Myeloid Leukemia (AML) pose challenges due to scarce and costly annotations on a single-cell level. Multiple Instance Learning (MIL) addresses weakly labeled scenarios but necessitates powerful encoders typically trained with labeled data. In this study, we explore Self-Supervised Learning (SSL) as a pre-training approach for MIL-based AML subtype classification from blood smears, removing the need for labeled data during encoder training. We investigate the three state-of-the-art SSL methods SimCLR, SwAV, and DINO, and compare their performance against supervised pre-training. Our findings show that SSL-pretrained encoders achieve comparable performance, showcasing the potential of SSL in MIL. This breakthrough offers a cost-effective and data-efficient solution, propelling the field of AI-based disease diagnosis.


title: Spectrogram-Based Detection of Auto-Tuned Vocals in Music Recordings

abstract: In the domain of music production and audio processing, the implementation of automatic pitch correction of the singing voice, also known as Auto-Tune, has significantly transformed the landscape of vocal performance. While auto-tuning technology has offered musicians the ability to tune their vocal pitches and achieve a desired level of precision, its use has also sparked debates regarding its impact on authenticity and artistic integrity. As a result, detecting and analyzing Auto-Tuned vocals in music recordings has become essential for music scholars, producers, and listeners. However, to the best of our knowledge, no prior effort has been made in this direction. This study introduces a data-driven approach leveraging triplet networks for the detection of Auto-Tuned songs, backed by the creation of a dataset composed of original and Auto-Tuned audio clips. The experimental results demonstrate the superiority of the proposed method in both accuracy and robustness compared to Rawnet2, an end-to-end model proposed for anti-spoofing and widely used for other audio forensic tasks.


title: Exploring Robust Features for Few-Shot Object Detection in Satellite Imagery

abstract: The goal of this paper is to perform object detection in satellite imagery with only a few examples, thus enabling users to specify any object class with minimal annotation. To this end, we explore recent methods and ideas from open-vocabulary detection for the remote sensing domain. We develop a few-shot object detector based on a traditional two-stage architecture, where the classification block is replaced by a prototype-based classifier. A large-scale pre-trained model is used to build class-reference embeddings or prototypes, which are compared to region proposal contents for label prediction. In addition, we propose to fine-tune prototypes on available training images to boost performance and learn differences between similar classes, such as aircraft types. We perform extensive evaluations on two remote sensing datasets containing challenging and rare objects. Moreover, we study the performance of both visual and image-text features, namely DINOv2 and CLIP, including two CLIP models specifically tailored for remote sensing applications. Results indicate that visual features are largely superior to vision-language models, as the latter lack the necessary domain-specific vocabulary. Lastly, the developed detector outperforms fully supervised and few-shot methods evaluated on the SIMD and DIOR datasets, despite minimal training parameters.


title: Quasiperiodic and periodic extended Hatano-Nelson model: Anomalous complex-real transition and non-Hermitian skin effect

abstract: We study the effect of quasiperiodic and periodic onsite potentials in a Hatano-Nelson model with next-nearest-neighbour hopping. By considering a non-reciprocal next-nearest-neighbour hopping and a quasiperiodic onsite potential under periodic boundary conditions, we show a breakdown of the typical correspondence between the delocalization-localization and complex-real transitions as a function of the potential strength. Moreover, we reveal that in the delocalized regime, when the potential strength increases, the eigenstates under open boundary conditions exhibit a bidirectional non-Hermitian skin effect, i.e., they tend to localize on both the edges instead of localizing on either of the edges. However, when a periodic onsite potential is considered, the system not only exhibits a bidirectional skin effect but also shows a complete direction reversal of the skin effect as a function of the onsite periodic potential.


title: Thermal cycling induced evolution and colossal exchange bias in MnPS3/Fe3GeTe2 van der Waals heterostructures

abstract: The exchange bias phenomenon, inherent in exchange-coupled ferromagnetic and antiferromagnetic systems, has intrigued researchers for decades. Van der Waals materials, with their layered structure, provide an optimal platform for probing such physical phenomena. However, achieving a facile and effective means to manipulate exchange bias in pristine van der Waals heterostructures remains challenging. In this study, we investigate the origin of exchange bias in MnPS3/Fe3GeTe2 van der Waals heterostructures. Our work demonstrates a method to modulate unidirectional exchange anisotropy, achieving an unprecedented nearly 1000% variation through simple thermal cycling. Despite the compensated interfacial spin configuration of MnPS3, magneto-transport measurements reveal a huge 170 mT exchange bias at 5 K, the largest observed in pristine van der Waals antiferromagnet-ferromagnet interfaces. This substantial magnitude of the exchange bias is linked to an anomalous weak ferromagnetic ordering in MnPS3 below 40 K. On the other hand, the tunability of exchange bias during thermal cycling is ascribed to the modified arrangement of interfacial atoms and changes in the vdW gap during field cooling. Our findings highlight a robust and easily adjustable exchange bias in van der Waals antiferromagnetic/ferromagnetic heterostructures, presenting a straightforward approach to enhance other interface related spintronic phenomena for practical applications.


title: A Data Augmentation Pipeline to Generate Synthetic Labeled Datasets of 3D Echocardiography Images using a GAN

abstract: Due to privacy issues and limited amount of publicly available labeled datasets in the domain of medical imaging, we propose an image generation pipeline to synthesize 3D echocardiographic images with corresponding ground truth labels, to alleviate the need for data collection and for laborious and error-prone human labeling of images for subsequent Deep Learning (DL) tasks. The proposed method utilizes detailed anatomical segmentations of the heart as ground truth label sources. This initial dataset is combined with a second dataset made up of real 3D echocardiographic images to train a Generative Adversarial Network (GAN) to synthesize realistic 3D cardiovascular Ultrasound images paired with ground truth labels. To generate the synthetic 3D dataset, the trained GAN uses high resolution anatomical models from Computed Tomography (CT) as input. A qualitative analysis of the synthesized images showed that the main structures of the heart are well delineated and closely follow the labels obtained from the anatomical models. To assess the usability of these synthetic images for DL tasks, segmentation algorithms were trained to delineate the left ventricle, left atrium, and myocardium. A quantitative analysis of the 3D segmentations given by the models trained with the synthetic images indicated the potential use of this GAN approach to generate 3D synthetic data, use the data to train DL models for different clinical tasks, and therefore tackle the problem of scarcity of 3D labeled echocardiography datasets.


title: Switching the Loss Reduces the Cost in Batch Reinforcement Learning

abstract: We propose training fitted Q-iteration with log-loss (FQI-LOG) for batch reinforcement learning (RL). We show that the number of samples needed to learn a near-optimal policy with FQI-LOG scales with the accumulated cost of the optimal policy, which is zero in problems where acting optimally achieves the goal and incurs no cost. In doing so, we provide a general framework for proving $\textit{small-cost}$ bounds, i.e. bounds that scale with the optimal achievable cost, in batch RL. Moreover, we empirically verify that FQI-LOG uses fewer samples than FQI trained with squared loss on problems where the optimal policy reliably achieves the goal.


title: Sound and Complete Witnesses for Template-based Verification of LTL Properties on Polynomial Programs

abstract: In this work, we study the classical problem of verifying programs with respect to formal specifications given in the linear temporal logic (LTL). LTL is a rich and expressive logic that can specify important properties of programs. This includes, but is not limited to, termination, safety, liveness, progress, recurrence and reach-avoid properties. We first present novel sound and complete witnesses for LTL verification over imperative programs. Our witnesses are applicable to both universal (all runs) and existential (some run) settings. We then consider polynomial arithmetic programs, i.e. programs in which every assignment and guard consists only of polynomial expressions, with specifications as LTL formulas in which atomic propositions are polynomial constraints. For this setting, we provide an efficient algorithm to automatically synthesize such LTL witnesses. Our synthesis procedure is both sound and semi-complete, i.e. complete for any fixed polynomial degree in the templates. In other words, we provide the first template-based approach for polynomial programs that can handle any LTL formula as its specification. Our approach has termination guarantees with sub-exponential time complexity and generalizes and unifies previous methods for termination, safety and reachability, since they are expressible in LTL. Finally, we present experimental results demonstrating the effectiveness of our approach and that it can handle programs which were beyond the reach of previous state-of-the-art tools.


title: Partition of Sparse Graphs into Two Forests with Bounded Degree

abstract: Borodin and Kostochka proved that for $d_2 \geq 2d_1+2$ and a graph $G$ where every subgraph $H$ satisfies $$ e(H) < \left(2 - \frac{d_2+2}{(d_1+2)(d_2+1)}\right)n(H) + \frac{1}{d_2+1} $$ has a vertex partition $V(G) = V_1 \cup V_2$ such that $G[V_i]$ has maximum degree at most $d_i$ for each $i$. We show that under the same conditions we can additionally conclude that each $G[V_i]$ is a forest.


title: Generalized Correspondence Matching via Flexible Hierarchical Refinement and Patch Descriptor Distillation

abstract: Correspondence matching plays a crucial role in numerous robotics applications. In comparison to conventional hand-crafted methods and recent data-driven approaches, there is significant interest in plug-and-play algorithms that make full use of pre-trained backbone networks for multi-scale feature extraction and leverage hierarchical refinement strategies to generate matched correspondences. The primary focus of this paper is to address the limitations of deep feature matching (DFM), a state-of-the-art (SoTA) plug-and-play correspondence matching approach. First, we eliminate the pre-defined threshold employed in the hierarchical refinement process of DFM by leveraging a more flexible nearest neighbor search strategy, thereby preventing the exclusion of repetitive yet valid matches during the early stages. Our second technical contribution is the integration of a patch descriptor, which extends the applicability of DFM to accommodate a wide range of backbone networks pre-trained across diverse computer vision tasks, including image classification, semantic segmentation, and stereo matching. Taking into account the practical applicability of our method in real-world robotics applications, we also propose a novel patch descriptor distillation strategy to further reduce the computational complexity of correspondence matching. Extensive experiments conducted on three public datasets demonstrate the superior performance of our proposed method. Specifically, it achieves an overall performance in terms of mean matching accuracy of 0.68, 0.92, and 0.95 with respect to the tolerances of 1, 3, and 5 pixels, respectively, on the HPatches dataset, outperforming all other SoTA algorithms. Our source code, demo video, and supplement are publicly available at mias.group/GCM.


title: Multi-reference coupled cluster theory using the normal ordered exponential ansatz

abstract: Properly spin-adapted coupled-cluster theory for general open-shell configurations remains an elusive goal in electronic structure theory. In this contribution we examine Lindgren's normal-ordered exponential ansatz using spin-free excitation operators, with the aid of automatic equation generation software. We present a size-extensive reformulation of the unlinked working equations, and analyse the performance of the method with single and double excitations for simple molecular systems in terms of accuracy and size consistency.


title: The minimal cosmological standard model

abstract: We propose a novel minimal scenario which simultaneously addresses the following theoretical/cosmological/phenomenological puzzles: (i) the origin of scales, (ii) primordial inflation, (iii) matter-antimatter asymmetry, (iv) tiny neutrino masses, (v) dark matter, and (vi) the strong CP-problem. Exact scale-symmetry was assumed. A global $U(1)_{\rm PQ}$-symmetry was also assumed but only in the matter sector. The novelty of the scenario is the introduction of an explicit $U(1)_{\rm PQ}$-breaking term in the gravity sector only. Such a term does not disturb the axion solution whereas naturally realizes an axi-majoron hybrid inflation which allows a natural realization of Affleck-Dine mechanism for generating Peccei-Quinn number asymmetry. The asymmetry can be transferred to the visible sector via the right-handed neutrino portal through non-thermal decay and thermal processes, even without the presence of a CP-violating phase in the matter sector. Dark matter and dark radiation are obtained by cold and hot components of axi-majorons, respectively.


title: Multi-qubit Dynamical Decoupling for Enhanced Crosstalk Suppression

abstract: Dynamical decoupling (DD) is one of the simplest error suppression methods, aiming to enhance the coherence of qubits in open quantum systems. Moreover, DD has demonstrated effectiveness in reducing coherent crosstalk, one major error source in near-term quantum hardware, which manifests from two types of interactions. Static crosstalk exists in various hardware platforms, including superconductor and semiconductor qubits, by virtue of always-on qubit-qubit coupling. Additionally, driven crosstalk may occur as an unwanted drive term due to leakage from driven gates on other qubits. Here we explore a novel staggered DD protocol tailored for multi-qubit systems that suppresses the decoherence error and both types of coherent crosstalk. We develop two experimental setups - an "idle-idle" experiment in which two pairs of qubits undergo free evolution simultaneously and a "driven-idle" experiment in which one pair is continuously driven during the free evolution of the other pair. These experiments are performed on an IBM Quantum superconducting processor and demonstrate the significant impact of the staggered DD protocol in suppressing both types of coherent crosstalk. When compared to the standard DD sequences from state-of-the-art methodologies with the application of X2 sequences, our staggered DD protocol enhances circuit fidelity by 19.7% and 8.5%, respectively, in addressing these two crosstalk types.


title: All paths admit trajectoids

abstract: In a recent paper published in Nature, Y.I. Sobolev et al. introduced the concept of trajectoids: convex, rigid objects, which roll without slip or spin on a flat plane along a prescribed periodic, unbounded planar path. A geometric construction method applicable to many paths was introduced, and the theory was experimentally verified using objects rolling downwards on slightly inclined planes. The construction method was applicable to many but not all curves. A possible extension of the method (referred to as period-n trajectoids) was also proposed, but the limits of applicability were not clarified. Here, a geometric proof is given for the existence of period-n trajectoids for any sufficiently smooth prescribed curve. A somewhat different proof was recently proposed by O. Muller independently from this work. We also highlight some related geometry problems.


title: Binaural Speech Enhancement Using Deep Complex Convolutional Transformer Networks

abstract: Studies have shown that in noisy acoustic environments, providing binaural signals to the user of an assistive listening device may improve speech intelligibility and spatial awareness. This paper presents a binaural speech enhancement method using a complex convolutional neural network with an encoder-decoder architecture and a complex multi-head attention transformer. The model is trained to estimate individual complex ratio masks in the time-frequency domain for the left and right-ear channels of binaural hearing devices. The model is trained using a novel loss function that incorporates the preservation of spatial information along with speech intelligibility improvement and noise reduction. Simulation results for acoustic scenarios with a single target speaker and isotropic noise of various types show that the proposed method improves the estimated binaural speech intelligibility and preserves the binaural cues better in comparison with several baseline algorithms.


title: A Deep Learning Method for Classification of Biophilic Artworks

abstract: Biophilia is an innate love for living things and nature itself that has been associated with a positive impact on mental health and well-being. This study explores the application of deep learning methods for the classification of Biophilic artwork, in order to learn and explain the different Biophilic characteristics present in a visual representation of a painting. Using the concept of Biophilia that postulates the deep connection of human beings with nature, we use an artificially intelligent algorithm to recognise the different patterns underlying the Biophilic features in an artwork. Our proposed method uses a lower-dimensional representation of an image and a decoder model to extract salient features of the image of each Biophilic trait, such as plants, water bodies, seasons, animals, etc., based on learnt factors such as shape, texture, and illumination. The proposed classification model is capable of extracting Biophilic artwork that not only helps artists, collectors, and researchers studying to interpret and exploit the effects of mental well-being on exposure to nature-inspired visual aesthetics but also enables a methodical exploration of the study of Biophilia and Biophilic artwork for aesthetic preferences. Using the proposed algorithms, we have also created a gallery of Biophilic collections comprising famous artworks from different European and American art galleries, which will soon be published on the Vieunite@ online community.


title: Recovery Guarantees of Unsupervised Neural Networks for Inverse Problems trained with Gradient Descent

abstract: Advanced machine learning methods, and more prominently neural networks, have become standard to solve inverse problems over the last years. However, the theoretical recovery guarantees of such methods are still scarce and difficult to achieve. Only recently did unsupervised methods such as Deep Image Prior (DIP) get equipped with convergence and recovery guarantees for generic loss functions when trained through gradient flow with an appropriate initialization. In this paper, we extend these results by proving that these guarantees hold true when using gradient descent with an appropriately chosen step-size/learning rate. We also show that the discretization only affects the overparametrization bound for a two-layer DIP network by a constant and thus that the different guarantees found for the gradient flow will hold for gradient descent.


title: HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interaction

abstract: Histopathology serves as the gold standard in cancer diagnosis, with clinical reports being vital in interpreting and understanding this process, guiding cancer treatment and patient care. The automation of histopathology report generation with deep learning stands to significantly enhance clinical efficiency and lessen the labor-intensive, time-consuming burden on pathologists in report writing. In pursuit of this advancement, we introduce HistGen, a multiple instance learning-empowered framework for histopathology report generation together with the first benchmark dataset for evaluation. Inspired by diagnostic and report-writing workflows, HistGen features two delicately designed modules, aiming to boost report generation by aligning whole slide images (WSIs) and diagnostic reports from local and global granularity. To achieve this, a local-global hierarchical encoder is developed for efficient visual feature aggregation from a region-to-slide perspective. Meanwhile, a cross-modal context module is proposed to explicitly facilitate alignment and interaction between distinct modalities, effectively bridging the gap between the extensive visual sequences of WSIs and corresponding highly summarized reports. Experimental results on WSI report generation show the proposed model outperforms state-of-the-art (SOTA) models by a large margin. Moreover, the results of fine-tuning our model on cancer subtyping and survival analysis tasks further demonstrate superior performance compared to SOTA methods, showcasing strong transfer learning capability. Dataset, model weights, and source code are available in https://github.com/dddavid4real/HistGen.