title: Global Synthesis of CNOT Circuits with Holes

abstract: A common approach to quantum circuit transformation is to use the properties of a specific gate set to create an efficient representation of a given circuit's unitary, such as a parity matrix or stabiliser tableau, and then resynthesise an improved circuit, e.g. with fewer gates or respecting connectivity constraints. Since these methods rely on a restricted gate set, generalisation to arbitrary circuits usually involves slicing the circuit into pieces that can be resynthesised and working with these separately. The choices made about what gates should go into each slice can have a major effect on the performance of the resynthesis. In this paper we propose an alternative approach to generalising these resynthesis algorithms to general quantum circuits. Instead of cutting the circuit into slices, we "cut out" the gates we can't resynthesise leaving holes in our quantum circuit. The result is a second-order process called a quantum comb, which can be resynthesised directly. We apply this idea to the RowCol algorithm, which resynthesises CNOT circuits for topologically constrained hardware, explaining how we were able to extend it to work for quantum combs. We then compare the generalisation of RowCol using our method to the naive "slice and build" method empirically on a variety of circuit sizes and hardware topologies. Finally, we outline how quantum combs could be used to help generalise other resynthesis algorithms.


title: Moore-Penrose Dagger Categories

abstract: The notion of a Moore-Penrose inverse (M-P inverse) was introduced by Moore in 1920 and rediscovered by Penrose in 1955. The M-P inverse of a complex matrix is a special type of inverse which is unique, always exists, and can be computed using singular value decomposition. In a series of papers in the 1980s, Puystjens and Robinson studied M-P inverses more abstractly in the context of dagger categories. Despite the fact that dagger categories are now a fundamental notion in categorical quantum mechanics, the notion of a M-P inverse has not (to our knowledge) been revisited since their work. One purpose of this paper is, thus, to renew the study of M-P inverses in dagger categories. Here we introduce the notion of a Moore-Penrose dagger category and provide many examples including complex matrices, finite Hilbert spaces, dagger groupoids, and inverse categories. We also introduce generalized versions of singular value decomposition, compact singular value decomposition, and polar decomposition for maps in a dagger category, and show how, having such a decomposition is equivalent to having M-P inverses. This allows us to provide precise characterizations of which maps have M-P inverses in a dagger idempotent complete category, a dagger kernel category with dagger biproducts (and negatives), and a dagger category with unique square roots.


title: Generalised Winograd Schema and its Contextuality

abstract: Ambiguities in natural language give rise to probability distributions over interpretations. The distributions are often over multiple ambiguous words at a time; a multiplicity which makes them a suitable topic for sheaf-theoretic models of quantum contextuality. Previous research showed that different quantitative measures of contextuality correlate well with Psycholinguistic research on lexical ambiguities. In this work, we focus on coreference ambiguities and investigate the Winograd Schema Challenge (WSC), a test proposed by Levesque in 2011 to evaluate the intelligence of machines. The WSC consists of a collection of multiple-choice questions that require disambiguating pronouns in sentences structured according to the Winograd schema, in a way that makes it difficult for machines to determine the correct referents but remains intuitive for human comprehension. In this study, we propose an approach that analogously models the Winograd schema as an experiment in quantum physics. However, we argue that the original Winograd Schema is inherently too simplistic to facilitate contextuality. We introduce a novel mechanism for generalising the schema, rendering it analogous to a Bell-CHSH measurement scenario. We report an instance of this generalised schema, complemented by the human judgements we gathered via a crowdsourcing platform. The resulting model violates the Bell-CHSH inequality by 0.192, thus exhibiting contextuality in a coreference resolution setting.


title: Navigating chemical reaction space with a steering wheel

abstract: Autonomous reaction network exploration algorithms offer a systematic approach to explore mechanisms of complex chemical processes. However, the resulting reaction networks are so vast that an exploration of all potentially accessible intermediates is computationally too demanding. This renders brute-force explorations unfeasible, while explorations with completely pre-defined intermediates or hard-wired chemical constraints, such as element-specific coordination numbers, are not flexible enough for complex chemical systems. Here, we introduce a Steering Wheel to guide an otherwise unbiased automated exploration. The Steering Wheel algorithm is intuitive, generally applicable, and enables one to focus on specific regions of an emerging network. It also allows for guiding automated data generation in the context of mechanism exploration, catalyst design, and other chemical optimization challenges. The algorithm is demonstrated for reaction mechanism elucidation of transition metal catalysts. We highlight how to explore catalytic cycles in a systematic and reproducible way. The exploration objectives are fully adjustable, allowing one to harness the Steering Wheel for both structure-specific (accurate) calculations as well as for broad high-throughput screening of possible reaction intermediates.


title: Images of Multilinear Polynomials on Generalized Quaternion Algebras

abstract: The main goal of this paper is to extend [J. Algebra Appl. 20 (2021), 2150074] to generalized quaternion algebras, even when these algebras are not necessarily division rings. More precisely, in such cases, the image of a multilinear polynomial evaluated on a quaternion algebra is a vector space and we additionally provide a classification of possible images.


title: Individually Rational Collaborative Vehicle Routing through Give-And-Take Exchanges

abstract: In this paper, we are concerned with the automated exchange of orders between logistics companies in a marketplace platform to optimize total revenues. We introduce a novel multi-agent approach to this problem, focusing on the Collaborative Vehicle Routing Problem (CVRP) through the lens of individual rationality. Our proposed algorithm applies the principles of Vehicle Routing Problem (VRP) to pairs of vehicles from different logistics companies, optimizing the overall routes while considering standard VRP constraints plus individual rationality constraints. By facilitating cooperation among competing logistics agents through a Give-and-Take approach, we show that it is possible to reduce travel distance and increase operational efficiency system-wide. More importantly, our approach ensures individual rationality and faster convergence, which are important properties of ensuring the long-term sustainability of the marketplace platform. We demonstrate the efficacy of our approach through extensive experiments using real-world test data from major logistics companies. The results reveal our algorithm's ability to rapidly identify numerous optimal solutions, underscoring its practical applicability and potential to transform the logistics industry.


title: Apply Non-Hermitian Physics to Realize Ultra-High-Quality Factors of Optically Trapped Particles

abstract: Optical trapping and binding systems are non-Hermitian. On one hand, the optical force is non-Hermitian and may pump energy into the trapped particle when the non-Hermiticity is sufficiently large. On the other hand, the ambient damping constitutes a loss to the particle. Here, we show that in a low-friction environment, the interplay between the energy pumped-in by light and the ambient dissipation can give rise to either instability or a periodic vibration characterized by a finite quality factor (Q-factor). Through a comprehensive exploration, we analyze the influence of various parameters on the non-Hermitian force field. Our investigation reveals several strategies for enhancing the non-Hermitian force field, such as augmenting particle radius and refractive index, utilizing triangular lattice optical clusters, and reducing lattice constants.


title: Semidiscrete optical vortex droplets in quasi-phase-matched photonic crystals

abstract: A new scheme for producing semidiscrete self-trapped vortices (\textquotedblleft swirling photon droplets\textquotedblright ) in photonic crystals with competing quadratic ($\chi ^{(2)}$) and self-defocusing cubic ($\chi ^{(3)}$) nonlinearities is proposed. The photonic crystal is designed with a striped structure, in the form of spatially periodic modulation of the $\chi ^{(2)}$ susceptibility, which is imposed by the quasi-phase-matching technique. Unlike previous realizations of semidiscrete optical modes in composite media, built as combinations of continuous and arrayed discrete waveguides, the semidiscrete vortex droplets are produced here in the fully continuous medium. This work reveals that the system supports two types of semidiscrete vortex droplets, \textit{viz}., onsite- and intersite-centered ones, which feature, respectively, odd and even numbers of stripes, $\mathcal{N}$. Stability areas for the states with different values of $\mathcal{N}$ are identified in the system's parameter space. Some stability areas overlap with each others, giving rise to multistability of states with different $\mathcal{N}$. The coexisting states are mutually degenerate, featuring equal values of the Hamiltonian and propagation constant. An experimental scheme to realize the droplets is outlined, suggesting new possibilities for the long-distance transmission of structured light carrying orbital angular momentum in nonlinear media.


title: Optimal Stopping of BSDEs with Constrained Jumps and Related Zero-Sum Games

abstract: In this paper, we introduce a non-linear Snell envelope which at each time represents the maximal value that can be achieved by stopping a BSDE with constrained jumps. We establish the existence of the Snell envelope by employing a penalization technique and the primary challenge we encounter is demonstrating the regularity of the limit for the scheme. Additionally, we relate the Snell envelope to a finite horizon, zero-sum stochastic differential game, where one player controls a path-dependent stochastic system by invoking impulses, while the opponent is given the opportunity to stop the game prematurely. Importantly, by developing new techniques within the realm of control randomization, we demonstrate that the value of the game exists and is precisely characterized by our non-linear Snell envelope.


title: Recommender AI Agent: Integrating Large Language Models for Interactive Recommendations

abstract: Recommender models excel at providing domain-specific item recommendations by leveraging extensive user behavior data. Despite their ability to act as lightweight domain experts, they struggle to perform versatile tasks such as providing explanations and engaging in conversations. On the other hand, large language models (LLMs) represent a significant step towards artificial general intelligence, showcasing remarkable capabilities in instruction comprehension, commonsense reasoning, and human interaction. However, LLMs lack the knowledge of domain-specific item catalogs and behavioral patterns, particularly in areas that diverge from general world knowledge, such as online e-commerce. Finetuning LLMs for each domain is neither economic nor efficient. In this paper, we bridge the gap between recommender models and LLMs, combining their respective strengths to create a versatile and interactive recommender system. We introduce an efficient framework called \textbf{InteRecAgent}, which employs LLMs as the brain and recommender models as tools. We first outline a minimal set of essential tools required to transform LLMs into InteRecAgent. We then propose an efficient workflow within InteRecAgent for task execution, incorporating key components such as memory components, dynamic demonstration-augmented task planning, and reflection. InteRecAgent enables traditional recommender systems, such as those ID-based matrix factorization models, to become interactive systems with a natural language interface through the integration of LLMs. Experimental results on several public datasets show that InteRecAgent achieves satisfying performance as a conversational recommender system, outperforming general-purpose LLMs. The source code of InteRecAgent is released at https://aka.ms/recagent.


title: Characterisations for the depletion of reactant in a one-dimensional dynamic combustion model

abstract: In this paper, a novel observation is made on a one-dimensional compressible Navier--Stokes model for the dynamic combustion of a reacting mixture of $\gamma$-law gases ($\gamma>1$) with discontinuous Arrhenius reaction rate function, on both bounded and unbounded domains. We show that the mass fraction of the reactant (denoted as $Z$) satisfies a weighted gradient estimate $Z_y/ \sqrt{Z} \in L^\infty_t L^2_y$, provided that at time zero the density is Lipschitz continuous and bounded strictly away from zero and infinity. Consequently, the graph of $Z$ cannot form cusps or corners near the points where the reactant in the combustion process is completely depleted at any instant, and the entropy of $Z$ is bounded from above. The key ingredient of the proof is a new estimate based on the Fisher information, first exploited by [2, 7] with applications to PDEs in chemorepulsion and thermoelasticity. Along the way, we also establish a Lipschitz estimate for the density.


title: Strong electron-phonon coupling and phonon-induced superconductivity in tetragonal C$_3$N$_4$ with hole doping

abstract: C$_3$N$_4$ is a recently discovered phase of carbon nitrides with the tetragonal crystal structure [D.Laniel $\textit{et al.}$, Adv. Mater. 2023, 2308030] that is stable at ambient conditions. C$_3$N$_4$ is a semiconductor exhibiting flat-band anomalies in the valence band, suggesting the emergence of many-body instabilities upon hole doping. Here, using state-of-the-art first-principles calculations we show that hole-doped C$_3$N$_4$ reveals strong electron-phonon coupling, leading to the formation of a gapped superconducting state. The phase transition temperatures turn out to be strongly dependent on the hole concentration. We propose that holes could be injected into C$_3$N$_4$ via boron doping which induces, according to our results, a rigid shift of the Fermi energy without significant modification of the electronic structure. Based on the electron-phonon coupling and Coulomb pseudopotential calculated from first principles, we conclude that the boron concentration of 6 atoms per nm$^3$ would be required to reach the critical temperature of $\sim$36 K at ambient pressure.


title: Restricted Hausdorff spectra of $q$-adic automorphisms

abstract: We solve two well-known open problems on the Hausdorff dimension of branch groups. Firstly, we completely determine the self-similar Hausdorff spectrum of the group of $q$-adic automorphisms where $q$ is a prime power, answering a question of Grigorchuk. Indeed, we take a further step and completely determine its Hausdorff spectra restricted to the most important subclasses of self-similar groups, providing examples differing drastically from the previously known ones in the literature. Our proof relies on a new explicit formula for the computation of the Hausdorff dimension of closed self-similar groups and a generalization of iterated permutational wreath products. Secondly, we provide the first examples of just infinite branch pro-$p$ groups with trivial Hausdorff dimension, disproving a well-known conjecture of Boston which has been open for over two decades.


title: Discovery of interlayer plasmon polaron in graphene/WS$_2$ heterostructures

abstract: Harnessing electronic excitations involving coherent coupling to bosonic modes is essential for the design and control of emergent phenomena in quantum materials [1]. In situations where charge carriers induce a lattice distortion due to the electron-phonon interaction, the conducting states get "dressed". This leads to the formation of polaronic quasiparticles that dramatically impact charge transport, surface reactivity, thermoelectric and optical properties, as observed in a variety of crystals and interfaces composed of polar materials [2-6]. Similarly, when oscillations of the charge density couple to conduction electrons the more elusive plasmon polaron emerges [7], which has been detected in electron-doped semiconductors [8-10]. However, the exploration of polaronic effects on low energy excitations is still in its infancy in two-dimensional (2D) materials. Here, we present the discovery of an interlayer plasmon polaron in heterostructures composed of graphene on top of SL WS$_2$. By using micro-focused angle-resolved photoemission spectroscopy (microARPES) during in situ doping of the top graphene layer, we observe a strong quasiparticle peak accompanied by several carrier density-dependent shake-off replicas around the SL WS$_2$ conduction band minimum (CBM). Our results are explained by an effective many-body model in terms of a coupling between SL WS$_2$ conduction electrons and graphene plasmon modes. It is important to take into account the presence of such interlayer collective modes, as they have profound consequences for the electronic and optical properties of heterostructures that are routinely explored in many device architectures involving 2D transition metal dichalcogenides (TMDs) [11-15].


title: Robust GAN inversion

abstract: Recent advancements in real image editing have been attributed to the exploration of Generative Adversarial Networks (GANs) latent space. However, the main challenge of this procedure is GAN inversion, which aims to map the image to the latent space accurately. Existing methods that work on extended latent space $W+$ are unable to achieve low distortion and high editability simultaneously. To address this issue, we propose an approach which works in native latent space $W$ and tunes the generator network to restore missing image details. We introduce a novel regularization strategy with learnable coefficients obtained by training randomized StyleGAN 2 model - WRanGAN. This method outperforms traditional approaches in terms of reconstruction quality and computational efficiency, achieving the lowest distortion with 4 times fewer parameters. Furthermore, we observe a slight improvement in the quality of constructing hyperplanes corresponding to binary image attributes. We demonstrate the effectiveness of our approach on two complex datasets: Flickr-Faces-HQ and LSUN Church.


title: PhonMatchNet: Phoneme-Guided Zero-Shot Keyword Spotting for User-Defined Keywords

abstract: This study presents a novel zero-shot user-defined keyword spotting model that utilizes the audio-phoneme relationship of the keyword to improve performance. Unlike the previous approach that estimates at utterance level, we use both utterance and phoneme level information. Our proposed method comprises a two-stream speech encoder architecture, self-attention-based pattern extractor, and phoneme-level detection loss for high performance in various pronunciation environments. Based on experimental results, our proposed model outperforms the baseline model and achieves competitive performance compared with full-shot keyword spotting models. Our proposed model significantly improves the EER and AUC across all datasets, including familiar words, proper nouns, and indistinguishable pronunciations, with an average relative improvement of 67% and 80%, respectively. The implementation code of our proposed model is available at https://github.com/ncsoft/PhonMatchNet.


title: MVDream: Multi-view Diffusion for 3D Generation

abstract: We introduce MVDream, a diffusion model that is able to generate consistent multi-view images from a given text prompt. Learning from both 2D and 3D data, a multi-view diffusion model can achieve the generalizability of 2D diffusion models and the consistency of 3D renderings. We demonstrate that such a multi-view diffusion model is implicitly a generalizable 3D prior agnostic to 3D representations. It can be applied to 3D generation via Score Distillation Sampling, significantly enhancing the consistency and stability of existing 2D-lifting methods. It can also learn new concepts from a few 2D examples, akin to DreamBooth, but for 3D generation.


title: Lie groups with all left-invariant semi-Riemannian metrics complete

abstract: For each left-invariant semi-Riemannian metric $g$ on a Lie group $G$, we introduce the class of bi-Lipschitz Riemannian Clairaut metrics, whose completeness implies the completeness of $g$. When the adjoint representation of $G$ satisfies an at most linear growth bound, then all the Clairaut metrics are complete for any $g$. We prove that this bound is satisfied by compact and 2-step nilpotent groups, as well as by semidirect products $K \ltimes_\rho \mathbb{R}^n$ , where $K$ is the direct product of a compact and an abelian Lie group and $\rho(K)$ is pre-compact; they include all the known examples of Lie groups with all left-invariant metrics complete. The affine group of the real line is considered to illustrate how our techniques work even in the the absence of linear growth and suggest new questions.


title: On arrangements of smooth plane quartics and their bitangents

abstract: In the present paper we revisit the geometry of smooth plane quartics and their bitangents from various viewpoints. First of all, we study in detail the weak combinatorics of arrangements of bitangents associated with highly symmetric quartic curves. We look at these quartic curves automorphism-wise and we establish a lower bound on the number of quadruple intersection points for arrangements of bitangents associated to smooth plane quartics being smooth and reduced members of Ciani's pencil. Then we construct new examples of $3$-syzygy reduced plane curves using smooth plane quartics and their bitangents.


title: A Discharging Method: Improved Kernels for Edge Triangle Packing and Covering

abstract: \textsc{Edge Triangle Packing} and \textsc{Edge Triangle Covering} are dual problems extensively studied in the field of parameterized complexity. Given a graph $G$ and an integer $k$, \textsc{Edge Triangle Packing} seeks to determine whether there exists a set of at least $k$ edge-disjoint triangles in $G$, while \textsc{Edge Triangle Covering} aims to find out whether there exists a set of at most $k$ edges that intersects all triangles in $G$. Previous research has shown that \textsc{Edge Triangle Packing} has a kernel of $(3+\epsilon)k$ vertices, while \textsc{Edge Triangle Covering} has a kernel of $6k$ vertices. In this paper, we show that the two problems allow kernels of $3k$ vertices, improving all previous results. A significant contribution of our work is the utilization of a novel discharging method for analyzing kernel size, which exhibits potential for analyzing other kernel algorithms.


title: Curvature-based Pooling within Graph Neural Networks

abstract: Over-squashing and over-smoothing are two critical issues, that limit the capabilities of graph neural networks (GNNs). While over-smoothing eliminates the differences between nodes making them indistinguishable, over-squashing refers to the inability of GNNs to propagate information over long distances, as exponentially many node states are squashed into fixed-size representations. Both phenomena share similar causes, as both are largely induced by the graph topology. To mitigate these problems in graph classification tasks, we propose CurvPool, a novel pooling method. CurvPool exploits the notion of curvature of a graph to adaptively identify structures responsible for both over-smoothing and over-squashing. By clustering nodes based on the Balanced Forman curvature, CurvPool constructs a graph with a more suitable structure, allowing deeper models and the combination of distant information. We compare it to other state-of-the-art pooling approaches and establish its competitiveness in terms of classification accuracy, computational complexity, and flexibility. CurvPool outperforms several comparable methods across all considered tasks. The most consistent results are achieved by pooling densely connected clusters using the sum aggregation, as this allows additional information about the size of each pool.


title: BeeFlow: Behavior Tree-based Serverless Workflow Modeling and Scheduling for Resource-Constrained Edge Clusters

abstract: Serverless computing has gained popularity in edge computing due to its flexible features, including the pay-per-use pricing model, auto-scaling capabilities, and multi-tenancy support. Complex Serverless-based applications typically rely on Serverless workflows (also known as Serverless function orchestration) to express task execution logic, and numerous application- and system-level optimization techniques have been developed for Serverless workflow scheduling. However, there has been limited exploration of optimizing Serverless workflow scheduling in edge computing systems, particularly in high-density, resource-constrained environments such as system-on-chip clusters and single-board-computer clusters. In this work, we discover that existing Serverless workflow scheduling techniques typically assume models with limited expressiveness and cause significant resource contention. To address these issues, we propose modeling Serverless workflows using behavior trees, a novel and fundamentally different approach from existing directed-acyclic-graph- and state machine-based models. Behavior tree-based modeling allows for easy analysis without compromising workflow expressiveness. We further present observations derived from the inherent tree structure of behavior trees for contention-free function collections and awareness of exact and empirical concurrent function invocations. Based on these observations, we introduce BeeFlow, a behavior tree-based Serverless workflow system tailored for resource-constrained edge clusters. Experimental results demonstrate that BeeFlow achieves up to 3.2X speedup in a high-density, resource-constrained edge testbed and 2.5X speedup in a high-profile cloud testbed, compared with the state-of-the-art.


title: MS23D: : A 3D Object Detection Method Using Multi-Scale Semantic Feature Points to Construct 3D Feature Layer

abstract: LiDAR point clouds can effectively depict the motion and posture of objects in three-dimensional space. Many studies accomplish the 3D object detection by voxelizing point clouds. However, in autonomous driving scenarios, the sparsity and hollowness of point clouds create some difficulties for voxel-based methods. The sparsity of point clouds makes it challenging to describe the geometric features of objects. The hollowness of point clouds poses difficulties for the aggregation of 3D features. We propose a two-stage 3D object detection framework, called MS23D. (1) We propose a method using voxel feature points from multi-branch to construct the 3D feature layer. Using voxel feature points from different branches, we construct a relatively compact 3D feature layer with rich semantic features. Additionally, we propose a distance-weighted sampling method, reducing the loss of foreground points caused by downsampling and allowing the 3D feature layer to retain more foreground points. (2) In response to the hollowness of point clouds, we predict the offsets between deep-level feature points and the object's centroid, making them as close as possible to the object's centroid. This enables the aggregation of these feature points with abundant semantic features. For feature points from shallow-level, we retain them on the object's surface to describe the geometric features of the object. To validate our approach, we evaluated its effectiveness on both the KITTI and ONCE datasets.


title: Characterizations of distality via weak equicontinuity

abstract: For an infinite discrete group $G$ acting on a compact metric space $X$, we introduce several weak versions of equicontinuity along subsets of $G$ and show that if a minimal system $(X,G)$ admits an invariant measure then $(X,G)$ is distal if and only if it is pairwise IP$^*$-equicontinuous; if the product system $(X\times X,G)$ of a minimal system $(X,G)$ has a dense set of minimal points, then $(X,G)$ is distal if and only if it is pairwise IP$^*$-equicontinuous if and only if it is pairwise central$^*$-equicontinuous; if $(X,G)$ is a minimal system with $G$ being abelian, then $(X,G)$ is a system of order $\infty$ if and only if it is pairwise FIP$^*$-equicontinuous.


title: Nevanlinna's five-value theorem on non-positively curved complete K\"ahler manifolds

abstract: Nevanlinna's five-value theorem is well-known as a famous theorem in value distribution theory, which asserts that two non-constant meromorphic functions on $\mathbb C$ are identical if they share five distinct values ignoring multiplicities in $\overline{\mathbb C}.$ The central goal of this paper is to generalize Nevanlinna's five-value theorem to non-compact complete K\"ahler manifolds with non-positive sectional curvature by means of the theory of algebraic dependence. With a certain growth condition imposed, we show that two nonconstant meromorphic functions on such class of manifolds are identical if they share five distinct values ignoring multiplicities in $\overline{\mathbb C}.$


title: Are "Changing-Look'' Active Galactic Nuclei Special in the Coevolution of Supermassive Black Holes and their Hosts? I

abstract: The nature of the so-called ``changing-look'' (CL) active galactic nucleus (AGN), which is characterized by spectral-type transitions within $\sim10$~yr, remains an open question. As the first in our series of studies, we here attempt to understand the CL phenomenon from a view of the coevolution of AGNs and their host galaxies (i.e., if CL-AGNs are at a specific evolutionary stage) by focusing on the SDSS local ``partially obscured'' AGNs in which the stellar population of the host galaxy can be easily measured in the integrated spectra. A spectroscopic follow-up program using the Xinglong 2.16~m, Lick/Shane 3~m, and Keck 10~m telescopes enables us to identify in total 9 CL-AGNs from a sample of 59 candidates selected by their mid-infrared variability. Detailed analysis of these spectra shows that the host galaxies of the CL-AGNs are biased against young stellar populations and tend to be dominated by intermediate-age stellar populations. This motivates us to propose that CL-AGNs are probably particular AGNs at a specific evolutionary stage, such as a transition stage from ``feast'' to ``famine'' fueling of the supermassive black hole. In addition, we reinforce the previous claim that CL-AGNs tend to be biased against both a high Eddington ratio and a high bolometric luminosity, suggesting that the disk-wind broad-line-region model is a plausible explanation of the CL phenomenon.


title: Graph-based SLAM-Aware Exploration with Prior Topo-Metric Information

abstract: Autonomous exploration requires the robot to explore an unknown environment while constructing an accurate map with the SLAM (Simultaneous Localization and Mapping) techniques. Without prior information, the exploratory performance is usually conservative due to the limited planning horizon. This paper exploits a prior topo-metric graph of the environment to benefit both the exploration efficiency and the pose graph accuracy in SLAM. Based on recent advancements in relating pose graph reliability with graph topology, we are able to formulate both objectives into a SLAM-aware path planning problem over the prior graph, which finds a fast exploration path with informative loop closures that globally stabilize the pose graph. Furthermore, we derive theoretical thresholds to speed up the greedy algorithm to the problem, which significantly prune non-optimal loop closures in iterations. The proposed planner is incorporated into a hierarchical exploration framework, with flexible features including path replanning and online prior map update that adds additional information to the prior graph. Extensive experiments indicate that our method has comparable exploration efficiency to others while consistently maintaining higher mapping accuracy in various environments. Our implementations will be open-source on GitHub.


title: Circle packing in arbitrary domains

abstract: We describe an algorithm that allows one to find dense packing configurations of a number of congruent disks in arbitrary domains in two or more dimensions. We have applied it to a large class of two dimensional domains such as rectangles, ellipses, crosses, multiply connected domains and even to the cardioid. For many of the cases that we have studied no previous result was available. The fundamental idea in our approach is the introduction of "image" disks, which allows one to work with a fixed container, thus lifting the limitations of the packing algorithms of \cite{Nurmela97,Amore21,Amore23}. We believe that the extension of our algorithm to three (or higher) dimensional containers (not considered here) can be done straightforwardly.


title: Zonal density staircase formation in collisional drift-wave turbulence

abstract: Turbulence-driven quasi-stationnary structures known as 'staircase' are investigated using the collisional drift-wave model. Two-dimensional simulations show that the ability of zonal density corrugations to suppress turbulence are affected by the adiabaticity parameter (inversely proportional to collision frequency). As the adiabaticity parameter increases, zonal density becomes less efficient at suppressing turbulence, and zonal flows become dominant in the near-adiabatic regime. The nonlinear transport crossphase displays radial modulations associated to zonal density.


title: Method for calculation of the beta exponent from the Heitler-Matthews model of hadronic air showers

abstract: The number of muons in an air shower is a strong indicator of the mass of the primary particle and increases with a small power of the cosmic ray mass by the $\beta$-exponent, $N_{\mu} \sim A^{(1-\beta)}$. This behaviour can be explained in terms of the Heitler-Matthews model of hadronic air showers. In this paper, we present a method for calculating $\beta$ from the Heitler-Matthews model. The method has been successfully verified with a series of simulated events observed by the Pierre Auger Observatory at $10^{19}$ eV. To follow real measurements of the mass composition at this energy, the generated sample consists of a certain fraction of events produced with p, He, N and Fe primary energies. Since hadronic interactions at the highest energies can differ from those observed at energies reached by terrestrial accelerators, we generate a mock data set with $\beta =0.92$ (the canonical value) and $\beta =0.96$ (a more exotic scenario). The method can be applied to measured events to determine the muon signal for each primary particle as well as the muon scaling factor and the $\beta$-exponent. Determining the $\beta$-exponent can effectively constrain the parameters that govern hadronic interactions and help solve the so-called muon problem, where hadronic interaction models predict too few muons relative to observed events. In this paper, we lay the foundation for the future analysis of measured data from the Pierre Auger Observatory with a simulation study.


title: Gravity-induced entanglement between two massive microscopic particles in curved spacetime: I.The Schwarzschild background

abstract: The experiment involving the entanglement of two massive particles through gravitational fields has been devised to discern the quantum attributes of gravity. In this paper, we present a scheme to extend this experiment's applicability to more generalized curved spacetimes, with the objective of validating universal quantum gravity within broader contexts. Specifically, we direct our attention towards the quantum gravity induced entanglement of mass (QGEM) in astrophysical phenomena, such as particles traversing the interstellar medium. Notably, we ascertain that the gravitational field within curved spacetime can induce observable entanglement between particle pairs in both scenarios, even when dealing with particles significantly smaller than mesoscopic masses. Furthermore, we obtain the characteristic spectra of QGEM across diverse scenarios, shedding light on potential future experimental examinations. This approach not only establishes a more pronounced and extensive manifestation of the quantum influences of gravity compared to the original scheme but also opens avenues for prospective astronomical experiments. These experiments, aligned with our postulates, hold immense advantages and implications for the detection of quantum gravity and can be envisioned for future design.


title: Unsupervised Recognition of Unknown Objects for Open-World Object Detection

abstract: Open-World Object Detection (OWOD) extends object detection problem to a realistic and dynamic scenario, where a detection model is required to be capable of detecting both known and unknown objects and incrementally learning newly introduced knowledge. Current OWOD models, such as ORE and OW-DETR, focus on pseudo-labeling regions with high objectness scores as unknowns, whose performance relies heavily on the supervision of known objects. While they can detect the unknowns that exhibit similar features to the known objects, they suffer from a severe label bias problem that they tend to detect all regions (including unknown object regions) that are dissimilar to the known objects as part of the background. To eliminate the label bias, this paper proposes a novel approach that learns an unsupervised discriminative model to recognize true unknown objects from raw pseudo labels generated by unsupervised region proposal methods. The resulting model can be further refined by a classification-free self-training method which iteratively extends pseudo unknown objects to the unlabeled regions. Experimental results show that our method 1) significantly outperforms the prior SOTA in detecting unknown objects while maintaining competitive performance of detecting known object classes on the MS COCO dataset, and 2) achieves better generalization ability on the LVIS and Objects365 datasets.


title: SA6D: Self-Adaptive Few-Shot 6D Pose Estimator for Novel and Occluded Objects

abstract: To enable meaningful robotic manipulation of objects in the real-world, 6D pose estimation is one of the critical aspects. Most existing approaches have difficulties to extend predictions to scenarios where novel object instances are continuously introduced, especially with heavy occlusions. In this work, we propose a few-shot pose estimation (FSPE) approach called SA6D, which uses a self-adaptive segmentation module to identify the novel target object and construct a point cloud model of the target object using only a small number of cluttered reference images. Unlike existing methods, SA6D does not require object-centric reference images or any additional object information, making it a more generalizable and scalable solution across categories. We evaluate SA6D on real-world tabletop object datasets and demonstrate that SA6D outperforms existing FSPE methods, particularly in cluttered scenes with occlusions, while requiring fewer reference images.


title: Developing Social Robots with Empathetic Non-Verbal Cues Using Large Language Models

abstract: We propose augmenting the empathetic capacities of social robots by integrating non-verbal cues. Our primary contribution is the design and labeling of four types of empathetic non-verbal cues, abbreviated as SAFE: Speech, Action (gesture), Facial expression, and Emotion, in a social robot. These cues are generated using a Large Language Model (LLM). We developed an LLM-based conversational system for the robot and assessed its alignment with social cues as defined by human counselors. Preliminary results show distinct patterns in the robot's responses, such as a preference for calm and positive social emotions like 'joy' and 'lively', and frequent nodding gestures. Despite these tendencies, our approach has led to the development of a social robot capable of context-aware and more authentic interactions. Our work lays the groundwork for future studies on human-robot interactions, emphasizing the essential role of both verbal and non-verbal cues in creating social and empathetic robots.


title: Privacy-Preserving Medical Image Classification through Deep Learning and Matrix Decomposition

abstract: Deep learning (DL)-based solutions have been extensively researched in the medical domain in recent years, enhancing the efficacy of diagnosis, planning, and treatment. Since the usage of health-related data is strictly regulated, processing medical records outside the hospital environment for developing and using DL models demands robust data protection measures. At the same time, it can be challenging to guarantee that a DL solution delivers a minimum level of performance when being trained on secured data, without being specifically designed for the given task. Our approach uses singular value decomposition (SVD) and principal component analysis (PCA) to obfuscate the medical images before employing them in the DL analysis. The capability of DL algorithms to extract relevant information from secured data is assessed on a task of angiographic view classification based on obfuscated frames. The security level is probed by simulated artificial intelligence (AI)-based reconstruction attacks, considering two threat actors with different prior knowledge of the targeted data. The degree of privacy is quantitatively measured using similarity indices. Although a trade-off between privacy and accuracy should be considered, the proposed technique allows for training the angiographic view classifier exclusively on secured data with satisfactory performance and with no computational overhead, model adaptation, or hyperparameter tuning. While the obfuscated medical image content is well protected against human perception, the hypothetical reconstruction attack proved that it is also difficult to recover the complete information of the original frames.


title: Strong [O III] {\lambda}5007 Compact Galaxies Identified from SDSS DR16 and Their Scaling Relations

abstract: Green pea galaxies are a special class of star-forming compact galaxies with strong [O III]{\lambda}5007 and considered as analogs of high-redshift Ly{\alpha}-emitting galaxies and potential sources for cosmic reionization. In this paper, we identify 76 strong [O III]{\lambda}5007 compact galaxies at z < 0.35 from DR1613 of the Sloan Digital Sky Survey. These galaxies present relatively low stellar mass, high star formation rate, and low metallicity. Both star-forming main sequence relation (SFMS) and mass-metallicity relation (MZR) are investigated and compared with green pea and blueberry galaxies collected from literature. It is found that our strong [O III] {\lambda}5007 compact galaxies share common properties with those compact galaxies with extreme star formation and show distinct scaling relations in respect to those of normal star-forming galaxies at the same redshift. The slope of SFMS is higher, indicates that strong [O III]{\lambda}5007 compact galaxies might grow faster in stellar mass. The lower MZR implies that they may be less chemically evolved and hence on the early stage of star formation. A further environmental investigation confirms that they inhabit relatively low-density regions. Future largescale spectroscopic surveys will provide more details on their physical origin and evolution.


title: Decoupled Local Aggregation for Point Cloud Learning

abstract: The unstructured nature of point clouds demands that local aggregation be adaptive to different local structures. Previous methods meet this by explicitly embedding spatial relations into each aggregation process. Although this coupled approach has been shown effective in generating clear semantics, aggregation can be greatly slowed down due to repeated relation learning and redundant computation to mix directional and point features. In this work, we propose to decouple the explicit modelling of spatial relations from local aggregation. We theoretically prove that basic neighbor pooling operations can too function without loss of clarity in feature fusion, so long as essential spatial information has been encoded in point features. As an instantiation of decoupled local aggregation, we present DeLA, a lightweight point network, where in each learning stage relative spatial encodings are first formed, and only pointwise convolutions plus edge max-pooling are used for local aggregation then. Further, a regularization term is employed to reduce potential ambiguity through the prediction of relative coordinates. Conceptually simple though, experimental results on five classic benchmarks demonstrate that DeLA achieves state-of-the-art performance with reduced or comparable latency. Specifically, DeLA achieves over 90\% overall accuracy on ScanObjectNN and 74\% mIoU on S3DIS Area 5. Our code is available at https://github.com/Matrix-ASC/DeLA .


title: Influence of the symmetry energy on the nuclear binding energies and the neutron drip line position

abstract: A clear connection can be established between properties of nuclear matter and finite-nuclei observables, such as the correlation between the slope of the symmetry energy and dipole polarizability, or between compressibility and the isoscalar monopole giant resonance excitation energy. Establishing a connection between realistic atomic nuclei and an idealized infinite nuclear matter leads to a better understanding of underlying physical mechanisms that govern nuclear dynamics. In this work, we aim to study the dependence of the binding energies and related quantities (e.g. location of drip lines, the total number of bound even-even nuclei) on the symmetry energy $S_2(\rho)$. The properties of finite nuclei are calculated by employing the relativistic Hartree-Bogoliubov (RHB) model, assuming even-even axial and reflection symmetric nuclei. Calculations are performed by employing two families of relativistic energy density functionals (EDFs), based on different effective Lagrangians, constrained to a specific symmetry energy at saturation density $J$ within the interval of $30$--$36$ MeV. Nuclear binding energies and related quantities of bound nuclei are calculated between $8 \leq Z \leq 104$ from the two-proton to the two-neutron drip line. As the neutron drip line is approached, the interactions with stiffer $J$ tend to predict more bound nuclei, resulting in a systematic shift of the two-neutron drip line towards more neutron-rich nuclei. Consequentially, a correlation between the number of bound nuclei $N_{nucl}$ and $S_2(\rho)$ is established for a set of functionals constrained using the similar optimization procedures. The direction of the relationship between the number of bound nuclei and symmetry energy highly depends on the density under consideration.


title: Conditioning Score-Based Generative Models by Neuro-Symbolic Constraints

abstract: Score-based and diffusion models have emerged as effective approaches for both conditional and unconditional generation. Still conditional generation is based on either a specific training of a conditional model or classifier guidance, which requires training a noise-dependent classifier, even when the classifier for uncorrupted data is given. We propose an approach to sample from unconditional score-based generative models enforcing arbitrary logical constraints, without any additional training. Firstly, we show how to manipulate the learned score in order to sample from an un-normalized distribution conditional on a user-defined constraint. Then, we define a flexible and numerically stable neuro-symbolic framework for encoding soft logical constraints. Combining these two ingredients we obtain a general, but approximate, conditional sampling algorithm. We further developed effective heuristics aimed at improving the approximation. Finally, we show the effectiveness of our approach for various types of constraints and data: tabular data, images and time series.


title: Soliton molecules in Fermi-Pasta-Ulam-Tsingou lattice: Gardner equation approach

abstract: We revisit the Fermi-Pasta-Ulam-Tsingou lattice (FPUT) with quadratic and cubic nonlinear interactions in the continuous limit by deducing the Gardner equation. Through the Hirota bilinear method, multi-soliton solutions are obtained for the Gardner equation. Based on these solutions, we show the excitation of an interesting class of table-top soliton molecules in the FPUT lattice through the velocity resonance mechanism. Depending on the condition on the free parameters, we classify them as dissociated and synthetic type molecules. The main feature of the table-top soliton molecules is that they do not exhibit oscillations in the coalescence region. This property ensures that they are distinct from the soliton molecules, having retrieval force, of the nonlinear Schr\"odinger family of systems. Further, to study the stability of the soliton molecule we allow it to interact with a single (or multi) soliton(s). The asymptotic analysis shows that their structures remain constant, though the bond length varies, throughout the collision process. In addition, we consider the FPUT lattice with quadratic nonlinear interaction and FPUT lattice with cubic nonlinearity as sub-cases and point out the nature of the soliton molecules for these cases also systematically. We achieve this based on the interconnections between the solutions of the Gardner, modified K-dV and K-dV equations. Finally, we simulate the FPUT chain corresponding to the Gardner equation numerically and verify the existence of all the soliton structures associated with it. We believe that the present study can be extended to other integrable and non-integrable systems with applications in fluid dynamics, Bose-Einstein condensates, nonlinear optics, and plasma physics.


title: Search for a neutron dark decay in $^6$He

abstract: Neutron dark decays have been suggested as a solution to the discrepancy between bottle and beam experiments, providing a dark matter candidate that can be searched for in halo nuclei. The free neutron in the final state following the decay of $^6$He into $^4$He $+$ $n$ + $\chi$ provides an exceptionally clean detection signature when combined with a high efficiency neutron detector. Using a high-intensity $^6$He$^+$ beam at GANIL, a search for a coincident neutron signal resulted in an upper limit on a dark decay branching ratio of Br$_\chi \leq 4.0\times10^{-10}$ (95\% C.L.). Using the dark neutron decay model proposed originally by Fornal and Grinstein, we translate this into an upper bound on a dark neutron branching ratio of $\mathcal{O}(10^{-5})$, improving over global constraints by one to several orders of magnitude depending on $m_\chi$.


title: The Smart Data Extractor, a Clinician Friendly Solution to Accelerate and Improve the Data Collection During Clinical Trials

abstract: In medical research, the traditional way to collect data, i.e. browsing patient files, has been proven to induce bias, errors, human labor and costs. We propose a semi-automated system able to extract every type of data, including notes. The Smart Data Extractor pre-populates clinic research forms by following rules. We performed a cross-testing experiment to compare semi-automated to manual data collection. 20 target items had to be collected for 79 patients. The average time to complete one form was 6'81'' for manual data collection and 3'22'' with the Smart Data Extractor. There were also more mistakes during manual data collection (163 for the whole cohort) than with the Smart Data Extractor (46 for the whole cohort). We present an easy to use, understandable and agile solution to fill out clinical research forms. It reduces human effort and provides higher quality data, avoiding data re-entry and fatigue induced errors.


title: The AI Revolution: Opportunities and Challenges for the Finance Sector

abstract: This report examines Artificial Intelligence (AI) in the financial sector, outlining its potential to revolutionise the industry and identify its challenges. It underscores the criticality of a well-rounded understanding of AI, its capabilities, and its implications to effectively leverage its potential while mitigating associated risks. The potential of AI potential extends from augmenting existing operations to paving the way for novel applications in the finance sector. The application of AI in the financial sector is transforming the industry. Its use spans areas from customer service enhancements, fraud detection, and risk management to credit assessments and high-frequency trading. However, along with these benefits, AI also presents several challenges. These include issues related to transparency, interpretability, fairness, accountability, and trustworthiness. The use of AI in the financial sector further raises critical questions about data privacy and security. A further issue identified in this report is the systemic risk that AI can introduce to the financial sector. Being prone to errors, AI can exacerbate existing systemic risks, potentially leading to financial crises. Regulation is crucial to harnessing the benefits of AI while mitigating its potential risks. Despite the global recognition of this need, there remains a lack of clear guidelines or legislation for AI use in finance. This report discusses key principles that could guide the formation of effective AI regulation in the financial sector, including the need for a risk-based approach, the inclusion of ethical considerations, and the importance of maintaining a balance between innovation and consumer protection. The report provides recommendations for academia, the finance industry, and regulators.


title: On a Connection between Differential Games, Optimal Control, and Energy-based Models for Multi-Agent Interactions

abstract: Game theory offers an interpretable mathematical framework for modeling multi-agent interactions. However, its applicability in real-world robotics applications is hindered by several challenges, such as unknown agents' preferences and goals. To address these challenges, we show a connection between differential games, optimal control, and energy-based models and demonstrate how existing approaches can be unified under our proposed Energy-based Potential Game formulation. Building upon this formulation, this work introduces a new end-to-end learning application that combines neural networks for game-parameter inference with a differentiable game-theoretic optimization layer, acting as an inductive bias. The experiments using simulated mobile robot pedestrian interactions and real-world automated driving data provide empirical evidence that the game-theoretic layer improves the predictive performance of various neural network backbones.


title: Time-Varying Quasi-Closed-Phase Analysis for Accurate Formant Tracking in Speech Signals

abstract: In this paper, we propose a new method for the accurate estimation and tracking of formants in speech signals using time-varying quasi-closed-phase (TVQCP) analysis. Conventional formant tracking methods typically adopt a two-stage estimate-and-track strategy wherein an initial set of formant candidates are estimated using short-time analysis (e.g., 10--50 ms), followed by a tracking stage based on dynamic programming or a linear state-space model. One of the main disadvantages of these approaches is that the tracking stage, however good it may be, cannot improve upon the formant estimation accuracy of the first stage. The proposed TVQCP method provides a single-stage formant tracking that combines the estimation and tracking stages into one. TVQCP analysis combines three approaches to improve formant estimation and tracking: (1) it uses temporally weighted quasi-closed-phase analysis to derive closed-phase estimates of the vocal tract with reduced interference from the excitation source, (2) it increases the residual sparsity by using the $L_1$ optimization and (3) it uses time-varying linear prediction analysis over long time windows (e.g., 100--200 ms) to impose a continuity constraint on the vocal tract model and hence on the formant trajectories. Formant tracking experiments with a wide variety of synthetic and natural speech signals show that the proposed TVQCP method performs better than conventional and popular formant tracking tools, such as Wavesurfer and Praat (based on dynamic programming), the KARMA algorithm (based on Kalman filtering), and DeepFormants (based on deep neural networks trained in a supervised manner). Matlab scripts for the proposed method can be found at: https://github.com/njaygowda/ftrack


abstract: The success of existing multi-view clustering (MVC) relies on the assumption that all views are complete. However, samples are usually partially available due to data corruption or sensor malfunction, which raises the research of incomplete multi-view clustering (IMVC). Although several anchor-based IMVC methods have been proposed to process the large-scale incomplete data, they still suffer from the following drawbacks: i) Most existing approaches neglect the inter-view discrepancy and enforce cross-view representation to be consistent, which would corrupt the representation capability of the model; ii) Due to the samples disparity between different views, the learned anchor might be misaligned, which we referred as the Anchor-Unaligned Problem for Incomplete data (AUP-ID). Such the AUP-ID would cause inaccurate graph fusion and degrades clustering performance. To tackle these issues, we propose a novel incomplete anchor graph learning framework termed Scalable Incomplete Multi-View Clustering with Structure Alignment (SIMVC-SA). Specially, we construct the view-specific anchor graph to capture the complementary information from different views. In order to solve the AUP-ID, we propose a novel structure alignment module to refine the cross-view anchor correspondence. Meanwhile, the anchor graph construction and alignment are jointly optimized in our unified framework to enhance clustering quality. Through anchor graph construction instead of full graphs, the time and space complexity of the proposed SIMVC-SA is proven to be linearly correlated with the number of samples. Extensive experiments on seven incomplete benchmark datasets demonstrate the effectiveness and efficiency of our proposed method. Our code is publicly available at https://github.com/wy1019/SIMVC-SA.


title: On Model-Checking Higher-Order Effectful Programs (Long Version)

abstract: Model-checking is one of the most powerful techniques for verifying systems and programs, which since the pioneering results by Knapik et al., Ong, and Kobayashi, is known to be applicable to functional programs with higher-order types against properties expressed by formulas of monadic second-order logic. What happens when the program in question, in addition to higher-order functions, also exhibits algebraic effects such as probabilistic choice or global store? The results in the literature range from those, mostly positive, about nondeterministic effects, to those about probabilistic effects, in the presence of which even mere reachability becomes undecidable. This work takes a fresh and general look at the problem, first of all showing that there is an elegant and natural way of viewing higher-order programs producing algebraic effects as ordinary higher-order recursion schemes. We then move on to consider effect handlers, showing that in their presence the model checking problem is bound to be undecidable in the general case, while it stays decidable when handlers have a simple syntactic form, still sufficient to capture so-called generic effects. Along the way we hint at how a general specification language could look like, this way justifying some of the results in the literature, and deriving new ones.


title: BMO-type functionals, total variation, and $\Gamma$-convergence

abstract: We study the BMO-type functional $\kappa_{\varepsilon}(f,\mathbb R^n)$, which can be used to characterize BV functions $f\in BV(\mathbb R^n)$. The $\Gamma$-limit of this functional, taken with respect to $L^1_{\mathrm{loc}}$-convergence, is known to be $\tfrac 14 |Df|(\mathbb R^n)$. We show that the $\Gamma$-limit with respect to $L^{\infty}_{\mathrm{loc}}$-convergence is \[ \tfrac 14 |D^a f|(\mathbb R^n)+\tfrac 14 |D^c f|(\mathbb R^n)+\tfrac 12 |D^j f|(\mathbb R^n), \] which agrees with the ``pointwise'' limit in the case of SBV functions.


title: Forecasting Emergency Department Crowding with Advanced Machine Learning Models and Multivariable Input

abstract: Emergency department (ED) crowding is a significant threat to patient safety and it has been repeatedly associated with increased mortality. Forecasting future service demand has the potential patient outcomes. Despite active research on the subject, several gaps remain: 1) proposed forecasting models have become outdated due to quick influx of advanced machine learning models (ML), 2) amount of multivariable input data has been limited and 3) discrete performance metrics have been rarely reported. In this study, we document the performance of a set of advanced ML models in forecasting ED occupancy 24 hours ahead. We use electronic health record data from a large, combined ED with an extensive set of explanatory variables, including the availability of beds in catchment area hospitals, traffic data from local observation stations, weather variables, etc. We show that N-BEATS and LightGBM outpeform benchmarks with 11 % and 9 % respective improvements and that DeepAR predicts next day crowding with an AUC of 0.76 (95 % CI 0.69-0.84). To the best of our knowledge, this is the first study to document the superiority of LightGBM and N-BEATS over statistical benchmarks in the context of ED forecasting.


title: Distributed Nonblocking Supervisory Control of Timed Discrete-Event Systems with Communication Delays and Losses

abstract: This paper investigates the problem of distributed nonblocking supervisory control for timed discrete-event systems (DESs). The distributed supervisors communicate with each other over networks subject to nondeterministic communication delays and losses. Given that the delays are counted by time, techniques have been developed to model the dynamics of the communication channels. By incorporating the dynamics of the communication channels into the system model, we construct a communication automaton to model the interaction process between the supervisors. Based on the communication automaton, we define the observation mappings for the supervisors, which consider delays and losses occurring in the communication channels. Then, we derive the necessary and sufficient conditions for the existence of a set of supervisors for distributed nonblocking supervisory control. These conditions are expressed as network controllability, network joint observability, and system language closure. Finally, an example of intelligent manufacturing is provided to show the application of the proposed framework.


title: Inference of dynamic hypergraph representations in temporal interaction data

abstract: A range of systems across the social and natural sciences generate datasets consisting of interactions between two distinct categories of items at various instances in time. Online shopping, for example, generates purchasing events of the form (user, product, time of purchase), and mutualistic interactions in plant-pollinator systems generate pollination events of the form (insect, plant, time of pollination). These data sets can be meaningfully modeled as temporal hypergraph snapshots in which multiple items within one category (i.e. online shoppers) share a hyperedge if they interacted with a common item in the other category (i.e. purchased the same product) within a given time window, allowing for the application of hypergraph analysis techniques. However, it is often unclear how to choose the number and duration of these temporal snapshots, which have a strong influence on the final hypergraph representations. Here we propose a principled nonparametric solution to this problem by extracting temporal hypergraph snapshots that optimally capture structural regularities in temporal event data according to the minimum description length principle. We demonstrate our methods on real and synthetic datasets, finding that they can recover planted artificial hypergraph structure in the presence of considerable noise and reveal meaningful activity fluctuations in human mobility data.


title: Fully adaptive structure-preserving hyper-reduction of parametric Hamiltonian systems

abstract: Model order reduction provides low-complexity high-fidelity surrogate models that allow rapid and accurate solutions of parametric differential equations. The development of reduced order models for parametric nonlinear Hamiltonian systems is challenged by several factors: (i) the geometric structure encoding the physical properties of the dynamics; (ii) the slowly decaying Kolmogorov n-width of conservative dynamics; (iii) the gradient structure of the nonlinear flow velocity; (iv) high variations in the numerical rank of the state as a function of time and parameters. We propose to address these aspects via a structure-preserving adaptive approach that combines symplectic dynamical low-rank approximation with adaptive gradient-preserving hyper-reduction and parameters sampling. Additionally, we propose to vary in time the dimensions of both the reduced basis space and the hyper-reduction space by monitoring the quality of the reduced solution via an error indicator related to the projection error of the Hamiltonian vector field. The resulting adaptive hyper-reduced models preserve the geometric structure of the Hamiltonian flow, do not rely on prior information on the dynamics, and can be solved at a cost that is linear in the dimension of the full order model and linear in the number of test parameters. Numerical experiments demonstrate the improved performances of the fully adaptive models compared to the original and reduced models.


title: Does the Cosmological Constant really indicate the existence of a Dark Dimension?

abstract: It has been recently proposed that we might live in a universe with a single compact extra dimension, whose mesoscopic size is dictated by the measured value of the cosmological constant. Central to this proposal is the result that in a $4+n$ dimensional theory with $n$ compact dimensions a tower of Kaluza-Klein (KK) states contributes an amount $m_{_{\rm KK}}^4$ to the vacuum energy $\rho_4$, where $m_{_{\rm KK}}$ is the KK scale of the tower. We show that the result $\rho_4 \sim m_{_{\rm KK}}^4$ comes from a mistreatment of the asymptotics of the loop momenta in the $4+n$ original theory. When the latter are correctly treated, new UV-sensitive terms appear in $\rho_4$ that invalidate the prediction of the dark dimension. We also show that, despite recent claims to the contrary, it is always possible to perform consistent effective field theory calculations that include only a finite number of tower states.


title: Thesis Distillation: Investigating The Impact of Bias in NLP Models on Hate Speech Detection

abstract: This paper is a summary of the work done in my PhD thesis. Where I investigate the impact of bias in NLP models on the task of hate speech detection from three perspectives: explainability, offensive stereotyping bias, and fairness. Then, I discuss the main takeaways from my thesis and how they can benefit the broader NLP community. Finally, I discuss important future research directions. The findings of my thesis suggest that the bias in NLP models impacts the task of hate speech detection from all three perspectives. And that unless we start incorporating social sciences in studying bias in NLP models, we will not effectively overcome the current limitations of measuring and mitigating bias in NLP models.


title: Imaging the Electric Field with X-Ray Diffraction Microscopy

abstract: The properties of semiconductors and functional dielectrics are defined by their response in electric fields, which may be perturbed by defects and the strain they generate. In this work, we demonstrate how diffraction-based X-ray microscopy techniques may be utilized to image the electric field in insulating crystalline materials. By analysing a prototypical ferro- and piezoelectric material, BaTiO$_{3}$, we identify trends that can guide experimental design towards imaging the electric field using any diffraction-based X-ray microscopy technique. We explain these trends in the context of dark-field X-ray microscopy, but the framework is also valid for Bragg scanning probe X-ray microscopy, Bragg coherent diffraction imaging and Bragg X-ray ptychography. The ability to quantify electric field distributions alongside the defects and strain already accessible via these techniques offers a more comprehensive picture of the often complex structure-property relationships that exist in many insulating and semiconducting materials.


title: Object Detection for Caries or Pit and Fissure Sealing Requirement in Children's First Permanent Molars

abstract: Dental caries is one of the most common oral diseases that, if left untreated, can lead to a variety of oral problems. It mainly occurs inside the pits and fissures on the occlusal/buccal/palatal surfaces of molars and children are a high-risk group for pit and fissure caries in permanent molars. Pit and fissure sealing is one of the most effective methods that is widely used in prevention of pit and fissure caries. However, current detection of pits and fissures or caries depends primarily on the experienced dentists, which ordinary parents do not have, and children may miss the remedial treatment without timely detection. To address this issue, we present a method to autodetect caries and pit and fissure sealing requirements using oral photos taken by smartphones. We use the YOLOv5 and YOLOX models and adopt a tiling strategy to reduce information loss during image pre-processing. The best result for YOLOXs model with tiling strategy is 72.3 mAP.5, while the best result without tiling strategy is 71.2. YOLOv5s6 model with/without tiling attains 70.9/67.9 mAP.5, respectively. We deploy the pre-trained network to mobile devices as a WeChat applet, allowing in-home detection by parents or children guardian.


title: Prompt-enhanced Hierarchical Transformer Elevating Cardiopulmonary Resuscitation Instruction via Temporal Action Segmentation

abstract: The vast majority of people who suffer unexpected cardiac arrest are performed cardiopulmonary resuscitation (CPR) by passersby in a desperate attempt to restore life, but endeavors turn out to be fruitless on account of disqualification. Fortunately, many pieces of research manifest that disciplined training will help to elevate the success rate of resuscitation, which constantly desires a seamless combination of novel techniques to yield further advancement. To this end, we collect a custom CPR video dataset in which trainees make efforts to behave resuscitation on mannequins independently in adherence to approved guidelines, thereby devising an auxiliary toolbox to assist supervision and rectification of intermediate potential issues via modern deep learning methodologies. Our research empirically views this problem as a temporal action segmentation (TAS) task in computer vision, which aims to segment an untrimmed video at a frame-wise level. Here, we propose a Prompt-enhanced hierarchical Transformer (PhiTrans) that integrates three indispensable modules, including a textual prompt-based Video Features Extractor (VFE), a transformer-based Action Segmentation Executor (ASE), and a regression-based Prediction Refinement Calibrator (PRC). The backbone of the model preferentially derives from applications in three approved public datasets (GTEA, 50Salads, and Breakfast) collected for TAS tasks, which accounts for the excavation of the segmentation pipeline on the CPR dataset. In general, we unprecedentedly probe into a feasible pipeline that genuinely elevates the CPR instruction qualification via action segmentation in conjunction with cutting-edge deep learning techniques. Associated experiments advocate our implementation with multiple metrics surpassing 91.0%.


title: The seating couple problem in even case

abstract: In this paper we consider the seating couple problem with an even number of seats, which, using graph theory terminology, can be stated as follows. Given a positive even integer $v=2n$ and a list $L$ containing $n$ positive integers not exceeding $n$, is it always possible to find a perfect matching of $K_v$ whose list of edge-lengths is $L$? Up to now a (non-constructive) solution is known only when all the edge-lengths are coprime with $v$. In this paper we firstly present some necessary conditions for the existence of a solution. Then, we give a complete constructive solution when the list consists of one or two distinct elements, and when the list consists of consecutive integers $1,2,\ldots,x$, each one appearing with the same multiplicity. Finally, we propose a conjecture and some open problems.


title: Interior point methods in optimal control problems of affine systems: Convergence results and solving algorithms

abstract: This paper presents an interior point method for pure-state and mixed-constrained optimal control problems for dynamics, mixed constraints, and cost function all affine in the control variable. This method relies on resolving a sequence of two-point boundary value problems of differential and algebraic equations. This paper establishes a convergence result for primal and dual variables of the optimal control problem. A primal and a primal-dual solving algorithm are presented, and a challenging numerical example is treated for illustration. Accepted for publication at SIAM SICON 2023


title: E3CM: Epipolar-Constrained Cascade Correspondence Matching

abstract: Accurate and robust correspondence matching is of utmost importance for various 3D computer vision tasks. However, traditional explicit programming-based methods often struggle to handle challenging scenarios, and deep learning-based methods require large well-labeled datasets for network training. In this article, we introduce Epipolar-Constrained Cascade Correspondence (E3CM), a novel approach that addresses these limitations. Unlike traditional methods, E3CM leverages pre-trained convolutional neural networks to match correspondence, without requiring annotated data for any network training or fine-tuning. Our method utilizes epipolar constraints to guide the matching process and incorporates a cascade structure for progressive refinement of matches. We extensively evaluate the performance of E3CM through comprehensive experiments and demonstrate its superiority over existing methods. To promote further research and facilitate reproducibility, we make our source code publicly available at https://mias.group/E3CM.


title: Batch test of MRPC3b for CBM-TOF/STAR-eTOF

abstract: The Compressed Baryonic Matter (CBM) experiment is one of the major scientific spectrometers of the future Facility for Antiproton and Ion Research (FAIR) in Darmstadt. As one of the core sub-systems in CBM experiment for charged hadron identification, the Time-of-Flight (TOF) system is required to have a time resolution better than 80 ps. According to the final state particle flux distribution, the CBM-TOF will be constructed with several types of Multigap Resistive Plate Chambers (MRPC). In the outer region of the TOF wall where the particle fluxes are around 1 kHz/cm2, MRPCs with ultra-thin float glass electrodes are considered as a cost effective solution. MRPC3b prototypes have been developed and tested with excellent performance which could meet all the requirements. Before the construction of CBM-TOF, approximately 80 MRPC3bs are assembled for the STAR endcap TOF (STAR-eTOF) upgrade at RHIC as part of the FAIR Phase-0 programs for CBM-TOF which provides a valuable opportunity for detector stability test under high flux environments. This paper will introduce the batch test of the MRPC3bs for STAR-eTOF upgrade. Time resolution of better than 70 ps and efficiency of around 95% are achieved. Notably, during the batch test, it has been observed that the noise rates of the two edge strips in each counter are significantly higher than those of the middle strips. Simulations with Computer Simulation Technology (CST)Studio Suite are carried out and several kinds of MRPC prototypes are designed and tested accordingly. Based on the simulation and test results, the design of the MRPC3b has been further optimized, resulting in a significant suppression of noise rates in the edge strips.


title: Effective Test Generation Using Pre-trained Large Language Models and Mutation Testing

abstract: One of the critical phases in software development is software testing. Testing helps with identifying potential bugs and reducing maintenance costs. The goal of automated test generation tools is to ease the development of tests by suggesting efficient bug-revealing tests. Recently, researchers have leveraged Large Language Models (LLMs) of code to generate unit tests. While the code coverage of generated tests was usually assessed, the literature has acknowledged that the coverage is weakly correlated with the efficiency of tests in bug detection. To improve over this limitation, in this paper, we introduce MuTAP for improving the effectiveness of test cases generated by LLMs in terms of revealing bugs by leveraging mutation testing. Our goal is achieved by augmenting prompts with surviving mutants, as those mutants highlight the limitations of test cases in detecting bugs. MuTAP is capable of generating effective test cases in the absence of natural language descriptions of the Program Under Test (PUTs). We employ different LLMs within MuTAP and evaluate their performance on different benchmarks. Our results show that our proposed method is able to detect up to 28% more faulty human-written code snippets. Among these, 17% remained undetected by both the current state-of-the-art fully automated test generation tool (i.e., Pynguin) and zero-shot/few-shot learning approaches on LLMs. Furthermore, MuTAP achieves a Mutation Score (MS) of 93.57% on synthetic buggy code, outperforming all other approaches in our evaluation. Our findings suggest that although LLMs can serve as a useful tool to generate test cases, they require specific post-processing steps to enhance the effectiveness of the generated test cases which may suffer from syntactic or functional errors and may be ineffective in detecting certain types of bugs and testing corner cases PUTs.


title: Persistence of structural distortion and bulk band Rashba splitting in SnTe above its ferroelectric critical temperature

abstract: The ferroelectric semiconductor $\alpha$-SnTe has been regarded as a topological crystalline insulator and the dispersion of its surface states has been intensively measured with angle-resolved photoemission spectroscopy (ARPES) over the last decade. However, much less attention has been given to the impact of the ferroelectric transition on its electronic structure, and in particular on its bulk states. Here, we investigate the low-energy electronic structure of $\alpha$-SnTe with ARPES and follow the evolution of the bulk-state Rashba splitting as a function of temperature, across its ferroelectric critical temperature of about $T_c\sim 110$ K. Unexpectedly, we observe a persistent band splitting up to room temperature, which is consistent with an order-disorder contribution to the phase transition that requires the presence of fluctuating local dipoles above $T_c$. We conclude that no topological surface state can occur at the (111) surface of SnTe, at odds with recent literature.


title: VisAhoi: Towards a Library to Generate and Integrate Visualization Onboarding Using High-level Visualization Grammars

abstract: Visualization onboarding supports users in reading, interpreting, and extracting information from visual data representations. General-purpose onboarding tools and libraries are applicable for explaining a wide range of graphical user interfaces but cannot handle specific visualization requirements. This paper describes a first step towards developing an onboarding library called VisAhoi, which is easy to integrate, extend, semi-automate, reuse, and customize. VisAhoi supports the creation of onboarding elements for different visualization types and datasets. We demonstrate how to extract and describe onboarding instructions using three well-known high-level descriptive visualization grammars - Vega-Lite, Plotly.js, and ECharts. We show the applicability of our library by performing two usage scenarios that describe the integration of VisAhoi into a VA tool for the analysis of high-throughput screening (HTS) data and, second, into a Flourish template to provide an authoring tool for data journalists for a treemap visualization. We provide a supplementary website that demonstrates the applicability of VisAhoi to various visualizations, including a bar chart, a horizon graph, a change matrix or heatmap, a scatterplot, and a treemap visualization.


title: Stepped-Frequency THz-wave Signal Generation From a Kerr Microresonator Soliton Comb

abstract: Optically generated terahertz (THz) oscillators have garnered considerable attention in recent years due to their potential for wide tunability and low phase noise. Here, for the first time, a dissipative Kerr microresonator soliton comb (DKS), which is inherently in a low noise state, is utilized to produce a stepped-frequency THz signal ($\approx$ 280 GHz). The frequency of one comb mode from a DKS is scanned through an optical-recirculating frequency-shifting loop (ORFSL) which induces a predetermined frequency step onto the carrier frequency. The scanned signal is subsequently heterodyned with an adjacent comb mode, generating a THz signal in a frequency range that is determined by the repetition frequency of the DKS. The proposed method is proved by proof-of-concept experiments with MHz level electronics, showing a bandwidth of 4.15 GHz with a frequency step of 83 MHz and a period of 16 $\mu$s.


title: MoMA: Momentum Contrastive Learning with Multi-head Attention-based Knowledge Distillation for Histopathology Image Analysis

abstract: There is no doubt that advanced artificial intelligence models and high quality data are the keys to success in developing computational pathology tools. Although the overall volume of pathology data keeps increasing, a lack of quality data is a common issue when it comes to a specific task due to several reasons including privacy and ethical issues with patient data. In this work, we propose to exploit knowledge distillation, i.e., utilize the existing model to learn a new, target model, to overcome such issues in computational pathology. Specifically, we employ a student-teacher framework to learn a target model from a pre-trained, teacher model without direct access to source data and distill relevant knowledge via momentum contrastive learning with multi-head attention mechanism, which provides consistent and context-aware feature representations. This enables the target model to assimilate informative representations of the teacher model while seamlessly adapting to the unique nuances of the target data. The proposed method is rigorously evaluated across different scenarios where the teacher model was trained on the same, relevant, and irrelevant classification tasks with the target model. Experimental results demonstrate the accuracy and robustness of our approach in transferring knowledge to different domains and tasks, outperforming other related methods. Moreover, the results provide a guideline on the learning strategy for different types of tasks and scenarios in computational pathology. Code is available at: \url{https://github.com/trinhvg/MoMA}.


title: The Power of MEME: Adversarial Malware Creation with Model-Based Reinforcement Learning

abstract: Due to the proliferation of malware, defenders are increasingly turning to automation and machine learning as part of the malware detection tool-chain. However, machine learning models are susceptible to adversarial attacks, requiring the testing of model and product robustness. Meanwhile, attackers also seek to automate malware generation and evasion of antivirus systems, and defenders try to gain insight into their methods. This work proposes a new algorithm that combines Malware Evasion and Model Extraction (MEME) attacks. MEME uses model-based reinforcement learning to adversarially modify Windows executable binary samples while simultaneously training a surrogate model with a high agreement with the target model to evade. To evaluate this method, we compare it with two state-of-the-art attacks in adversarial malware creation, using three well-known published models and one antivirus product as targets. Results show that MEME outperforms the state-of-the-art methods in terms of evasion capabilities in almost all cases, producing evasive malware with an evasion rate in the range of 32-73%. It also produces surrogate models with a prediction label agreement with the respective target models between 97-99%. The surrogate could be used to fine-tune and improve the evasion rate in the future.


title: Schwinger boson symmetric spin liquids of Shastry-Sutherland model

abstract: Motivated by recent experimental and numerical evidences of deconfined quantum critical point and quantum spin-liquid states in spin-$1/2$ Heisenberg model on Shastry-Sutherland lattice, we studied possible symmetric spin liquid states and their proximate ordered states under Schwinger boson formalism. We found a symmetric gapped $Z_2$ spin-liquid state for intermediate model parameter $0.66 < J_1/J_2 < 0.71$ under mean-field approximation. The Schwinger boson mean-field picture is partially supported by exact-diagonalization and self-consistent spin wave theory results.


title: High-T$_C$ superconductivity in $\mathrm{La_3Ni_2O_7}$ based on the bilayer two-orbital t-J model

abstract: The recently discovered high-T$_C$ superconductor La$_3$Ni$_2$O$_7$ has sparked renewed interest in the unconventional superconductivity. Here we study superconductivity in pressurized La$_3$Ni$_2$O$_7$ based on a bilayer two-orbital $t-J$ model, using the renormalized mean-field theory. Our results reveal a robust $s^\pm-$wave pairing driven by the inter-layer $d_{z^2}$ magnetic coupling, which exhibits a transition temperature within the same order of magnitude as the experimentally observed $T_c \sim 80$ K. We establish a comprehensive superconducting phase diagram in the doping plane. Notably, the La$_3$Ni$_2$O$_7$ under pressure is found situated roughly in the optimal doping regime of the phase diagram. When the $d_{x^2-y^2}$ orbital becomes close to half-filling, $d-$wave and $d+is$ pairing can emerge from the system. We discuss the interplay between Fermi surface topology and different pairing symmetries. The stability of the $s^\pm-$wave pairing against Hund's coupling and other magnetic exchange couplings is discussed.


title: Reporting activities for the oxygen evolution reaction: Do we compare apples to apples?

abstract: The oxygen evolution reaction (OER) is a key enabler of sustainable chemical energy storage. Here, the author assesses the current status of protocols for benchmarking the OER in materials- and device-centered investigations and makes suggestions for more comparable data.


title: Comparing Rapid Type Analysis with Points-To Analysis in GraalVM Native Image

abstract: Whole-program analysis is an essential technique that enables advanced compiler optimizations. An important example of such a method is points-to analysis used by ahead-of-time (AOT) compilers to discover program elements (classes, methods, fields) used on at least one program path. GraalVM Native Image uses a points-to analysis to optimize Java applications, which is a time-consuming step of the build. We explore how much the analysis time can be improved by replacing the points-to analysis with a rapid type analysis (RTA), which computes reachable elements faster by allowing more imprecision. We propose several extensions of previous approaches to RTA: making it parallel, incremental, and supporting heap snapshotting. We present an extensive experimental evaluation of the effects of using RTA instead of points-to analysis, in which RTA allowed us to reduce the analysis time for Spring Petclinic, a popular demo application of the Spring framework, by 64% and the overall build time by 35% at the cost of increasing the image size due to the imprecision by 15%.


title: ScrollNet: Dynamic Weight Importance for Continual Learning

abstract: The principle underlying most existing continual learning (CL) methods is to prioritize stability by penalizing changes in parameters crucial to old tasks, while allowing for plasticity in other parameters. The importance of weights for each task can be determined either explicitly through learning a task-specific mask during training (e.g., parameter isolation-based approaches) or implicitly by introducing a regularization term (e.g., regularization-based approaches). However, all these methods assume that the importance of weights for each task is unknown prior to data exposure. In this paper, we propose ScrollNet as a scrolling neural network for continual learning. ScrollNet can be seen as a dynamic network that assigns the ranking of weight importance for each task before data exposure, thus achieving a more favorable stability-plasticity tradeoff during sequential task learning by reassigning this ranking for different tasks. Additionally, we demonstrate that ScrollNet can be combined with various CL methods, including regularization-based and replay-based approaches. Experimental results on CIFAR100 and TinyImagenet datasets show the effectiveness of our proposed method. We release our code at https://github.com/FireFYF/ScrollNet.git.


title: Shape of my heart: Cardiac models through learned signed distance functions

abstract: The efficient construction of anatomical models is one of the major challenges of patient-specific in-silico models of the human heart. Current methods frequently rely on linear statistical models, allowing no advanced topological changes, or requiring medical image segmentation followed by a meshing pipeline, which strongly depends on image resolution, quality, and modality. These approaches are therefore limited in their transferability to other imaging domains. In this work, the cardiac shape is reconstructed by means of three-dimensional deep signed distance functions with Lipschitz regularity. For this purpose, the shapes of cardiac MRI reconstructions are learned to model the spatial relation of multiple chambers. We demonstrate that this approach is also capable of reconstructing anatomical models from partial data, such as point clouds from a single ventricle, or modalities different from the trained MRI, such as the electroanatomical mapping (EAM).


title: LightGrad: Lightweight Diffusion Probabilistic Model for Text-to-Speech

abstract: Recent advances in neural text-to-speech (TTS) models bring thousands of TTS applications into daily life, where models are deployed in cloud to provide services for customs. Among these models are diffusion probabilistic models (DPMs), which can be stably trained and are more parameter-efficient compared with other generative models. As transmitting data between customs and the cloud introduces high latency and the risk of exposing private data, deploying TTS models on edge devices is preferred. When implementing DPMs onto edge devices, there are two practical problems. First, current DPMs are not lightweight enough for resource-constrained devices. Second, DPMs require many denoising steps in inference, which increases latency. In this work, we present LightGrad, a lightweight DPM for TTS. LightGrad is equipped with a lightweight U-Net diffusion decoder and a training-free fast sampling technique, reducing both model parameters and inference latency. Streaming inference is also implemented in LightGrad to reduce latency further. Compared with Grad-TTS, LightGrad achieves 62.2% reduction in paramters, 65.7% reduction in latency, while preserving comparable speech quality on both Chinese Mandarin and English in 4 denoising steps.


title: MONDEO: Multistage Botnet Detection

abstract: Mobile devices have widespread to become the most used piece of technology. Due to their characteristics, they have become major targets for botnet-related malware. FluBot is one example of botnet malware that infects mobile devices. In particular, FluBot is a DNS-based botnet that uses Domain Generation Algorithms (DGA) to establish communication with the Command and Control Server (C2). MONDEO is a multistage mechanism with a flexible design to detect DNS-based botnet malware. MONDEO is lightweight and can be deployed without requiring the deployment of software, agents, or configuration in mobile devices, allowing easy integration in core networks. MONDEO comprises four detection stages: Blacklisting/Whitelisting, Query rate analysis, DGA analysis, and Machine learning evaluation. It was created with the goal of processing streams of packets to identify attacks with high efficiency, in the distinct phases. MONDEO was tested against several datasets to measure its efficiency and performance, being able to achieve high performance with RandomForest classifiers. The implementation is available at github.


title: Document Layout Analysis on BaDLAD Dataset: A Comprehensive MViTv2 Based Approach

abstract: In the rapidly evolving digital era, the analysis of document layouts plays a pivotal role in automated information extraction and interpretation. In our work, we have trained MViTv2 transformer model architecture with cascaded mask R-CNN on BaDLAD dataset to extract text box, paragraphs, images and tables from a document. After training on 20365 document images for 36 epochs in a 3 phase cycle, we achieved a training loss of 0.2125 and a mask loss of 0.19. Our work extends beyond training, delving into the exploration of potential enhancement avenues. We investigate the impact of rotation and flip augmentation, the effectiveness of slicing input images pre-inference, the implications of varying the resolution of the transformer backbone, and the potential of employing a dual-pass inference to uncover missed text-boxes. Through these explorations, we observe a spectrum of outcomes, where some modifications result in tangible performance improvements, while others offer unique insights for future endeavors.


title: CL-MAE: Curriculum-Learned Masked Autoencoders

abstract: Masked image modeling has been demonstrated as a powerful pretext task for generating robust representations that can be effectively generalized across multiple downstream tasks. Typically, this approach involves randomly masking patches (tokens) in input images, with the masking strategy remaining unchanged during training. In this paper, we propose a curriculum learning approach that updates the masking strategy to continually increase the complexity of the self-supervised reconstruction task. We conjecture that, by gradually increasing the task complexity, the model can learn more sophisticated and transferable representations. To facilitate this, we introduce a novel learnable masking module that possesses the capability to generate masks of different complexities, and integrate the proposed module into masked autoencoders (MAE). Our module is jointly trained with the MAE, while adjusting its behavior during training, transitioning from a partner to the MAE (optimizing the same reconstruction loss) to an adversary (optimizing the opposite loss), while passing through a neutral state. The transition between these behaviors is smooth, being regulated by a factor that is multiplied with the reconstruction loss of the masking module. The resulting training procedure generates an easy-to-hard curriculum. We train our Curriculum-Learned Masked Autoencoder (CL-MAE) on ImageNet and show that it exhibits superior representation learning capabilities compared to MAE. The empirical results on five downstream tasks confirm our conjecture, demonstrating that curriculum learning can be successfully used to self-supervise masked autoencoders. We release our code at https://github.com/ristea/cl-mae.


title: Dual-Decoder Consistency via Pseudo-Labels Guided Data Augmentation for Semi-Supervised Medical Image Segmentation

abstract: While supervised learning has achieved remarkable success, obtaining large-scale labeled datasets in biomedical imaging is often impractical due to high costs and the time-consuming annotations required from radiologists. Semi-supervised learning emerges as an effective strategy to overcome this limitation by leveraging useful information from unlabeled datasets. In this paper, we present a novel semi-supervised learning method, Dual-Decoder Consistency via Pseudo-Labels Guided Data Augmentation (DCPA), for medical image segmentation. We devise a consistency regularization to promote consistent representations during the training process. Specifically, we use distinct decoders for student and teacher networks while maintain the same encoder. Moreover, to learn from unlabeled data, we create pseudo-labels generated by the teacher networks and augment the training data with the pseudo-labels. Both techniques contribute to enhancing the performance of the proposed method. The method is evaluated on three representative medical image segmentation datasets. Comprehensive comparisons with state-of-the-art semi-supervised medical image segmentation methods were conducted under typical scenarios, utilizing 10% and 20% labeled data, as well as in the extreme scenario of only 5% labeled data. The experimental results consistently demonstrate the superior performance of our method compared to other methods across the three semi-supervised settings. The source code is publicly available at https://github.com/BinYCn/DCPA.git.