title: Experimental demonstrations of alignment and mode matching in optical cavities with higher-order Hermite-Gauss modes

abstract: Higher-order spatial laser modes have recently been investigated as candidates for reducing test-mass thermal noise in ground-based gravitational-wave detectors such as advanced LIGO. In particular, higher-order Hermite-Gauss (HG) modes have gained attention within the community for their more robust behaviors against random test-mass surface deformations and stronger sensing and control capacities. In this letter we offer experimental investigations on various aspects of HG mode interferometry. We have generated purified HG modes up to the 12-th order $\mathrm{HG}_{6,6}$ mode, with a power conversion efficiency of 38.8% and 27.7% for the $\mathrm{HG}_{3,3}$ and $\mathrm{HG}_{6,6}$ modes respectively. We demonstrated for the first time the misalignment and mode mismatch-induced power coupling loss measurements for HG modes up to the $\mathrm{HG}_{6,6}$. We report an excellent agreement with the extended numerical power loss factors that in the ``small power loss'' region converge to $2n+1$ or $n^2+n+1$ for a misaligned or mode mismatched $\mathrm{HG}_{n,n}$ mode. We also demonstrated the wavefront sensing (WFS) signal measurement for HG modes up to the $\mathrm{HG}_{6,6}$. The measurement result is accurately in accordance with theoretical WFS gain $\beta_{n,n-1}\sqrt{n} + \beta_{n,n+1}\sqrt{n+1}$ for an $\mathrm{HG}_{n,n}$ mode, with $\beta_{n,n-1}$ being the beat coefficient of the adjacent $\mathrm{HG}_{n,n}$ and $\mathrm{HG}_{n-1,n}$ modes on a split photodetector.


title: A New Approach to Calculate Coronal Electron Density: Simplified van de Hulst's Method

abstract: Determining the electron density is a challenging task in solar corona studies, as it requires certain assumptions to be made, such as symmetric, homogeneous and radial distribution, thermal equilibrium, etc. In such studies, the observed $K$ corona brightness is based on the coronal electron density. An important paper on the calculation of electron density was published in 1950 by van de Hulst in an article titled "The Electron Density of the Solar Corona". The author developed a method with some assumptions to calculate the electron density from the observed $K$ corona brightness. We presented here, a new simplified calculation method for the coronal electron density is presented. The integral equation solution given by van de Hulst is interpreted from a different perspective and the $K$ coronal electron density is calculated using only observational data without making any additional adjustments such as successive approximations and multiple attempts.


title: Dissipation induced extended-localized transition

abstract: Mobility edge (ME), representing the critical energy that distinguishes between extended and localized states, is a key concept in understanding the transition between extended (metallic) and localized (insulating) states in disordered and quasiperiodic systems. Here we explore the impact of dissipation on a quasiperiodic system featuring MEs by calculating steady-state density matrix and analyzing quench dynamics with sudden introduction of dissipation, and demonstrate that dissipation can lead the system into specific states predominantly characterized by either extended or localized states, irrespective of the initial state. Our results establish the use of dissipation as a new avenue for inducing transitions between extended and localized states, and for manipulating dynamic behaviors of particles.


title: Mass Generation in Structural Algebraic Quantum Field Theory: An alternative to the Higgs mechanism

abstract: Within the recently proposed structure-inclusive algebraic formulation of quantum field theory, we show that a massless particle can acquire mass by special nonlinear coupling to a universal massless scalar field; establishing an alternative to the Higgs mechanism in the standard model of particle physics. We end with a conjecture concerning dark energy and dark matter.


title: DYNAMITE: Dynamic Interplay of Mini-Batch Size and Aggregation Frequency for Federated Learning with Static and Streaming Dataset

abstract: Federated Learning (FL) is a distributed learning paradigm that can coordinate heterogeneous edge devices to perform model training without sharing private data. While prior works have focused on analyzing FL convergence with respect to hyperparameters like batch size and aggregation frequency, the joint effects of adjusting these parameters on model performance, training time, and resource consumption have been overlooked, especially when facing dynamic data streams and network characteristics. This paper introduces novel analytical models and optimization algorithms that leverage the interplay between batch size and aggregation frequency to navigate the trade-offs among convergence, cost, and completion time for dynamic FL training. We establish a new convergence bound for training error considering heterogeneous datasets across devices and derive closed-form solutions for co-optimized batch size and aggregation frequency that are consistent across all devices. Additionally, we design an efficient algorithm for assigning different batch configurations across devices, improving model accuracy and addressing the heterogeneity of both data and system characteristics. Further, we propose an adaptive control algorithm that dynamically estimates network states, efficiently samples appropriate data batches, and effectively adjusts batch sizes and aggregation frequency on the fly. Extensive experiments demonstrate the superiority of our offline optimal solutions and online adaptive algorithm.


title: Orientation-Aware Leg Movement Learning for Action-Driven Human Motion Prediction

abstract: The task of action-driven human motion prediction aims to forecast future human motion based on the observed sequence while respecting the given action label. It requires modeling not only the stochasticity within human motion but the smooth yet realistic transition between multiple action labels. However, the fact that most datasets do not contain such transition data complicates this task. Existing work tackles this issue by learning a smoothness prior to simply promote smooth transitions, yet doing so can result in unnatural transitions especially when the history and predicted motions differ significantly in orientations. In this paper, we argue that valid human motion transitions should incorporate realistic leg movements to handle orientation changes, and cast it as an action-conditioned in-betweening (ACB) learning task to encourage transition naturalness. Because modeling all possible transitions is virtually unreasonable, our ACB is only performed on very few selected action classes with active gait motions, such as Walk or Run. Specifically, we follow a two-stage forecasting strategy by first employing the motion diffusion model to generate the target motion with a specified future action, and then producing the in-betweening to smoothly connect the observation and prediction to eventually address motion prediction. Our method is completely free from the labeled motion transition data during training. To show the robustness of our approach, we generalize our trained in-betweening learning model on one dataset to two unseen large-scale motion datasets to produce natural transitions. Extensive experimental evaluations on three benchmark datasets demonstrate that our method yields the state-of-the-art performance in terms of visual quality, prediction accuracy, and action faithfulness.


title: TOI-544 b: a potential water-world inside the radius valley in a two-planet system

abstract: We report on the precise radial velocity follow-up of TOI-544 (HD 290498), a bright K star (V=10.8), which hosts a small transiting planet recently discovered by the Transiting Exoplanet Survey Satellite (TESS). We collected 122 high-resolution HARPS and HARPS-N spectra to spectroscopically confirm the transiting planet and measure its mass. The nearly 3-year baseline of our follow-up allowed us to unveil the presence of an additional, non-transiting, longer-period companion planet. We derived a radius and mass for the inner planet, TOI-544b, of 2.018 $\pm$ 0.076 R$_{\oplus}$ and 2.89 $\pm$ 0.48 M$_{\oplus}$ respectively, which gives a bulk density of $1.93^{+0.30}_{-0.25}$ g cm$^{-3}$. TOI-544c has a minimum mass of 21.5 $\pm$ 2.0 M$_{\oplus}$ and orbital period of 50.1 $\pm$ 0.2 days. The low density of planet-b implies that it has either an Earth-like rocky core with a hydrogen atmosphere, or a composition which harbours a significant fraction of water. The composition interpretation is degenerate depending on the specific choice of planet interior models used. Additionally, TOI-544b has an orbital period of 1.55 days and equilibrium temperature of 999 $\pm$ 14 K, placing it within the predicted location of the radius valley, where few planets are expected. TOI-544b is a top target for future atmospheric observations, for example with JWST, which would enable better constraints of the planet composition.


title: Linking Surface Facts to Large-Scale Knowledge Graphs

abstract: Open Information Extraction (OIE) methods extract facts from natural language text in the form of ("subject"; "relation"; "object") triples. These facts are, however, merely surface forms, the ambiguity of which impedes their downstream usage; e.g., the surface phrase "Michael Jordan" may refer to either the former basketball player or the university professor. Knowledge Graphs (KGs), on the other hand, contain facts in a canonical (i.e., unambiguous) form, but their coverage is limited by a static schema (i.e., a fixed set of entities and predicates). To bridge this gap, we need the best of both worlds: (i) high coverage of free-text OIEs, and (ii) semantic precision (i.e., monosemy) of KGs. In order to achieve this goal, we propose a new benchmark with novel evaluation protocols that can, for example, measure fact linking performance on a granular triple slot level, while also measuring if a system has the ability to recognize that a surface form has no match in the existing KG. Our extensive evaluation of several baselines show that detection of out-of-KG entities and predicates is more difficult than accurate linking to existing ones, thus calling for more research efforts on this difficult task. We publicly release all resources (data, benchmark and code) on https://github.com/nec-research/fact-linking.


title: Linear matrix inequality based Type-III compensator synthesis for DC-DC converters

abstract: Boost, buck-boost, and fly-back DC-DC converters which are utilized in power lines of any electric vehicles, solar energy, and power factor correction applications require control systems to regulate the output voltage under mismatched disturbances i.e. load current and input voltage. In continuous current mode operation, the converters, however, are bandwidth-limited control systems due to their non-minimum phase nature. Disturbance rejection performance of such bandwidth-limited control system is an open problem especially where input voltage and load current disturbances cannot be measured. A third-order integral-lead (Type-III) compensator with a disturbance observer (DOB) can suppress the disturbances and unmodeled dynamics of the converters. However, synthesizing such a fixed-order control system under performance constraints is generally challenging. This paper proposes a simultaneous design of a Type-III compensator and a fixed order DOB based on Hinf control approach using convex optimization. The optimization problem is formulated in a convex-concave procedure by including the estimated disturbance and sensor noise functions. We proposed a two-stage iterative algorithm to solve the problem in a convex optimization framework. Convex programming can therefore be used to synthesize an optimal fixed-order control system by removing the non-convex constraints on the parameter space. The approach leads to an easily resolvable control algorithm with linear matrix inequality constraints over parameterized controller parameters due to the convexity of the problem. The proposed control system is implemented on a 200W DC-DC multi-phase interleaved boost converter prototype using a TMS320F28335 digital signal processor. The performance of the approach is compared with the well-known K-factor design approach for the Type-III compensators.


title: Joint Fronthaul Load Balancing and Computation Resource Allocation in Cell-Free User-Centric Massive MIMO Networks

abstract: We consider scalable cell-free massive multiple-input multiple-output networks under an open radio access network paradigm comprising user equipments (UEs), radio units (RUs), and decentralized processing units (DUs). UEs are served by dynamically allocated user-centric clusters of RUs. The corresponding cluster processors (implementing the physical layer for each user) are hosted by the DUs as software-defined virtual network functions. Unlike the current literature, mainly focused on the characterization of the user rates under unrestricted fronthaul communication and computation, in this work we explicitly take into account the fronthaul topology, the limited fronthaul communication capacity, and computation constraints at the DUs. In particular, we systematically address the new problem of joint fronthaul load balancing and allocation of the computation resource. As a consequence of our new optimization framework, we present representative numerical results highlighting the existence of an optimal number of quantization bits in the analog-to-digital conversion at the RUs.


title: Parabolic frequency monotonicity for two nonlinear equations under Ricci flow

abstract: In this paper, we consider the parabolic frequency for positive solutions of two nonlinear parabolic equations under the Ricci flow on closed manifolds. We obtain the monotonicity of parabolic frequency for the solution of two nonlinear parabolic equations with bounded Ricci curvature, then we apply the parabolic frequency monotonicity to get some integral type Harnack inequalities and we use -K1 instead of the lower bound 0 of Ricci curvature from Theorem 4.3 in 16, where K1 is any positive constant.


title: Cluster soft sets and cluster soft topologies

abstract: The cluster soft point is an attempt to introduce a novel generalization of the soft closure point and the soft limit point. A cluster soft set is defined to be the system of all cluster soft points of a soft set. Then the fundamental properties of cluster soft sets are demonstrated. Moreover, the concept of a cluster soft topology on a universal set is introduced with regard to the cluster soft sets. The cluster soft topology is derived from a soft topology with an associated soft ideal, but it is finer than the original soft topology. On the other hand, if we start constructing the cluster soft topology from another cluster soft topology, we will end up with the first cluster soft topology we started with. The implication of cluster soft topologies is highlighted using some examples. Eventually, we represent the cluster soft closed sets in terms of several forms of soft sets.


title: Object Pose Estimation Annotation Pipeline for Multi-view Monocular Camera Systems in Industrial Settings

abstract: Object localization, and more specifically object pose estimation, in large industrial spaces such as warehouses and production facilities, is essential for material flow operations. Traditional approaches rely on artificial artifacts installed in the environment or excessively expensive equipment, that is not suitable at scale. A more practical approach is to utilize existing cameras in such spaces in order to address the underlying pose estimation problem and to localize objects of interest. In order to leverage state-of-the-art methods in deep learning for object pose estimation, large amounts of data need to be collected and annotated. In this work, we provide an approach to the annotation of large datasets of monocular images without the need for manual labor. Our approach localizes cameras in space, unifies their location with a motion capture system, and uses a set of linear mappings to project 3D models of objects of interest at their ground truth 6D pose locations. We test our pipeline on a custom dataset collected from a system of eight cameras in an industrial setting that mimics the intended area of operation. Our approach was able to provide consistent quality annotations for our dataset with 26, 482 object instances at a fraction of the time required by human annotators.


title: Design of the LLRF control system for MA cavity at CSNS RCS

abstract: The China Spallation Neutron Source (CSNS) beam power was successfully reached 125 kW with a low beam loss in February 2022. In order to increase beam power, during the summer in 2022, we employ magnetic-alloy (MA) cavity in the rapid cycling synchrotron (RCS). It is a wideband cavity (Q=2), allows the second harmonic rf (h= 4) operation, with the existing ferrite cavity to realize the dual-harmonic acceleration. The second harmonic (h=4) is used for the bunch shape control and alleviating the space charge effects. We design of the low-level RF(LLRF) control system for MA cavity, in this paper, we describe the system design and implementation, and the preliminary test results.


title: Extended plane wave expansion formulation for viscoelastic phononic thin plates

abstract: The extended plane wave expansion (EPWE) formulation is derived to obtain the complex band structure of flexural waves in viscoelastic thin phononic crystal plates considering the Kirchhoff-Love plate theory. The presented formulation yields the evanescent behavior of flexural waves in periodic thin plates considering viscoelastic effects. The viscosity is modeled by the standard linear solid model (SLSM), typically used to closely model the behavior of polymers. It is observed that the viscoelasticity influences significantly both the propagating and evanescent Bloch modes. The highest wave attenuation of the viscoelastic phononic thin plate is found around a unit cell filling fraction of 0.37 for higher frequencies considering the least attenuated wave mode. This EPWE formulation broadens the suitable methods to handle evanescent flexural waves in 2-D thin periodic plate systems considering the effects of viscoelasticity on wave attenuation.


title: The 1908 Tunguska event: analysis of eyewitness accounts of luminous phenomena collected in 1908

abstract: Historically there were two main reasons to assign the 1908 Tunguska event to a spacebody infall: a) newspaper notes about a fall of a meteorite near the town of Kansk (later claimed to be false); b) eyewitnesses reports about seeing luminous phenomena in the sky. This paper examines accounts of the Siberian eyewitnesses about luminous phenomena in the sky, collected in 1908, immediately after the event. The conducted generalization of the available accounts reported in 1908 indicates that eyewitnesses reported several types of luminous phenomena.


title: ARNIQA: Learning Distortion Manifold for Image Quality Assessment

abstract: No-Reference Image Quality Assessment (NR-IQA) aims to develop methods to measure image quality in alignment with human perception without the need for a high-quality reference image. In this work, we propose a self-supervised approach named ARNIQA (leArning distoRtion maNifold for Image Quality Assessment) for modeling the image distortion manifold to obtain quality representations in an intrinsic manner. First, we introduce an image degradation model that randomly composes ordered sequences of consecutively applied distortions. In this way, we can synthetically degrade images with a large variety of degradation patterns. Second, we propose to train our model by maximizing the similarity between the representations of patches of different images distorted equally, despite varying content. Therefore, images degraded in the same manner correspond to neighboring positions within the distortion manifold. Finally, we map the image representations to the quality scores with a simple linear regressor, thus without fine-tuning the encoder weights. The experiments show that our approach achieves state-of-the-art performance on several datasets. In addition, ARNIQA demonstrates improved data efficiency, generalization capabilities, and robustness compared to competing methods. The code and the model are publicly available at https://github.com/miccunifi/ARNIQA.


title: GRLib: An Open-Source Hand Gesture Detection and Recognition Python Library

abstract: Hand gesture recognition systems provide a natural way for humans to interact with computer systems. Although various algorithms have been designed for this task, a host of external conditions, such as poor lighting or distance from the camera, make it difficult to create an algorithm that performs well across a range of environments. In this work, we present GRLib: an open-source Python library able to detect and classify static and dynamic hand gestures. Moreover, the library can be trained on existing data for improved classification robustness. The proposed solution utilizes a feed from an RGB camera. The retrieved frames are then subjected to data augmentation and passed on to MediaPipe Hands to perform hand landmark detection. The landmarks are then classified into their respective gesture class. The library supports dynamic hand gestures through trajectories and keyframe extraction. It was found that the library outperforms another publicly available HGR system - MediaPipe Solutions, on three diverse, real-world datasets. The library is available at https://github.com/mikhail-vlasenko/grlib and can be installed with pip.


title: Resonant Scattering of Gravitational Waves With Electromagnetic Waves

abstract: A certain class of exact solutions of Einstein Maxwell spacetime in general relativity is discussed which demonstrates at the level of theory that, when certain parametric resonance condition is met, the interaction of electromagnetic field with a gravitational wave will display certain Liapounov instability and lead to exponential amplification of a gravitational wave train described by certain Newman-Penrose component of the Weyl curvature. In some way akin to a free electron laser in electromagnetic theory, by the conversion of electromagnetic energy into gravitational energy in a coherent way, the feasibility of generating a pulsed laser like intense beam of gravitational wave is displayed.


title: PartialFormer: Modeling Part Instead of Whole for Machine Translation

abstract: The design choices in Transformer feed-forward neural networks have resulted in significant computational and parameter overhead. In this work, we emphasize the importance of hidden dimensions in designing lightweight FFNs, a factor often overlooked in previous architectures. Guided by this principle, we introduce PartialFormer, a parameter-efficient Transformer architecture utilizing multiple smaller FFNs to reduce parameters and computation while maintaining essential hidden dimensions. These smaller FFNs are integrated into a multi-head attention mechanism for effective collaboration. We also propose a tailored head scaling strategy to enhance PartialFormer's capabilities. Furthermore, we present a residual-like attention calculation to improve depth scaling within PartialFormer. Extensive experiments on 9 translation tasks and 1 abstractive summarization task validate the effectiveness of our PartialFormer approach on machine translation and summarization tasks. Our code would be available at: https://github.com/zhengkid/PartialFormer.


title: The Complex Network Patterns of Human Migration at Different Geographical Scales: Network Science meets Regression Analysis

abstract: Migration's influence in shaping population dynamics in times of impending climate and population crises exposes its crucial role in upholding societal cohesion. As migration impacts virtually all aspects of life, it continues to require attention across scientific disciplines. This study delves into two distinctive substrates of Migration Studies: the "why" substrate, which deals with identifying the factors driving migration relying primarily on regression modeling, encompassing economic, demographic, geographic, cultural, political, and other variables; and the "how" substrate, which focuses on identifying migration flows and patterns, drawing from Network Science tools and visualization techniques to depict complex migration networks. Despite the growing percentage of Network Science studies in migration, the explanations of the identified network traits remain very scarce, highlighting the detachment between the two research substrates. Our study includes real-world network analyses of human migration across different geographical levels: city, country, and global. We examine inter-district migration in Vienna at the city level, review internal migration networks in Austria and Croatia at the country level, and analyze migration exchange between Croatia and the world at the global level. By comparing network structures, we demonstrate how distinct network traits impact regression modeling. This work not only uncovers migration network patterns in previously unexplored areas but also presents a comprehensive overview of recent research, highlighting gaps in each field and their interconnectedness. Our contribution offers suggestions for integrating both fields to enhance methodological rigor and support future research.


title: Effects of inorganic seed promoters on MoS2 few-layers grown via chemical vapor deposition

abstract: In the last years, transition metal dichalcogenides (TMDs), especially at the two-dimensional (2D) limit, gained a large interest due to their unique optical and electronic properties. Among them, MoS2 received great attention from the scientific community due to its versatility, workability, and applicability in a large number of fields such as electronics, optoelectronics and electrocatalysis. To open the possibility of 2D-MoS2 exploitation, its synthesis over large macroscopic areas using cost-effective methods is fundamental. In this study, we report a method for the synthesis of large-area (~ cm2) few-layers MoS2 via liquid precursor CVD (L-CVD), where the Mo precursor (i.e. ammonium heptamolybdate AHM) is provided via a solution that is spin-coated over the substrate. Given the capability of organic and inorganic molecules, such as alkaline salts, to enhance MoS2 growth, we investigated the action of different inorganic salts as seed promoters. In particular, by using visible Raman spectroscopy, we focused on the effect of Na(OH), KCl, KI, and Li(OH) on the thickness, morphology, uniformity and degree of coverage of the grown MoS2. We optimized the process tuning parameters such as the volume of spin-coated solution, the growth temperature, and the seed promoter concentration, to synthesise the lowest possible thickness which resulted to be 2 layers (2L) of the highest quality. We witnessed that the addition of an inorganic seed promoter in the solution improves the extension of the grown MoS2 promoting lateral growth front, and therefore the degree of coverage. From this study, we conclude that, amongst the investigated seed promoters, K-based salts proved to grant the growth of high-quality two-layer MoS2 with optimal and uniform coverage of the SiO2/Si substrate surface.


title: Converting Depth Images and Point Clouds for Feature-based Pose Estimation

abstract: In recent years, depth sensors have become more and more affordable and have found their way into a growing amount of robotic systems. However, mono- or multi-modal sensor registration, often a necessary step for further processing, faces many challenges on raw depth images or point clouds. This paper presents a method of converting depth data into images capable of visualizing spatial details that are basically hidden in traditional depth images. After noise removal, a neighborhood of points forms two normal vectors whose difference is encoded into this new conversion. Compared to Bearing Angle images, our method yields brighter, higher-contrast images with more visible contours and more details. We tested feature-based pose estimation of both conversions in a visual odometry task and RGB-D SLAM. For all tested features, AKAZE, ORB, SIFT, and SURF, our new Flexion images yield better results than Bearing Angle images and show great potential to bridge the gap between depth data and classical computer vision. Source code is available here: https://rlsch.github.io/depth-flexion-conversion.


title: Efficient Causal Discovery for Robotics Applications

abstract: Using robots for automating tasks in environments shared with humans, such as warehouses, shopping centres, or hospitals, requires these robots to comprehend the fundamental physical interactions among nearby agents and objects. Specifically, creating models to represent cause-and-effect relationships among these elements can aid in predicting unforeseen human behaviours and anticipate the outcome of particular robot actions. To be suitable for robots, causal analysis must be both fast and accurate, meeting real-time demands and the limited computational resources typical in most robotics applications. In this paper, we present a practical demonstration of our approach for fast and accurate causal analysis, known as Filtered PCMCI (F-PCMCI), along with a real-world robotics application. The provided application illustrates how our F-PCMCI can accurately and promptly reconstruct the causal model of a human-robot interaction scenario, which can then be leveraged to enhance the quality of the interaction.


title: Reference-based Restoration of Digitized Analog Videotapes

abstract: Analog magnetic tapes have been the main video data storage device for several decades. Videos stored on analog videotapes exhibit unique degradation patterns caused by tape aging and reader device malfunctioning that are different from those observed in film and digital video restoration tasks. In this work, we present a reference-based approach for the resToration of digitized Analog videotaPEs (TAPE). We leverage CLIP for zero-shot artifact detection to identify the cleanest frames of each video through textual prompts describing different artifacts. Then, we select the clean frames most similar to the input ones and employ them as references. We design a transformer-based Swin-UNet network that exploits both neighboring and reference frames via our Multi-Reference Spatial Feature Fusion (MRSFF) blocks. MRSFF blocks rely on cross-attention and attention pooling to take advantage of the most useful parts of each reference frame. To address the absence of ground truth in real-world videos, we create a synthetic dataset of videos exhibiting artifacts that closely resemble those commonly found in analog videotapes. Both quantitative and qualitative experiments show the effectiveness of our approach compared to other state-of-the-art methods. The code, the model, and the synthetic dataset are publicly available at https://github.com/miccunifi/TAPE.


title: Neumann semigroup, subgraph convergence, form uniqueness, stochastic completeness and the Feller property

abstract: We study heat kernel convergence of induced subgraphs with Neumann boundary conditions. We first establish convergence of the resulting semigroups to the Neumann semigroup in $\ell^2$. While convergence to the Neumann semigroup always holds, convergence to the Dirichlet semigroup in $\ell^2$ turns out to be equivalent to the coincidence of the Dirichlet and Neumann semigroups while convergence in $\ell^1$ is equivalent to stochastic completeness. We then investigate the Feller property for the Neumann semigroup via generalized solutions and give applications to graphs satisfying a condition on the edges as well as birth-death chains.


title: Unveiling A Core Linguistic Region in Large Language Models

abstract: Brain localization, which describes the association between specific regions of the brain and their corresponding functions, is widely accepted in the field of cognitive science as an objective fact. Today's large language models (LLMs) possess human-level linguistic competence and can execute complex tasks requiring abstract knowledge and reasoning. To deeply understand the inherent mechanisms of intelligence emergence in LLMs, this paper conducts an analogical research using brain localization as a prototype. We have discovered a core region in LLMs that corresponds to linguistic competence, accounting for approximately 1% of the total model parameters. This core region exhibits significant dimension dependency, and perturbations to even a single parameter on specific dimensions can lead to a loss of linguistic competence. Furthermore, we observe that an improvement in linguistic competence does not necessarily accompany an elevation in the model's knowledge level, which might imply the existence of regions of domain knowledge that are dissociated from the linguistic region. Overall, exploring the LLMs' functional regions provides insights into the foundation of their intelligence. In the future, we will continue to investigate knowledge regions within LLMs and the interactions between them.


title: Definitional Functoriality for Dependent (Sub)Types -- Extended version

abstract: Dependently typed proof assistant rely crucially on definitional equality, which relates types and terms that are automatically identified in the underlying type theory. This paper extends type theory with definitional functor laws, equations satisfied propositionally by a large class of container-like type constructors $F : \mathrm{Type} \to \mathrm{Type}$, equipped with a $\mathrm{map}_{F} : (A \to B) \to F\,A \to F\,B$, such as lists or trees. Promoting these equations to definitional ones strengthens the theory, enabling slicker proofs and more automation for functorial type constructors. This extension is used to modularly justify a structural form of coercive subtyping, propagating subtyping through type formers in a map-like fashion. We show that the resulting notion of coercive subtyping, thanks to the extra definitional equations, is equivalent to a natural and implicit form of subsumptive subtyping. The key result of decidability of type-checking in a dependent type system with functor laws for lists has been entirely mechanized in Coq. This is the extended version of the work with the same name published at ESOP'24.


title: Unprovability of First Maxwell's Equation in Light of EPR's Completeness Condition -- A Computational Approach from Logico-linguistic Perspective

abstract: Maxwell's verbal statement of Coulomb's experimental verification of his hypothesis, concerning force between two electrified bodies, is suggestive of a modification of the respective computable expression on logical grounds. This modification is in tandem with the completeness condition for a physical theory, that was stated by Einstein, Podolsky and Rosen in their seminal work. Working with such a modification, I show that the first Maxwell's equation, symbolically identifiable as ``$\vec{\nabla}\cdot\vec{E}=\rho/\epsilon_0$'' from the standard literature, is {\it unprovable}. This renders Poynting's theorem to be {\it unprovable} as well. Therefore, the explanation of `light' as `propagation of electromagnetic energy' comes into question on theoretical grounds.


title: Topological Derivative for Shallow Water Equations

abstract: Coastal erosion is a major and growing environmental problem describing the movement of sand caused by tides, waves or currents. Several phenomena contribute to the significant advance of the sea. These include climate change, with rising sea levels due to the melting of ice at the Earth's poles, the amplification of the tidal effect, leading to the transport of large masses of sand, storms, etc. We contribute to this problem by using topological shape optimization techniques applied to an PDE describing coastal erosion. We use Shallow water equations as a model.


title: Navigating the Ocean with DRL: Path following for marine vessels

abstract: Human error is a substantial factor in marine accidents, accounting for 85% of all reported incidents. By reducing the need for human intervention in vessel navigation, AI-based methods can potentially reduce the risk of accidents. AI techniques, such as Deep Reinforcement Learning (DRL), have the potential to improve vessel navigation in challenging conditions, such as in restricted waterways and in the presence of obstacles. This is because DRL algorithms can optimize multiple objectives, such as path following and collision avoidance, while being more efficient to implement compared to traditional methods. In this study, a DRL agent is trained using the Deep Deterministic Policy Gradient (DDPG) algorithm for path following and waypoint tracking. Furthermore, the trained agent is evaluated against a traditional PD controller with an Integral Line of Sight (ILOS) guidance system for the same. This study uses the Kriso Container Ship (KCS) as a test case for evaluating the performance of different controllers. The ship's dynamics are modeled using the maneuvering Modelling Group (MMG) model. This mathematical simulation is used to train a DRL-based controller and to tune the gains of a traditional PD controller. The simulation environment is also used to assess the controller's effectiveness in the presence of wind.


title: Nuclear mass and size corrections to the magnetic shielding

abstract: We derive finite nuclear mass and finite nuclear size corrections to the magnetic shielding in light ions. These corrections are important for the accurate determination of nuclear magnetic moments. We correct several previous formulas for the nuclear mass corrections and present improved results for the magnetic shielding in $^1$H, $^3$He$^+$, and $^3$He. Finally, we obtain an $^3$He atomic magnetic moment, which serves as an accurate probe to measure magnetic fields.


title: Robust Depth Linear Error Decomposition with Double Total Variation and Nuclear Norm for Dynamic MRI Reconstruction

abstract: Compressed Sensing (CS) significantly speeds up Magnetic Resonance Image (MRI) processing and achieves accurate MRI reconstruction from under-sampled k-space data. According to the current research, there are still several problems with dynamic MRI k-space reconstruction based on CS. 1) There are differences between the Fourier domain and the Image domain, and the differences between MRI processing of different domains need to be considered. 2) As three-dimensional data, dynamic MRI has its spatial-temporal characteristics, which need to calculate the difference and consistency of surface textures while preserving structural integrity and uniqueness. 3) Dynamic MRI reconstruction is time-consuming and computationally resource-dependent. In this paper, we propose a novel robust low-rank dynamic MRI reconstruction optimization model via highly under-sampled and Discrete Fourier Transform (DFT) called the Robust Depth Linear Error Decomposition Model (RDLEDM). Our method mainly includes linear decomposition, double Total Variation (TV), and double Nuclear Norm (NN) regularizations. By adding linear image domain error analysis, the noise is reduced after under-sampled and DFT processing, and the anti-interference ability of the algorithm is enhanced. Double TV and NN regularizations can utilize both spatial-temporal characteristics and explore the complementary relationship between different dimensions in dynamic MRI sequences. In addition, Due to the non-smoothness and non-convexity of TV and NN terms, it is difficult to optimize the unified objective model. To address this issue, we utilize a fast algorithm by solving a primal-dual form of the original problem. Compared with five state-of-the-art methods, extensive experiments on dynamic MRI data demonstrate the superior performance of the proposed method in terms of both reconstruction accuracy and time complexity.


title: Causal machine learning for single-cell genomics

abstract: Advances in single-cell omics allow for unprecedented insights into the transcription profiles of individual cells. When combined with large-scale perturbation screens, through which specific biological mechanisms can be targeted, these technologies allow for measuring the effect of targeted perturbations on the whole transcriptome. These advances provide an opportunity to better understand the causative role of genes in complex biological processes such as gene regulation, disease progression or cellular development. However, the high-dimensional nature of the data, coupled with the intricate complexity of biological systems renders this task nontrivial. Within the machine learning community, there has been a recent increase of interest in causality, with a focus on adapting established causal techniques and algorithms to handle high-dimensional data. In this perspective, we delineate the application of these methodologies within the realm of single-cell genomics and their challenges. We first present the model that underlies most of current causal approaches to single-cell biology and discuss and challenge the assumptions it entails from the biological point of view. We then identify open problems in the application of causal approaches to single-cell data: generalising to unseen environments, learning interpretable models, and learning causal models of dynamics. For each problem, we discuss how various research directions - including the development of computational approaches and the adaptation of experimental protocols - may offer ways forward, or on the contrary pose some difficulties. With the advent of single cell atlases and increasing perturbation data, we expect causal models to become a crucial tool for informed experimental design.


title: Effects of oxygen on the optical properties of phenyl-based scintillators during irradiation and recovery

abstract: Plastic scintillators are a versatile and inexpensive option for particle detection, which is why the largest particle physics experiments, CMS and ATLAS, use them extensively in their calorimeters. One of their challenging aspects, however, is their relatively low radiation hardness, which might be inadequate for very high luminosity future projects like the FCC-hh. In this study, results on the effects of ionizing radiation on the optical properties of plastic scintillator samples are presented. The samples are made from two different matrix materials, polystyrene and polyvinyltoluene, and have been irradiated at dose rates ranging from $2.2\,$Gy/h up to $3.4\,$kGy/h at room temperature. An internal boundary that separates two regions of different indices of refraction is visible in the samples depending on the dose rate, and it is compatible with the expected oxygen penetration depth during irradiation. The dose rate dependence of the oxygen penetration depth for the two matrix materials suggests that the oxygen penetration coefficient differs for PS and PVT. The values of the refractive index for the internal regions are elevated compared to those of the outer regions, which are compatible with the indices of unirradiated samples.


title: On the generalized Friedrichs-Lee model with multiple discrete and continuous states

abstract: In this study, we present several improvements of the non-relativistic Friedrichs-Lee model with multiple discrete and continuous states and still retain its solvability. Our findings establish a solid theoretical basis for the exploration of resonance phenomena in scenarios involving the presence of multiple interfering states across various channels. The scattering amplitudes associated with the continuous states naturally adhere to coupled-channel unitarity, rendering this framework particularly valuable for investigating hadronic resonant states appearing in multiple coupled channels. Moreover, this generalized framework exhibits a wide-range applicability, enabling investigations into resonance phenomena across diverse physical domains, including hadron physics, nuclear physics, optics, and cold atom physics, among others.


title: AI on the Water: Applying DRL to Autonomous Vessel Navigation

abstract: Human decision-making errors cause a majority of globally reported marine accidents. As a result, automation in the marine industry has been gaining more attention in recent years. Obstacle avoidance becomes very challenging for an autonomous surface vehicle in an unknown environment. We explore the feasibility of using Deep Q-Learning (DQN), a deep reinforcement learning approach, for controlling an underactuated autonomous surface vehicle to follow a known path while avoiding collisions with static and dynamic obstacles. The ship's motion is described using a three-degree-of-freedom (3-DOF) dynamic model. The KRISO container ship (KCS) is chosen for this study because it is a benchmark hull used in several studies, and its hydrodynamic coefficients are readily available for numerical modelling. This study shows that Deep Reinforcement Learning (DRL) can achieve path following and collision avoidance successfully and can be a potential candidate that may be investigated further to achieve human-level or even better decision-making for autonomous marine vehicles.


title: Expressivity and Complexity of the Conjunctive Core of the SIGNAL Process Query Language

abstract: This paper presents a formalisation and expressivity and complexity analysis of SIGNAL, an industry-scale query language for analysing business process event logs. The formal analysis shows that the core capabilities of SIGNAL, which we refer to as the SIGNAL Conjunctive Core, are more expressive than relational algebra and thus not captured by standard relational databases. We do provide an upper-bound on the expressiveness via a reduction to semi-positive Datalog, which also leads to an upper bound of P-hard for the data complexity of evaluating SIGNAL Conjunctive Core queries. The findings provide first insights into how real-world process query languages are fundamentally different from the more generally prevalent structured query languages for querying relational databases and provide a rigorous foundation for extending the existing capabilities of the industry-scale state-of-the-art of process data querying.


title: Comparison of path following in ships using modern and traditional controllers

abstract: Vessel navigation is difficult in restricted waterways and in the presence of static and dynamic obstacles. This difficulty can be attributed to the high-level decisions taken by humans during these maneuvers, which is evident from the fact that 85% of the reported marine accidents are traced back to human errors. Artificial intelligence-based methods offer us a way to eliminate human intervention in vessel navigation. Newer methods like Deep Reinforcement Learning (DRL) can optimize multiple objectives like path following and collision avoidance at the same time while being computationally cheaper to implement in comparison to traditional approaches. Before addressing the challenge of collision avoidance along with path following, the performance of DRL-based controllers on the path following task alone must be established. Therefore, this study trains a DRL agent using Proximal Policy Optimization (PPO) algorithm and tests it against a traditional PD controller guided by an Integral Line of Sight (ILOS) guidance system. The Krisco Container Ship (KCS) is chosen to test the different controllers. The ship dynamics are mathematically simulated using the Maneuvering Modelling Group (MMG) model developed by the Japanese. The simulation environment is used to train the deep reinforcement learning-based controller and is also used to tune the gains of the traditional PD controller. The effectiveness of the controllers in the presence of wind is also investigated.


title: Is dynamic dedicated path protection tractable?

abstract: Intractable is the problem of finding two link-disjoint paths of minimal cost if the path cost is limited since it can be a special case of the partition problem. In optical networks, this limit can be introduced by the signal modulation reach. Even without this limit, the existing literature suggested the problem intractable because of the spectrum continuity and contiguity constraints, but we show that the problem can be solved exactly with the recently-proposed generic Dijkstra algorithm over a polynomially-bounded search space, thus proving the problem tractable.


title: Domain Watermark: Effective and Harmless Dataset Copyright Protection is Closed at Hand

abstract: The prosperity of deep neural networks (DNNs) is largely benefited from open-source datasets, based on which users can evaluate and improve their methods. In this paper, we revisit backdoor-based dataset ownership verification (DOV), which is currently the only feasible approach to protect the copyright of open-source datasets. We reveal that these methods are fundamentally harmful given that they could introduce malicious misclassification behaviors to watermarked DNNs by the adversaries. In this paper, we design DOV from another perspective by making watermarked models (trained on the protected dataset) correctly classify some `hard' samples that will be misclassified by the benign model. Our method is inspired by the generalization property of DNNs, where we find a \emph{hardly-generalized domain} for the original dataset (as its \emph{domain watermark}). It can be easily learned with the protected dataset containing modified samples. Specifically, we formulate the domain generation as a bi-level optimization and propose to optimize a set of visually-indistinguishable clean-label modified data with similar effects to domain-watermarked samples from the hardly-generalized domain to ensure watermark stealthiness. We also design a hypothesis-test-guided ownership verification via our domain watermark and provide the theoretical analyses of our method. Extensive experiments on three benchmark datasets are conducted, which verify the effectiveness of our method and its resistance to potential adaptive methods. The code for reproducing main experiments is available at \url{https://github.com/JunfengGo/Domain-Watermark}.


title: Gradient Bounds and Liouville theorems for Quasi-linear equations on compact Manifolds with nonnegative Ricci curvature

abstract: In this work we establish a gradient bound and Liouville-type theorems for solutions to Quasi-linear elliptic equations on compact Riemannian Manifolds with nonnegative Ricci curvature. Also, we provide a local splitting theorem when the inequality in the gradient bound becomes equality at some point. Moreover, we prove a Harnack-type inequality and an ABP estimate for the gradient of solutions in domains contained in the manifold.


title: An Event based Prediction Suffix Tree

abstract: This article introduces the Event based Prediction Suffix Tree (EPST), a biologically inspired, event-based prediction algorithm. The EPST learns a model online based on the statistics of an event based input and can make predictions over multiple overlapping patterns. The EPST uses a representation specific to event based data, defined as a portion of the power set of event subsequences within a short context window. It is explainable, and possesses many promising properties such as fault tolerance, resistance to event noise, as well as the capability for one-shot learning. The computational features of the EPST are examined in a synthetic data prediction task with additive event noise, event jitter, and dropout. The resulting algorithm outputs predicted projections for the near term future of the signal, which may be applied to tasks such as event based anomaly detection or pattern recognition.


title: Computationally Efficient Electromagnetic Transient Power System Studies using Bayesian Optimization

abstract: The power system of the future will be governed by complex interactions and non-linear phenomena, that should be studied more and more through computationally expensive software simulations. To solve the abovementioned problems, power system engineers face problems with following characteristics: (i) a computationally expensive simulator, (ii) non-linear functions to optimize and (iii) lack of abundance of data. Existing optimization settings involving EMT-type simulations have been developed, but mainly use a deterministic model and optimizer, which may be computationally inefficient and do not guarantee finding a global optimum. In this paper, an automation framework based on Bayesian Optimization is introduced, and applied to two case studies. It is found that the framework has the potential to reduce computational effort, outperform deterministic optimizers and is applicable to a multitude of problems. Nevertheless, it was found that the output of the Bayesian Optimization depends on the number of evaluations used for initialization, and in addition, careful selection of surrogate models, which should be subject to future investigation.


title: Intuitive Multilingual Audio-Visual Speech Recognition with a Single-Trained Model

abstract: We present a novel approach to multilingual audio-visual speech recognition tasks by introducing a single model on a multilingual dataset. Motivated by a human cognitive system where humans can intuitively distinguish different languages without any conscious effort or guidance, we propose a model that can capture which language is given as an input speech by distinguishing the inherent similarities and differences between languages. To do so, we design a prompt fine-tuning technique into the largely pre-trained audio-visual representation model so that the network can recognize the language class as well as the speech with the corresponding language. Our work contributes to developing robust and efficient multilingual audio-visual speech recognition systems, reducing the need for language-specific models.


title: System Combination via Quality Estimation for Grammatical Error Correction

abstract: Quality estimation models have been developed to assess the corrections made by grammatical error correction (GEC) models when the reference or gold-standard corrections are not available. An ideal quality estimator can be utilized to combine the outputs of multiple GEC systems by choosing the best subset of edits from the union of all edits proposed by the GEC base systems. However, we found that existing GEC quality estimation models are not good enough in differentiating good corrections from bad ones, resulting in a low F0.5 score when used for system combination. In this paper, we propose GRECO, a new state-of-the-art quality estimation model that gives a better estimate of the quality of a corrected sentence, as indicated by having a higher correlation to the F0.5 score of a corrected sentence. It results in a combined GEC system with a higher F0.5 score. We also propose three methods for utilizing GEC quality estimation models for system combination with varying generality: model-agnostic, model-agnostic with voting bias, and model-dependent method. The combined GEC system outperforms the state of the art on the CoNLL-2014 test set and the BEA-2019 test set, achieving the highest F0.5 scores published to date.


title: Physics-Informed Graph Convolutional Networks: Towards a generalized framework for complex geometries

abstract: Since the seminal work of [9] and their Physics-Informed neural networks (PINNs), many efforts have been conducted towards solving partial differential equations (PDEs) with Deep Learning models. However, some challenges remain, for instance the extension of such models to complex three-dimensional geometries, and a study on how such approaches could be combined to classical numerical solvers. In this work, we justify the use of graph neural networks for these problems, based on the similarity between these architectures and the meshes used in traditional numerical techniques for solving partial differential equations. After proving an issue with the Physics-Informed framework for complex geometries, during the computation of PDE residuals, an alternative procedure is proposed, by combining classical numerical solvers and the Physics-Informed framework. Finally, we propose an implementation of this approach, that we test on a three-dimensional problem on an irregular geometry.


title: Predictive Maintenance Model Based on Anomaly Detection in Induction Motors: A Machine Learning Approach Using Real-Time IoT Data

abstract: With the support of Internet of Things (IoT) devices, it is possible to acquire data from degradation phenomena and design data-driven models to perform anomaly detection in industrial equipment. This approach not only identifies potential anomalies but can also serve as a first step toward building predictive maintenance policies. In this work, we demonstrate a novel anomaly detection system on induction motors used in pumps, compressors, fans, and other industrial machines. This work evaluates a combination of pre-processing techniques and machine learning (ML) models with a low computational cost. We use a combination of pre-processing techniques such as Fast Fourier Transform (FFT), Wavelet Transform (WT), and binning, which are well-known approaches for extracting features from raw data. We also aim to guarantee an optimal balance between multiple conflicting parameters, such as anomaly detection rate, false positive rate, and inference speed of the solution. To this end, multiobjective optimization and analysis are performed on the evaluated models. Pareto-optimal solutions are presented to select which models have the best results regarding classification metrics and computational effort. Differently from most works in this field that use publicly available datasets to validate their models, we propose an end-to-end solution combining low-cost and readily available IoT sensors. The approach is validated by acquiring a custom dataset from induction motors. Also, we fuse vibration, temperature, and noise data from these sensors as the input to the proposed ML model. Therefore, we aim to propose a methodology general enough to be applied in different industrial contexts in the future.


title: Near-Infrared Transmission Spectroscopy of HAT-P-18$\,$b with NIRISS: Disentangling Planetary and Stellar Features in the Era of JWST

abstract: The JWST Early Release Observations (ERO) included a NIRISS/SOSS (0.6-2.8$\,\mu$m) transit of the $\sim\,$850$\,$K Saturn-mass exoplanet HAT-P-18$\,$b. Initial analysis of these data reported detections of water, escaping helium, and haze. However, active K dwarfs like HAT-P-18 possess surface heterogeneities $-$ starspots and faculae $-$ that can complicate the interpretation of transmission spectra, and indeed, a spot-crossing event is present in HAT-P-18$\,$b's NIRISS/SOSS light curves. Here, we present an extensive reanalysis and interpretation of the JWST ERO transmission spectrum of HAT-P-18$\,$b, as well as HST/WFC3 and $\textit{Spitzer}$/IRAC transit observations. We detect H$_2$O (12.5$\,\sigma$), CO$_2$ (7.3$\,\sigma$), a cloud deck (7.4$\,\sigma$), and unocculted starspots (5.8$\,\sigma$), alongside hints of Na (2.7$\,\sigma$). We do not detect the previously reported CH$_4$ ($\log$ CH$_4$ $<$ -6 to 2$\,\sigma$). We obtain excellent agreement between three independent retrieval codes, which find a sub-solar H$_2$O abundance ($\log$ H$_2$O $\approx -4.4 \pm 0.3$). However, the inferred CO$_2$ abundance ($\log$ CO$_2$ $\approx -4.8 \pm 0.4$) is significantly super-solar and requires further investigation into its origin. We also introduce new stellar heterogeneity considerations by fitting for the active regions' surface gravities $-$ a proxy for the effects of magnetic pressure. Finally, we compare our JWST inferences to those from HST/WFC3 and $\textit{Spitzer}$/IRAC. Our results highlight the exceptional promise of simultaneous planetary atmosphere and stellar heterogeneity constraints in the era of JWST and demonstrate that JWST transmission spectra may warrant more complex treatments of the transit light source effect.


title: Overview of Caching Mechanisms to Improve Hadoop Performance

abstract: Nowadays distributed computing environments, large amounts of data are generated from different resources with a high velocity, rendering the data difficult to capture, manage, and process within existing relational databases. Hadoop is a tool to store and process large datasets in a parallel manner across a cluster of machines in a distributed environment. Hadoop brings many benefits like flexibility, scalability, and high fault tolerance; however, it faces some challenges in terms of data access time, I/O operation, and duplicate computations resulting in extra overhead, resource wastage, and poor performance. Many researchers have utilized caching mechanisms to tackle these challenges. For example, they have presented approaches to improve data access time, enhance data locality rate, remove repetitive calculations, reduce the number of I/O operations, decrease the job execution time, and increase resource efficiency. In the current study, we provide a comprehensive overview of caching strategies to improve Hadoop performance. Additionally, a novel classification is introduced based on cache utilization. Using this classification, we analyze the impact on Hadoop performance and discuss the advantages and disadvantages of each group. Finally, a novel hybrid approach called Hybrid Intelligent Cache (HIC) that combines the benefits of two methods from different groups, H-SVM-LRU and CLQLMRS, is presented. Experimental results show that our hybrid method achieves an average improvement of 31.2% in job execution time.


title: 8+8=4: Formalizing Time Units to Handle Symbolic Music Durations

abstract: This paper focuses on the nominal durations of musical events (notes and rests) in a symbolic musical score, and on how to conveniently handle these in computer applications. We propose the usage of a temporal unit that is directly related to the graphical symbols in musical scores and pair this with a set of operations that cover typical computations in music applications. We formalize this time unit and the more commonly used approach in a single mathematical framework, as semirings, algebraic structures that enable an abstract description of algorithms/processing pipelines. We then discuss some practical use cases and highlight when our system can improve such pipelines by making them more efficient in terms of data type used and the number of computations.


title: Interpolation and the Exchange Rule

abstract: It was proved by Maksimova in 1977 that exactly eight varieties of Heyting algebras have the amalgamation property, and hence exactly eight axiomatic extensions of intuitionistic propositional logic have the deductive interpolation property. The prevalence of the deductive interpolation property for axiomatic extensions of substructural logics and the amalgamation property for varieties of pointed residuated lattices, their equivalent algebraic semantics, is far less well understood, however. Taking as our starting point a formulation of intuitionistic propositional logic as the full Lambek calculus with exchange, weakening, and contraction, we investigate the role of the exchange rule--algebraically, the commutativity law--in determining the scope of these properties. First, we show that there are continuum-many varieties of idempotent semilinear residuated lattices that have the amalgamation property and contain non-commutative members, and hence continuum-many axiomatic extensions of the corresponding logic that have the deductive interpolation property in which exchange is not derivable. We then show that, in contrast, exactly sixty varieties of commutative idempotent semilinear residuated lattices have the amalgamation property, and hence exactly sixty axiomatic extensions of the corresponding logic with exchange have the deductive interpolation property. From this latter result, it follows also that there are exactly sixty varieties of commutative idempotent semilinear residuated lattices whose first-order theories have a model completion.


title: Key Frame Mechanism For Efficient Conformer Based End-to-end Speech Recognition

abstract: Recently, Conformer as a backbone network for end-to-end automatic speech recognition achieved state-of-the-art performance. The Conformer block leverages a self-attention mechanism to capture global information, along with a convolutional neural network to capture local information, resulting in improved performance. However, the Conformer-based model encounters an issue with the self-attention mechanism, as computational complexity grows quadratically with the length of the input sequence. Inspired by previous Connectionist Temporal Classification (CTC) guided blank skipping during decoding, we introduce intermediate CTC outputs as guidance into the downsampling procedure of the Conformer encoder. We define the frame with non-blank output as key frame. Specifically, we introduce the key frame-based self-attention (KFSA) mechanism, a novel method to reduce the computation of the self-attention mechanism using key frames. The structure of our proposed approach comprises two encoders. Following the initial encoder, we introduce an intermediate CTC loss function to compute the label frame, enabling us to extract the key frames and blank frames for KFSA. Furthermore, we introduce the key frame-based downsampling (KFDS) mechanism to operate on high-dimensional acoustic features directly and drop the frames corresponding to blank labels, which results in new acoustic feature sequences as input to the second encoder. By using the proposed method, which achieves comparable or higher performance than vanilla Conformer and other similar work such as Efficient Conformer. Meantime, our proposed method can discard more than 60\% useless frames during model training and inference, which will accelerate the inference speed significantly. This work code is available in {https://github.com/scufan1990/Key-Frame-Mechanism-For-Efficient-Conformer}


title: Notes on Gauge Fields and Discrete Series representations in de Sitter spacetimes

abstract: In this note we discuss features of the simplest spinning Discrete Series Unitary Irreducible Representations (UIR) of SO(1,4). These representations are known to be realised in the single particle Hilbert space of a free gauge field propagating in a four dimensional fixed de Sitter background. They showcase distinct features as compared to the more common Principal Series realised by heavy fields. Upon computing the $1-$loop Sphere path integral we show that the \emph{edge modes} of the theory can be understood in terms of a Discrete Series of SO$(1,2)$. We then canonically quantise the theory and show how group theory constrains the mode decomposition. We further clarify the role played by the second SO(4) Casimir in the single particle Hilbert space of the theory.


title: Action of $w_0$ on $V^L$: the special case of $\mathfrak{so}(1,n)$

abstract: In this note, we present an algorithm that allows to answer any individual instance of the following question. Let $G_{\mathbb{R}}$ be a semisimple real Lie group, and $V$ an irreducible representation of $G_{\mathbb{R}}$. How does the longest element $w_0$ of the restricted Weyl group $W$ act on the subspace $V^L$ of $V$ formed by vectors that are invariant by $L$, the centralizer of a maximal split torus of $G_{\mathbb{R}}$? This algorithm comprises two parts. First we describe a complete answer to this question in the particular case where $G_{\mathbb{R}} = \operatorname{SO}(1,n)$ for any $n \geq 2$. Then, for an arbitrary $G_{\mathbb{R}}$, we show that it suffices to do the computation in a well-chosen subgroup $S_{\mathbb{R}} \subset G_{\mathbb{R}}$ which is (up to isogeny) the product of several groups that are either compact, abelian or isomorphic to $\operatorname{SO}(1,n)$ for some $n \geq 2$.


title: XTSC-Bench: Quantitative Benchmarking for Explainers on Time Series Classification

abstract: Despite the growing body of work on explainable machine learning in time series classification (TSC), it remains unclear how to evaluate different explainability methods. Resorting to qualitative assessment and user studies to evaluate explainers for TSC is difficult since humans have difficulties understanding the underlying information contained in time series data. Therefore, a systematic review and quantitative comparison of explanation methods to confirm their correctness becomes crucial. While steps to standardized evaluations were taken for tabular, image, and textual data, benchmarking explainability methods on time series is challenging due to a) traditional metrics not being directly applicable, b) implementation and adaption of traditional metrics for time series in the literature vary, and c) varying baseline implementations. This paper proposes XTSC-Bench, a benchmarking tool providing standardized datasets, models, and metrics for evaluating explanation methods on TSC. We analyze 3 perturbation-, 6 gradient- and 2 example-based explanation methods to TSC showing that improvements in the explainers' robustness and reliability are necessary, especially for multivariate data.


title: Learning Real-World Image De-Weathering with Imperfect Supervision

abstract: Real-world image de-weathering aims at removing various undesirable weather-related artifacts. Owing to the impossibility of capturing image pairs concurrently, existing real-world de-weathering datasets often exhibit inconsistent illumination, position, and textures between the ground-truth images and the input degraded images, resulting in imperfect supervision. Such non-ideal supervision negatively affects the training process of learning-based de-weathering methods. In this work, we attempt to address the problem with a unified solution for various inconsistencies. Specifically, inspired by information bottleneck theory, we first develop a Consistent Label Constructor (CLC) to generate a pseudo-label as consistent as possible with the input degraded image while removing most weather-related degradations. In particular, multiple adjacent frames of the current input are also fed into CLC to enhance the pseudo-label. Then we combine the original imperfect labels and pseudo-labels to jointly supervise the de-weathering model by the proposed Information Allocation Strategy (IAS). During testing, only the de-weathering model is used for inference. Experiments on two real-world de-weathering datasets show that our method helps existing de-weathering models achieve better performance. Codes are available at https://github.com/1180300419/imperfect-deweathering.


title: ShockHash: Near Optimal-Space Minimal Perfect Hashing Beyond Brute-Force

abstract: A minimal perfect hash function (MPHF) maps a set S of n keys to the first n integers without collisions. There is a lower bound of n*log(e)=1.44n bits needed to represent an MPHF. This can be reached by a brute-force algorithm that tries e^n hash function seeds in expectation and stores the first seed leading to an MPHF. The most space-efficient previous algorithms for constructing MPHFs all use such a brute-force approach as a basic building block. In this paper, we introduce ShockHash - Small, heavily overloaded cuckoo hash tables for minimal perfect hashing. ShockHash uses two hash functions h_0 and h_1, hoping for the existence of a function f : S->{0, 1} such that x -> h_{f(x)}(x) is an MPHF on S. It then uses a 1-bit retrieval data structure to store f using n + o(n) bits. In graph terminology, ShockHash generates n-edge random graphs until stumbling on a pseudoforest - where each component contains as many edges as nodes. Using cuckoo hashing, ShockHash then derives an MPHF from the pseudoforest in linear time. We show that ShockHash needs to try only about (e/2)^n=1.359^n seeds in expectation. This reduces the space for storing the seed by roughly n bits (maintaining the asymptotically optimal space consumption) and speeds up construction by almost a factor of 2^n compared to brute-force. Bipartite ShockHash reduces the expected construction time again to 1.166^n by maintaining a pool of candidate hash functions and checking all possible pairs. ShockHash as a building block within the RecSplit framework can be constructed up to 3 orders of magnitude faster than competing approaches. It can build an MPHF for 10 million keys with 1.489 bits per key in about half an hour. When instead using ShockHash after an efficient k-perfect hash function, it achieves space usage similar to the best competitors, while being significantly faster to construct and query.


title: Robust Outlier Detection Method Based on Local Entropy and Global Density

abstract: By now, most outlier-detection algorithms struggle to accurately detect both point anomalies and cluster anomalies simultaneously. Furthermore, a few K-nearest-neighbor-based anomaly-detection methods exhibit excellent performance on many datasets, but their sensitivity to the value of K is a critical issue that needs to be addressed. To address these challenges, we propose a novel robust anomaly detection method, called Entropy Density Ratio Outlier Detection (EDROD). This method incorporates the probability density of each sample as the global feature, and the local entropy around each sample as the local feature, to obtain a comprehensive indicator of abnormality for each sample, which is called Entropy Density Ratio (EDR) for short in this paper. By comparing several competing anomaly detection methods on both synthetic and real-world datasets, it is found that the EDROD method can detect both point anomalies and cluster anomalies simultaneously with accurate performance. In addition, it is also found that the EDROD method exhibits strong robustness to the number of selected neighboring samples, the dimension of samples in the dataset, and the size of the dataset. Therefore, the proposed EDROD method can be applied to a variety of real-world datasets to detect anomalies with accurate and robust performances.


title: StenUNet: Automatic Stenosis Detection from X-ray Coronary Angiography

abstract: Coronary angiography continues to serve as the primary method for diagnosing coronary artery disease (CAD), which is the leading global cause of mortality. The severity of CAD is quantified by the location, degree of narrowing (stenosis), and number of arteries involved. In current practice, this quantification is performed manually using visual inspection and thus suffers from poor inter- and intra-rater reliability. The MICCAI grand challenge: Automatic Region-based Coronary Artery Disease diagnostics using the X-ray angiography imagEs (ARCADE) curated a dataset with stenosis annotations, with the goal of creating an automated stenosis detection algorithm. Using a combination of machine learning and other computer vision techniques, we propose the architecture and algorithm StenUNet to accurately detect stenosis from X-ray Coronary Angiography. Our submission to the ARCADE challenge placed 3rd among all teams. We achieved an F1 score of 0.5348 on the test set, 0.0005 lower than the 2nd place.


title: A mathematical approach to mechanical properties of networks in thermoplastic elastomers

abstract: We employ a mathematical model to analyze stress chains in thermoplastic elastomers (TPEs) with a microphase-separated spherical structure composed of triblock copolymers. The model represents stress chains during uniaxial and biaxial extensions using networks of spherical domains connected by bridges. We advance previous research and discuss permanent strain and other aspects of the network. It explores the dependency of permanent strain on the extension direction, using the average of tension tensors to represent isotropic material behavior. The concept of deviation angle is introduced to measure network anisotropy and is shown to play an essential role in predicting permanent strain when a network is extended in a specific direction. The paper also discusses methods to create a new network structure using various polymers.


title: Studying K-FAC Heuristics by Viewing Adam through a Second-Order Lens

abstract: Research into optimisation for deep learning is characterised by a tension between the computational efficiency of first-order, gradient-based methods (such as SGD and Adam) and the theoretical efficiency of second-order, curvature-based methods (such as quasi-Newton methods and K-FAC). Noting that second-order methods often only function effectively with the addition of stabilising heuristics (such as Levenberg-Marquardt damping), we ask how much these (as opposed to the second-order curvature model) contribute to second-order algorithms' performance. We thus study AdamQLR: an optimiser combining damping and learning rate selection techniques from K-FAC (Martens & Grosse, 2015) with the update directions proposed by Adam, inspired by considering Adam through a second-order lens. We evaluate AdamQLR on a range of regression and classification tasks at various scales and hyperparameter tuning methodologies, concluding K-FAC's adaptive heuristics are of variable standalone general effectiveness, and finding an untuned AdamQLR setting can achieve comparable performance vs runtime to tuned benchmarks.


title: On energy and particle production in cosmology: the particular case of the gravitino

abstract: It is well-known that the number of particles produced in cosmology, commonly defined in the literature from the Fock space of the instantaneous hamiltonian of the canonically normalized fields, is ambiguous. On the other hand, the energy computed from the energy-momentum tensor should be physical. We compare the corresponding Fock spaces and relate them through a Bogolyubov transformation. We find that for particles of spin $0$, $1$ and $3/2$ the two Fock spaces are different, whereas they are the same for spin $1/2$ fermions. For spin $0$ and $1$, for particles of high momenta the two Fock spaces align, as intuitively expected. For the spin $3/2$, one finds two puzzles. The first one is that the two corresponding Fock spaces do not match even in the limit of high momenta. The second is that whereas we provide evidence for the equivalence theorem between longitudinal gravitinos and the goldstino in terms of an exact matching between the lagrangians and the instantaneous hamiltonians for the canonically normalized fields, the energy operator computed from the Rarita--Schwinger action does not seem to be captured in a simple way by the goldstino action. Our results suggest a re-analysis of non-thermal gravitino production in cosmology.


title: Parallel compressive super-resolution imaging with wide field-of-view based on physics enhanced network

abstract: Achieving both high-performance and wide field-of-view (FOV) super-resolution imaging has been attracting increasing attention in recent years. However, such goal suffers from long reconstruction time and huge storage space. Parallel compressive imaging (PCI) provides an efficient solution, but the super-resolution quality and imaging speed are strongly dependent on precise optical transfer function (OTF), modulation masks and reconstruction algorithm. In this work, we propose a wide FOV parallel compressive super-resolution imaging approach based on physics enhanced network. By training the network with the prior OTF of an arbitrary 128x128-pixel region and fine-tuning the network with other OTFs within rest regions of FOV, we realize both mask optimization and super-resolution imaging with up to 1020x1500 wide FOV. Numerical simulations and practical experiments demonstrate the effectiveness and superiority of the proposed approach. We achieve high-quality reconstruction with 4x4 times super-resolution enhancement using only three designed masks to reach real-time imaging speed. The proposed approach promotes the technology of rapid imaging for super-resolution and wide FOV, ranging from infrared to Terahertz.


title: Rational Q-systems at Root of Unity I. Closed Chains

abstract: The solution of Bethe ansatz equations for XXZ spin chain with the parameter $q$ being a root of unity is infamously subtle. In this work, we develop the rational $Q$-system for this case, which offers a systematic way to find all physical solutions of the Bethe ansatz equations at root of unity. The construction contains two parts. In the first part, we impose additional constraints to the rational $Q$-system. These constraints eliminate the so-called Fabricius-McCoy (FM) string solutions, yielding all primitive solutions. In the second part, we give a simple procedure to construct the descendant tower of any given primitive state. The primitive solutions together with their descendant towers constitute the complete Hilbert space. We test our proposal by extensive numerical checks and apply it to compute the torus partition function of the 6-vertex model at root of unity.

categories: hep-th cond-mat.stat-mech math-ph math.MP nlin.SI


title: Nonlinear Optical Effects Due to Magnetization Dynamics In a Ferromagnet

abstract: We theoretically consider magnetization dynamics in a ferromagnetic slab induced by the magnetic field of a strong femtosecond laser pulse. The longitudinal geometry, in which the initial magnetization lies in both the plane of incidence and the sample plane, is studied. The magnetization oscillations at the optical wave frequency are calculated with the use of the Kapitza pendulum approach taking into account that the optical frequency is much greater than the magnetization oscillation eigenfrequency. We study the reflection of the electromagnetic wave from a ferromagnet %with such a dynamics and show that this laser-induced low-frequency magnetization dynamics leads to the appearance of the second-order nonlinearity in the Maxwell's equations, which in turn gives rise to both the second harmonic generation (SHG) and rectification effect. Although the amplitude of the magnetization oscillations is small, the considered effect may be responsible for the SHG with the efficiency comparable to that of nonmagnetic SHG from metal surfaces. Our estimations show that the suggested mechanism may explain the recent experiments on magnetization induced modulation of the SHG intensity in a ``forbidden'' $P_{in}P_{out}$ combination of incident and reflected waves in cobalt/heavy metal systems, where it can be even more pronounced due to the spin current flow through the ferromagnet/ heavy metal interface.


title: Bayesian Active Learning in the Presence of Nuisance Parameters

abstract: In many settings, such as scientific inference, optimization, and transfer learning, the learner has a well-defined objective, which can be treated as estimation of a target parameter, and no intrinsic interest in characterizing the entire data-generating process. Usually, the learner must also contend with additional sources of uncertainty or variables -- with nuisance parameters. Bayesian active learning, or sequential optimal experimental design, can straightforwardly accommodate the presence of nuisance parameters, and so is a natural active learning framework for such problems. However, the introduction of nuisance parameters can lead to bias in the Bayesian learner's estimate of the target parameters, a phenomenon we refer to as negative interference. We characterize the threat of negative interference and how it fundamentally changes the nature of the Bayesian active learner's task. We show that the extent of negative interference can be extremely large, and that accurate estimation of the nuisance parameters is critical to reducing it. The Bayesian active learner is confronted with a dilemma: whether to spend a finite acquisition budget in pursuit of estimation of the target or of the nuisance parameters. Our setting encompasses Bayesian transfer learning as a special case, and our results shed light on the phenomenon of negative transfer between learning environments.


title: Collapse Models: a theoretical, experimental and philosophical review

abstract: n this paper, we review and connect the three essential conditions needed by the collapse model to achieve a complete and exact formulation, namely the theoretical, the experimental, and the ontological ones. These features correspond to the three parts of the paper. In any empirical science, the first two features are obviously connected but, as is well known, among the different formulations and interpretations of non-relativistic quantum mechanics, only collapse models, as the paper well illustrates with a richness of details, have experimental consequences. Finally, we show that a clarification of the ontological intimations of collapse models is needed for at least three reasons: (1) to respond to the indispensable task of answering the question `what are collapse models (and in general any physical theory) about?'; (2) to achieve a deeper understanding of their different formulations; (3) to enlarge the panorama of possible readings of a theory, which historically has often played a fundamental heuristic role.


title: Towards LLM-driven Dialogue State Tracking

abstract: Dialogue State Tracking (DST) is of paramount importance in ensuring accurate tracking of user goals and system actions within task-oriented dialogue systems. The emergence of large language models (LLMs) such as GPT3 and ChatGPT has sparked considerable interest in assessing their efficacy across diverse applications. In this study, we conduct an initial examination of ChatGPT's capabilities in DST. Our evaluation uncovers the exceptional performance of ChatGPT in this task, offering valuable insights to researchers regarding its capabilities and providing useful directions for designing and enhancing dialogue systems. Despite its impressive performance, ChatGPT has significant limitations including its closed-source nature, request restrictions, raising data privacy concerns, and lacking local deployment capabilities. To address these concerns, we present LDST, an LLM-driven DST framework based on smaller, open-source foundation models. By utilizing a novel domain-slot instruction tuning method, LDST achieves performance on par with ChatGPT. Comprehensive evaluations across three distinct experimental settings, we find that LDST exhibits remarkable performance improvements in both zero-shot and few-shot setting compared to previous SOTA methods. The source code is provided for reproducibility.


title: Penalty Decoding: Well Suppress the Self-Reinforcement Effect in Open-Ended Text Generation

abstract: The decoding algorithm is critical for open-ended text generation, transforming latent representations into coherent and meaningful outputs. This paper investigates the self-reinforcement effect in text generation and the effectiveness of a repetition penalty to mitigate it. However, determining the optimal repetition penalty value is challenging. To tackle this, we propose a forgetting mechanism that disregards distant tokens, reducing the burden of penalty selection. In addition, we introduce a length penalty to address overly short sentences caused by excessive penalties. Our penalty decoding approach incorporating three strategies helps resolve issues with sampling methods deviating from factual information. Experimental results demonstrate the efficacy of our approach in generating high-quality sentences resembling human output.


title: Robustness of stress focusing in soft lattices under topology-switching deformation

abstract: Recent developments in topological mechanics have demonstrated the ability of Maxwell lattices to effectively focus stress along domain walls between differently polarized domains. The focusing ability can be exploited to protect the lattice bulk from accidental stress concentration -- and eventually onset and propagation of fracture -- at structural hot spots such as defects and cracks. A recent study has revisited the problem for structural lattices featuring non-ideal hinges, showing that the focusing remains robust, albeit diluted in strength. Realizing that the problem of domain wall localization has been traditionally framed in the context of linear elasticity, in this work we extend the study to the realm of soft structures undergoing nonlinear finite deformation. Through experiments performed on silicone hyperelastic prototypes, we assess and quantify the robustness of the phenomenon against the macroscopic shape changes induced by large deformation, with special attention to deformation levels that alter the topology of the bulk, lifting the topological protection. Furthermore, we identify a simple geometric indicator for this transition.


title: Reconciling Open Interest with Traded Volume in Perpetual Swaps

abstract: Perpetual swaps are derivative contracts that allow traders to speculate on, or hedge, the price movements of cryptocurrencies. Unlike futures contracts, perpetual swaps have no settlement or expiration in the traditional sense. The funding rate acts as the mechanism that tethers the perpetual swap to its underlying with the help of arbitrageurs. Open interest, in the context of perpetual swaps and derivative contracts in general, refers to the total number of outstanding contracts at a given point in time. It is a critical metric in derivatives markets as it can provide insight into market activity, sentiment and overall liquidity. It also provides a way to estimate a lower bound on the collateral required for every cryptocurrency market on an exchange. This number, cumulated across all markets on the exchange in combination with proof of reserves, can be used to gauge whether the exchange in question operates with unsustainable levels of leverage, which could have solvency implications. We find that open interest in Bitcoin perpetual swaps is systematically misquoted by some of the largest derivatives exchanges; however, the degree varies, with some exchanges reporting open interest that is wholly implausible to others that seem to be delaying messages of forced trades, i.e., liquidations. We identify these incongruities by analyzing tick-by-tick data for two time periods in $2023$ by connecting directly to seven of the most liquid cryptocurrency derivatives exchanges.


title: Linear decomposition of approximate multi-controlled single qubit gates

abstract: We provide a method for compiling approximate multi-controlled single qubit gates into quantum circuits without ancilla qubits. The total number of elementary gates to decompose an n-qubit multi-controlled gate is proportional to 32n, and the previous best approximate approach without auxiliary qubits requires 32nk elementary operations, where k is a function that depends on the error threshold. The proposed decomposition depends on an optimization technique that minimizes the CNOT gate count for multi-target and multi-controlled CNOT and SU(2) gates. Computational experiments show the reduction in the number of CNOT gates to apply multi-controlled U(2) gates. As multi-controlled single-qubit gates serve as fundamental components of quantum algorithms, the proposed decomposition offers a comprehensive solution that can significantly decrease the count of elementary operations employed in quantum computing applications.


title: The WHY in Business Processes: Discovery of Causal Execution Dependencies

abstract: Unraveling the causal relationships among the execution of process activities is a crucial element in predicting the consequences of process interventions and making informed decisions regarding process improvements. Process discovery algorithms exploit time precedence as their main source of model derivation. Hence, a causal view can supplement process discovery, being a new perspective in which relations reflect genuine cause-effect dependencies among the tasks. This calls for faithful new techniques to discover the causal execution dependencies among the tasks in the process. To this end, our work offers a systematic approach to the unveiling of the causal business process by leveraging an existing causal discovery algorithm over activity timing. In addition, this work delves into a set of conditions under which process mining discovery algorithms generate a model that is incongruent with the causal business process model, and shows how the latter model can be methodologically employed for a sound analysis of the process. Our methodology searches for such discrepancies between the two models in the context of three causal patterns, and derives a new view in which these inconsistencies are annotated over the mined process model. We demonstrate our methodology employing two open process mining algorithms, the IBM Process Mining tool, and the LiNGAM causal discovery technique. We apply it on a synthesized dataset and on two open benchmark data sets.


title: Reinforcement learning in large, structured action spaces: A simulation study of decision support for spinal cord injury rehabilitation

abstract: Reinforcement learning (RL) has helped improve decision-making in several applications. However, applying traditional RL is challenging in some applications, such as rehabilitation of people with a spinal cord injury (SCI). Among other factors, using RL in this domain is difficult because there are many possible treatments (i.e., large action space) and few patients (i.e., limited training data). Treatments for SCIs have natural groupings, so we propose two approaches to grouping treatments so that an RL agent can learn effectively from limited data. One relies on domain knowledge of SCI rehabilitation and the other learns similarities among treatments using an embedding technique. We then use Fitted Q Iteration to train an agent that learns optimal treatments. Through a simulation study designed to reflect the properties of SCI rehabilitation, we find that both methods can help improve the treatment decisions of physiotherapists, but the approach based on domain knowledge offers better performance. Our findings provide a "proof of concept" that RL can be used to help improve the treatment of those with an SCI and indicates that continued efforts to gather data and apply RL to this domain are worthwhile.


title: Probabilistic Counting in Generalized Turnstile Models

abstract: Traditionally in the turnstile model of data streams, there is a state vector $x=(x_1,x_2,\ldots,x_n)$ which is updated through a stream of pairs $(i,k)$ where $i\in [n]$ and $k\in \Z$. Upon receiving $(i,k)$, $x_i\gets x_i + k$. A distinct count algorithm in the turnstile model takes one pass of the stream and then estimates $\norm{x}_0 = |\{i\in[n]\mid x_i\neq 0\}|$ (aka $L_0$, the Hamming norm). In this paper, we define a finite-field version of the turnstile model. Let $F$ be any finite field. Then in the $F$-turnstile model, for each $i\in [n]$, $x_i\in F$; for each update $(i,k)$, $k\in F$. The update $x_i\gets x_i+k$ is then computed in the field $F$. A distinct count algorithm in the $F$-turnstile model takes one pass of the stream and estimates $\norm{x}_{0;F} = |\{i\in[n]\mid x_i\neq 0_F\}|$. We present a simple distinct count algorithm, called $F$-\pcsa{}, in the $F$-turnstile model for any finite field $F$. The new $F$-\pcsa{} algorithm takes $m\log(n)\log (|F|)$ bits of memory and estimates $\norm{x}_{0;F}$ with $O(\frac{1}{\sqrt{m}})$ relative error where the hidden constant depends on the order of the field. $F$-\pcsa{} is straightforward to implement and has several applications in the real world with different choices of $F$. Most notably, it makes distinct count with deletions as simple as distinct count without deletions.


title: LC-TTFS: Towards Lossless Network Conversion for Spiking Neural Networks with TTFS Coding

abstract: The biological neurons use precise spike times, in addition to the spike firing rate, to communicate with each other. The time-to-first-spike (TTFS) coding is inspired by such biological observation. However, there is a lack of effective solutions for training TTFS-based spiking neural network (SNN). In this paper, we put forward a simple yet effective network conversion algorithm, which is referred to as LC-TTFS, by addressing two main problems that hinder an effective conversion from a high-performance artificial neural network (ANN) to a TTFS-based SNN. We show that our algorithm can achieve a near-perfect mapping between the activation values of an ANN and the spike times of an SNN on a number of challenging AI tasks, including image classification, image reconstruction, and speech enhancement. With TTFS coding, we can achieve up to orders of magnitude saving in computation over ANN and other rate-based SNNs. The study, therefore, paves the way for deploying ultra-low-power TTFS-based SNNs on power-constrained edge computing platforms.


title: ACTOR: Active Learning with Annotator-specific Classification Heads to Embrace Human Label Variation

abstract: Label aggregation such as majority voting is commonly used to resolve annotator disagreement in dataset creation. However, this may disregard minority values and opinions. Recent studies indicate that learning from individual annotations outperforms learning from aggregated labels, though they require a considerable amount of annotation. Active learning, as an annotation cost-saving strategy, has not been fully explored in the context of learning from disagreement. We show that in the active learning setting, a multi-head model performs significantly better than a single-head model in terms of uncertainty estimation. By designing and evaluating acquisition functions with annotator-specific heads on two datasets, we show that group-level entropy works generally well on both datasets. Importantly, it achieves performance in terms of both prediction and uncertainty estimation comparable to full-scale training from disagreement, while saving up to 70% of the annotation budget.