title: Diffeomorphic Transformations for Time Series Analysis: An Efficient Approach to Nonlinear Warping

abstract: The proliferation and ubiquity of temporal data across many disciplines has sparked interest for similarity, classification and clustering methods specifically designed to handle time series data. A core issue when dealing with time series is determining their pairwise similarity, i.e., the degree to which a given time series resembles another. Traditional distance measures such as the Euclidean are not well-suited due to the time-dependent nature of the data. Elastic metrics such as dynamic time warping (DTW) offer a promising approach, but are limited by their computational complexity, non-differentiability and sensitivity to noise and outliers. This thesis proposes novel elastic alignment methods that use parametric \& diffeomorphic warping transformations as a means of overcoming the shortcomings of DTW-based metrics. The proposed method is differentiable \& invertible, well-suited for deep learning architectures, robust to noise and outliers, computationally efficient, and is expressive and flexible enough to capture complex patterns. Furthermore, a closed-form solution was developed for the gradient of these diffeomorphic transformations, which allows an efficient search in the parameter space, leading to better solutions at convergence. Leveraging the benefits of these closed-form diffeomorphic transformations, this thesis proposes a suite of advancements that include: (a) an enhanced temporal transformer network for time series alignment and averaging, (b) a deep-learning based time series classification model to simultaneously align and classify signals with high accuracy, (c) an incremental time series clustering algorithm that is warping-invariant, scalable and can operate under limited computational and time resources, and finally, (d) a normalizing flow model that enhances the flexibility of affine transformations in coupling and autoregressive layers.


title: DeWave: Discrete EEG Waves Encoding for Brain Dynamics to Text Translation

abstract: The translation of brain dynamics into natural language is pivotal for brain-computer interfaces (BCIs). With the swift advancement of large language models, such as ChatGPT, the need to bridge the gap between the brain and languages becomes increasingly pressing. Current methods, however, require eye-tracking fixations or event markers to segment brain dynamics into word-level features, which can restrict the practical application of these systems. To tackle these issues, we introduce a novel framework, DeWave, that integrates discrete encoding sequences into open-vocabulary EEG-to-text translation tasks. DeWave uses a quantized variational encoder to derive discrete codex encoding and align it with pre-trained language models. This discrete codex representation brings forth two advantages: 1) it realizes translation on raw waves without marker by introducing text-EEG contrastive alignment training, and 2) it alleviates the interference caused by individual differences in EEG waves through an invariant discrete codex with or without markers. Our model surpasses the previous baseline (40.1 and 31.7) by 3.06% and 6.34%, respectively, achieving 41.35 BLEU-1 and 33.71 Rouge-F on the ZuCo Dataset. This work is the first to facilitate the translation of entire EEG signal periods without word-level order markers (e.g., eye fixations), scoring 20.5 BLEU-1 and 29.5 Rouge-1 on the ZuCo Dataset.


title: Phase-space iterative solvers

abstract: I introduce a new iterative method to solve problems in small-strain non-linear elasticity. The method is inspired by recent work in data-driven computational mechanics, which reformulated the classic boundary value problem of continuum mechanics using the concept of "phase space". The latter is an abstract metric space, whose coordinates are indexed by strains and stress components, where each possible state of the discretized body corresponds to a point. Since the phase space is associated to the discretized body, it is finite dimensional. Two subsets are then defined: an affine space termed "physically-admissible set" made up by those points that satisfy equilibrium and a "materially-admissible set" containing points that satisfy the constitutive law. Solving the boundary-value problem amounts to finding the intersection between these two subdomains. In the linear-elastic setting, this can be achieved through the solution of a set of linear equations; when material non-linearity enters the picture, such is not the case anymore and iterative solution approaches are necessary. Our iterative method consists on projecting points alternatively from one set to the other, until convergence. The method is similar in spirit to the "method of alternative projections" and to the "method of projections onto convex sets", for which there is a solid mathematical foundation that furnishes conditions for existence and uniqueness of solutions, upon which we rely to uphold our new method's performance. We present two examples to illustrate the applicability of the method, and to showcase its strengths when compared to the classic Newton-Raphson method, the usual tool of choice in non-linear continuum mechanics.


title: DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimization

abstract: Ant Colony Optimization (ACO) is a meta-heuristic algorithm that has been successfully applied to various Combinatorial Optimization Problems (COPs). Traditionally, customizing ACO for a specific problem requires the expert design of knowledge-driven heuristics. In this paper, we propose DeepACO, a generic framework that leverages deep reinforcement learning to automate heuristic designs. DeepACO serves to strengthen the heuristic measures of existing ACO algorithms and dispense with laborious manual design in future ACO applications. As a neural-enhanced meta-heuristic, DeepACO consistently outperforms its ACO counterparts on eight COPs using a single neural architecture and a single set of hyperparameters. As a Neural Combinatorial Optimization method, DeepACO performs better than or on par with problem-specific methods on canonical routing problems. Our code is publicly available at https://github.com/henry-yeh/DeepACO.


title: The Optimal Twisted Paper Cylinder

abstract: A smooth twisted paper cylinder of aspect ratio $\lambda$ is an isometric embedding of a $1 \times \lambda$ cylinder into $\pmb{R}^3$ such that the images of the boundary components are linked. We prove that for such an object to exist we must have $\lambda>2$ and that this bound is sharp. We also show that any sequence of examples having aspect ratio converging to $2$ must converge, up to isometries, to a certain $4$-fold wrapping of a right-angled isosceles triangle.


title: A unified worst case for classical simplex and policy iteration pivot rules

abstract: We construct a family of Markov decision processes for which the policy iteration algorithm needs an exponential number of improving switches with Dantzig's rule, with Bland's rule, and with the Largest Increase pivot rule. This immediately translates to a family of linear programs for which the simplex algorithm needs an exponential number of pivot steps with the same three pivot rules. Our results yield a unified construction that simultaneously reproduces well-known lower bounds for these classical pivot rules, and we are able to infer that any (deterministic or randomized) combination of them cannot avoid an exponential worst-case behavior. Regarding the policy iteration algorithm, pivot rules typically switch multiple edges simultaneously and our lower bound for Dantzig's rule and the Largest Increase rule, which perform only single switches, seem novel. Regarding the simplex algorithm, the individual lower bounds were previously obtained separately via deformed hypercube constructions. In contrast to previous bounds for the simplex algorithm via Markov decision processes, our rigorous analysis is reasonably concise.


title: Applicability and limitations of cluster perturbation theory for Hubbard models

abstract: We present important use cases and limitations when considering results obtained from Cluster Perturbation Theory (CPT). CPT combines the solutions of small individual clusters of an infinite lattice system with the Bloch theory of conventional band theory in order to provide an approximation for the Green's function in the thermodynamic limit. To this end we are investigating single-band and multi-band Hubbard models in one- and two-dimensional systems. A special interest is taken in the supposed pseudo gap regime of the two-dimensional square lattice at half filling and intermediate interaction strength ($U \leq 3t$) as well as the metal-insulator transition. We point out that the finite-size level spacing of the cluster limits the resolution of spectral features within CPT. This restricts the investigation of asymptotic properties of the metal-insulator transition, as it would require much larger cluster sizes that are beyond computational capabilities.


title: Taking the Null-Hypersurface Limit in the Parikh-Wilczek Membrane Approach

abstract: We consider subtleties of the horizon (null-hypersurface) limit in the Parikh-Wilczek Membrane Approach to Black Holes. Specifically, we refine the correspondence between the (projected) Einstein equations of gravity with matter and the Raychaudhuri-Damour-Navier-Stokes (RDNS) equations of relativistic hydrodynamics. For a general configuration of gravity with matter we obtain additional terms in the hydrodynamic equations, which include logarithmic derivarives of a parameter (the regularization function) determining the proximity of a stretched membrane to the BH horizon. Direct computation of the new terms for exact (Schwarzschild and Kerr) solutions to the Einstein equations results in vanishing the additions to the RDNS equations in the horizon limit. For spacetimes, which are not exact solutions to the Einstein equations, as, for instance, for space-time configurations mimicking black holes, taking into account new terms in the RDNS equations is the mandatory operation. We also comment the correspondence between the horizon limit of the Parikh-Wilczek Membrane Approach and the Gourgoulhon-Jaramillo method of a null-hypersurface description, as well as the link of the obtained results to our previous work on the Kerr black holes.


title: An automatic selection of optimal recurrent neural network architecture for processes dynamics modelling purposes

abstract: A problem related to the development of algorithms designed to find the structure of artificial neural network used for behavioural (black-box) modelling of selected dynamic processes has been addressed in this paper. The research has included four original proposals of algorithms dedicated to neural network architecture search. Algorithms have been based on well-known optimisation techniques such as evolutionary algorithms and gradient descent methods. In the presented research an artificial neural network of recurrent type has been used, whose architecture has been selected in an optimised way based on the above-mentioned algorithms. The optimality has been understood as achieving a trade-off between the size of the neural network and its accuracy in capturing the response of the mathematical model under which it has been learnt. During the optimisation, original specialised evolutionary operators have been proposed. The research involved an extended validation study based on data generated from a mathematical model of the fast processes occurring in a pressurised water nuclear reactor.


title: On the convolution equivalence of tempered stable distributions on the real line

abstract: We show the convolution equivalence property of univariate tempered stable distributions in the sense of Rosi\'nsky (2007). This makes rigorous various classic heuristic arguments on the asymptotic similarity between the probability and L\'evy densities of such distributions. Some specific examples from the literature are discussed.


title: Superport networks

abstract: We study multiport networks, common in electrical engineering. They have boundary conditions different from electrical networks: the boundary vertices are split into pairs and the sum of the incoming currents is set to be zero in each pair. If one sets the voltage difference for each pair, then the incoming currents are uniquely determined. We generalize Kirchhoff's matrix-tree theorem to this setup. Different forests now contribute with different signs, making the proof subtle. In particular, we use the formula for the response matrix minors by R. Kenyon-D. Wilson, determinantal identities, and combinatorial bijections. We introduce superport networks, generalizing both ordinary networks and multiport ones.


title: Mixing as a correlated aggregation process

abstract: Mixing describes the process by which solutes evolve from an initial heterogeneous state to uniformity under the stirring action of a fluid flow. Fluid stretching forms thin scalar lamellae which coalesce due to molecular diffusion. Owing to the linearity of the advection-diffusion equation, coalescence can be envisioned as an aggregation process. Here, we demonstrate that in smooth two-dimensional chaotic flows, mixing obeys a correlated aggregation process, where the spatial distribution of the number of lamellae in aggregates is highly correlated with their elongation and is set by the fractal properties of the advected material lines. We show that the presence of correlations makes mixing less efficient than a completely random aggregation process because lamellae with similar elongations and scalar levels tend to remain isolated from each other. We show that correlated aggregation is uniquely determined by a single exponent which quantifies the effective number of random aggregation events. These findings expand aggregation theories to a larger class of systems, which have relevance to various fundamental and applied mixing problems.


title: Beam Charge Asymmetries for Deeply Virtual Compton Scattering on the Proton at CLAS12

abstract: The parameterization of the nucleon structure through Generalized Parton Distributions (GPDs) shed a new light on the nucleon internal dynamics. For its direct interpretation, Deeply Virtual Compton Scattering (DVCS) is the golden channel for GPDs investigation. The DVCS process interferes with the Bethe-Heitler (BH) mechanism to constitute the leading order amplitude of the $eN \to eN\gamma$ process. The study of the $ep\gamma$ reaction with polarized positron and electron beams gives a complete set of unique observables to unravel the different contributions to the $ep \gamma$ cross section. This separates the different reaction amplitudes, providing a direct access to their real and imaginary parts which procures crucial constraints on the model dependences and associated systematic uncertainties on GPDs extraction. The real part of the BH-DVCS interference amplitude is particularly sensitive to the $D$-term which parameterizes the Gravitational Form Factors of the nucleon. The separation of the imaginary parts of the interference and DVCS amplitudes provides insights on possible higher-twist effects. We propose to measure the unpolarized and polarized Beam Charge Asymmetries (BCAs) of the $\vec{e}^{\pm}p \to e^{\pm}p \gamma$ process on an unpolarized hydrogen target with {\tt CLAS12}, using polarized positron and electron beams at 10.6 GeV. The azimuthal and $t$-dependences of the unpolarized and polarized BCAs will be measured over a large $(x_B,Q^2)$ phase space using a 100 day run with a luminosity of 0.66$\times 10^{35}$cm$^{-2}\cdot$s$^{-1}$.


title: Making topologically trivial non-Hermitian systems nontrivial via gauge fields

abstract: Non-Hermiticity significantly enriches the concepts of symmetry and topology in physics. Particularly, non-Hermiticity gives rise to the ramified symmetries, where the non-Hermitian Hamiltonian $H$ is transformed to $H^\dagger$. For time-reversal ($T$) and sublattice symmetries, there are six ramified symmetry classes leading to novel topological classifications with various non-Hermitian skin effects. As artificial crystals are the main experimental platforms for non-Hermitian physics, there exists the symmetry barrier for realizing topological physics in the six ramified symmetry classes: While artificial crystals are in spinless classes with $T^2=1$, nontrivial classifications dominantly appear in spinful classes with $T^2=-1$. Here, we present a general mechanism to cross the symmetry barrier. With an internal parity symmetry $P$, the square of the combination $\tilde{T}=PT$ can be modified by appropriate gauge fluxes. Using the general mechanism, we systematically construct spinless models for all non-Hermitian spinful topological phases in one and two dimensions, which are experimentally realizable. Our work suggests that gauge structures may significantly enrich non-Hermitian physics at the fundamental level.


title: Long-range spectral statistics of the Rosenzweig-Porter model

abstract: The Rosenzweig-Porter model is a single-parameter random matrix ensemble that supports an ergodic, fractal, and localized phase. The names of these phases refer to the properties of the (midspectrum) eigenstates. This work focuses on the long-range spectral statistics of the recently introduced unitary equivalent of this model. By numerically studying the Thouless time obtained from the spectral form factor, it is argued that long-range spectral statistics can be used to probe the transition between the ergodic and the fractal phases. The scaling of the Thouless time as a function of the model parameters is found to be similar to the scaling of the spreading width of the eigenstates. Provided that the transition between the fractal and the localized phases can be probed through short-range level statistics, such as the average ratio of consecutive level spacings, this work establishes that spectral statistics are sufficient to probe both transitions present in the phase diagram.


title: The Accuracy of Job Seekers' Wage Expectations

abstract: Job seekers' misperceptions about the labor market can distort their decision-making and increase the risk of long-term unemployment. Our study establishes objective benchmarks for the subjective wage expectations of unemployed workers. This enables us to provide novel insights into the accuracy of job seekers' wage expectations. First, especially workers with low objective earnings potential tend to display excessively optimistic beliefs about their future wages and anchor their wage expectations too strongly to their pre-unemployment wages. Second, among long-term unemployed workers, overoptimism remains persistent throughout the unemployment spell. Third, higher extrinsic incentives to search more intensively lead job seekers to hold more optimistic wage expectations, yet this does not translate into higher realized wages for them. Lastly, we document a connection between overoptimistic wage expectations and job seekers' tendency to overestimate their reemployment chances. We discuss the role of information frictions and motivated beliefs as potential sources of job seekers' optimism and the heterogeneity in their beliefs.


title: Impacts of Gravitational-Wave Background from Supermassive Black Hole Binaries on the Detection of Compact Binaries by LISA

abstract: In the frequency band of Laser Interferometer Space Antenna (LISA), extensive research has been conducted on the impact of foreground confusion noise generated by galactic binaries within the Milky Way galaxy. Additionally, the recent evidence for a stochastic signal, announced by the NANOGrav, EPTA, PPTA, CPTA and InPTA, indicates that the stochastic gravitational-wave background generated by supermassive black hole binaries (SMBHBs) can contribute a strong background noise within in LISA band. Given the presence of such strong noise, it is expected to have a considerable impacts on LISA's scientific missions. In this work, we investigate the impacts of the SGWB generated by SMBHBs on the detection of massive black hole binaries (MBHBs), verified galactic binaries (VGBs) and extreme mass ratio inspirals (EMRIs) in the context of LISA, and find it crucial to resolve and eliminate the exceed noise from the SGWB to ensure the success of LISA's missions.


title: Diversify and Conquer: Bandits and Diversity for an Enhanced E-commerce Homepage Experience

abstract: In the realm of e-commerce, popular platforms utilize widgets to recommend advertisements and products to their users. However, the prevalence of mobile device usage on these platforms introduces a unique challenge due to the limited screen real estate available. Consequently, the positioning of relevant widgets becomes pivotal in capturing and maintaining customer engagement. Given the restricted screen size of mobile devices, widgets placed at the top of the interface are more prominently displayed and thus attract greater user attention. Conversely, widgets positioned further down the page require users to scroll, resulting in reduced visibility and subsequent lower impression rates. Therefore it becomes imperative to place relevant widgets on top. However, selecting relevant widgets to display is a challenging task as the widgets can be heterogeneous, widgets can be introduced or removed at any given time from the platform. In this work, we model the vertical widget reordering as a contextual multi-arm bandit problem with delayed batch feedback. The objective is to rank the vertical widgets in a personalized manner. We present a two-stage ranking framework that combines contextual bandits with a diversity layer to improve the overall ranking. We demonstrate its effectiveness through offline and online A/B results, conducted on proprietary data from Myntra, a major fashion e-commerce platform in India.


title: Random-Energy Secret Sharing via Extreme Synergy

abstract: The random-energy model (REM), a solvable spin-glass model, has impacted an incredibly diverse set of problems, from protein folding to combinatorial optimization to many-body localization. Here, we explore a new connection to secret sharing. We formulate a secret-sharing scheme, based on the REM, and analyze its information-theoretic properties. Our analyses reveal that the correlations between subsystems of the REM are highly synergistic and form the basis for secure secret-sharing schemes. We derive the ranges of temperatures and secret lengths over which the REM satisfies the requirement of secure secret sharing. We show further that a special point in the phase diagram exists at which the REM-based scheme is optimal in its information encoding. Our analytical results for the thermodynamic limit are in good qualitative agreement with numerical simulations of finite systems, for which the strict security requirement is replaced by a tradeoff between secrecy and recoverability. Our work offers a further example of information theory as a unifying concept, connecting problems in statistical physics to those in computation.

categories: cond-mat.dis-nn cond-mat.stat-mech cs.CR cs.IT math.IT


title: Synchronous Agents, Verification, and Blame -- A Deontic View

abstract: A question we can ask of multi-agent systems is whether the agents' collective interaction satisfies particular goals or specifications, which can be either individual or collective. When a collaborative goal is not reached, or a specification is violated, a pertinent question is whether any agent is to blame. This paper considers a two-agent synchronous setting and a formal language to specify when agents' collaboration is required. We take a deontic approach and use obligations, permissions, and prohibitions to capture notions of non-interference between agents. We also handle reparations, allowing violations to be corrected or compensated. We give trace semantics to our logic, and use it to define blame assignment for violations. We give an automaton construction for the logic, which we use as the base for model checking and blame analysis. We also further provide quantitative semantics that is able to compare different interactions in terms of the required reparations.


title: How Novices Use LLM-Based Code Generators to Solve CS1 Coding Tasks in a Self-Paced Learning Environment

abstract: As Large Language Models (LLMs) gain in popularity, it is important to understand how novice programmers use them. We present a thematic analysis of 33 learners, aged 10-17, independently learning Python through 45 code-authoring tasks using Codex, an LLM-based code generator. We explore several questions related to how learners used these code generators and provide an analysis of the properties of the written prompts and the generated code. Specifically, we explore (A) the context in which learners use Codex, (B) what learners are asking from Codex, (C) properties of their prompts in terms of relation to task description, language, and clarity, and prompt crafting patterns, (D) the correctness, complexity, and accuracy of the AI-generated code, and (E) how learners utilize AI-generated code in terms of placement, verification, and manual modifications. Furthermore, our analysis reveals four distinct coding approaches when writing code with an AI code generator: AI Single Prompt, where learners prompted Codex once to generate the entire solution to a task; AI Step-by-Step, where learners divided the problem into parts and used Codex to generate each part; Hybrid, where learners wrote some of the code themselves and used Codex to generate others; and Manual coding, where learners wrote the code themselves. The AI Single Prompt approach resulted in the highest correctness scores on code-authoring tasks, but the lowest correctness scores on subsequent code-modification tasks during training. Our results provide initial insight into how novice learners use AI code generators and the challenges and opportunities associated with integrating them into self-paced learning environments. We conclude with various signs of over-reliance and self-regulation, as well as opportunities for curriculum and tool development.


title: NNgTL: Neural Network Guided Optimal Temporal Logic Task Planning for Mobile Robots

abstract: In this work, we investigate task planning for mobile robots under linear temporal logic (LTL) specifications. This problem is particularly challenging when robots navigate in continuous workspaces due to the high computational complexity involved. Sampling-based methods have emerged as a promising avenue for addressing this challenge by incrementally constructing random trees, thereby sidestepping the need to explicitly explore the entire state-space. However, the performance of this sampling-based approach hinges crucially on the chosen sampling strategy, and a well-informed heuristic can notably enhance sample efficiency. In this work, we propose a novel neural-network guided (NN-guided) sampling strategy tailored for LTL planning. Specifically, we employ a multi-modal neural network capable of extracting features concurrently from both the workspace and the B\"{u}chi automaton. This neural network generates predictions that serve as guidance for random tree construction, directing the sampling process toward more optimal directions. Through numerical experiments, we compare our approach with existing methods and demonstrate its superior efficiency, requiring less than 15% of the time of the existing methods to find a feasible solution.


title: Point torque representations of ciliary flows

abstract: Ciliary flows are generated by a vast array of eukaryotic organisms, from unicellular algae to mammals, and occur in a range of different geometrical configurations. We employ a point torque -- or `rotlet' -- model to capture the time-averaged ciliary flow above a planar rigid wall. We demonstrate the advantages (i.e. accuracy and computational efficiency) of using this, arguably simpler approach compared to other singularity-based models in Stokes flows. Then, in order to model ciliary flows in confined spaces, we extend the point torque solution to a bounded domain between two plane parallel no-slip walls. The flow field is resolved using the method of images and Fourier transforms, and we analyze the role of confinement by comparing the resultant fluid velocity to that of a rotlet near a single wall. Our results suggest that the flow field of a single cilium is not changed significantly by the confinement, even when the distance between the walls is commensurate with the cilium's length.


title: Single Image Test-Time Adaptation for Segmentation

abstract: Test-Time Adaptation (TTA) methods improve the robustness of deep neural networks to domain shift on a variety of tasks such as image classification or segmentation. This work explores adapting segmentation models to a single unlabelled image with no other data available at test-time. In particular, this work focuses on adaptation by optimizing self-supervised losses at test-time. Multiple baselines based on different principles are evaluated under diverse conditions and a novel adversarial training is introduced for adaptation with mask refinement. Our additions to the baselines result in a 3.51 and 3.28 % increase over non-adapted baselines, without these improvements, the increase would be 1.7 and 2.16 % only.


title: Revisiting LARS for Large Batch Training Generalization of Neural Networks

abstract: This paper explores Large Batch Training techniques using layer-wise adaptive scaling ratio (LARS) across diverse settings, uncovering insights. LARS algorithms with warm-up tend to be trapped in sharp minimizers early on due to redundant ratio scaling. Additionally, a fixed steep decline in the latter phase restricts deep neural networks from effectively navigating early-phase sharp minimizers. Building on these findings, we propose Time Varying LARS (TVLARS), a novel algorithm that replaces warm-up with a configurable sigmoid-like function for robust training in the initial phase. TVLARS promotes gradient exploration early on, surpassing sharp optimizers and gradually transitioning to LARS for robustness in later phases. Extensive experiments demonstrate that TVLARS consistently outperforms LARS and LAMB in most cases, with up to 2\% improvement in classification scenarios. Notably, in all self-supervised learning cases, TVLARS dominates LARS and LAMB with performance improvements of up to 10\%.


title: Adapt then Unlearn: Exploiting Parameter Space Semantics for Unlearning in Generative Adversarial Networks

abstract: The increased attention to regulating the outputs of deep generative models, driven by growing concerns about privacy and regulatory compliance, has highlighted the need for effective control over these models. This necessity arises from instances where generative models produce outputs containing undesirable, offensive, or potentially harmful content. To tackle this challenge, the concept of machine unlearning has emerged, aiming to forget specific learned information or to erase the influence of undesired data subsets from a trained model. The objective of this work is to prevent the generation of outputs containing undesired features from a pre-trained GAN where the underlying training data set is inaccessible. Our approach is inspired by a crucial observation: the parameter space of GANs exhibits meaningful directions that can be leveraged to suppress specific undesired features. However, such directions usually result in the degradation of the quality of generated samples. Our proposed method, known as 'Adapt-then-Unlearn,' excels at unlearning such undesirable features while also maintaining the quality of generated samples. This method unfolds in two stages: in the initial stage, we adapt the pre-trained GAN using negative samples provided by the user, while in the subsequent stage, we focus on unlearning the undesired feature. During the latter phase, we train the pre-trained GAN using positive samples, incorporating a repulsion regularizer. This regularizer encourages the model's parameters to be away from the parameters associated with the adapted model from the first stage while also maintaining the quality of generated samples. To the best of our knowledge, our approach stands as first method addressing unlearning in GANs. We validate the effectiveness of our method through comprehensive experiments.


title: Simultaneous High-Speed and Low-Dose 4-D STEM Using Compressive Sensing Techniques

abstract: Here we show that compressive sensing allow 4-dimensional (4-D) STEM data to be obtained and accurately reconstructed with both high-speed and low fluence. The methodology needed to achieve these results compared to conventional 4-D approaches requires only that a random subset of probe locations is acquired from the typical regular scanning grid, which immediately generates both higher speed and the lower fluence experimentally. We also consider downsampling of the detector, showing that oversampling is inherent within convergent beam electron diffraction (CBED) patterns, and that detector downsampling does not reduce precision but allows faster experimental data acquisition. Analysis of an experimental atomic resolution yttrium silicide data-set shows that it is possible to recover over 25dB peak signal-to-noise in the recovered phase using 0.3% of the total data.


title: Unveiling the dynamical diversity of quantum dot lasers subject to optoelectronic feedback

abstract: This paper investigates experimentally and numerically the nonlinear dynamics of an epitaxial quantum dot laser on silicon subjected to optoelectronic feedback. Experimental results showcase a diverse range of dynamics, encompassing square wave patterns, quasi-chaotic states, and mixed waveforms exhibiting fast and slow oscillations. These measurements unequivocally demonstrate that quantum dot lasers on silicon readily and stably generate a more extensive repertoire of nonlinear dynamics compared to quantum well lasers. This pronounced sensitivity of quantum dot lasers to optoelectronic feedback represents a notable departure from their inherent insensitivity to optical feedback arising from reflections. Moreover, based on the Ikeda-like model, our simulations illustrate that the inherent characteristics of quantum dot lasers on silicon enable rapid and diverse dynamic transformations in response to optoelectronic feedback. The emergence of these exotic dynamics paves the way for further applications like integrated optical clocks, optical logic, and optical computing.


title: Weakly Supervised Semantic Segmentation by Knowledge Graph Inference

abstract: Currently, existing efforts in Weakly Supervised Semantic Segmentation (WSSS) based on Convolutional Neural Networks (CNNs) have predominantly focused on enhancing the multi-label classification network stage, with limited attention given to the equally important downstream segmentation network. Furthermore, CNN-based local convolutions lack the ability to model the extensive inter-category dependencies. Therefore, this paper introduces a graph reasoning-based approach to enhance WSSS. The aim is to improve WSSS holistically by simultaneously enhancing both the multi-label classification and segmentation network stages. In the multi-label classification network segment, external knowledge is integrated, coupled with GCNs, to globally reason about inter-class dependencies. This encourages the network to uncover features in non-salient regions of images, thereby refining the completeness of generated pseudo-labels. In the segmentation network segment, the proposed Graph Reasoning Mapping (GRM) module is employed to leverage knowledge obtained from textual databases, facilitating contextual reasoning for class representation within image regions. This GRM module enhances feature representation in high-level semantics of the segmentation network's local convolutions, while dynamically learning semantic coherence for individual samples. Using solely image-level supervision, we have achieved state-of-the-art performance in WSSS on the PASCAL VOC 2012 and MS-COCO datasets. Extensive experimentation on both the multi-label classification and segmentation network stages underscores the effectiveness of the proposed graph reasoning approach for advancing WSSS.


title: Knot Floer homology and the fundamental group of $ (1,1) $ knots

abstract: We give an algorithm for computing the knot Floer homology of a $ (1,1) $ knot from a particular presentation of its fundamental group.


title: Single-Antenna Jammers in MIMO-OFDM Can Resemble Multi-Antenna Jammers

abstract: In multiple-input multiple-output (MIMO) wireless systems with frequency-flat channels, a single-antenna jammer causes receive interference that is confined to a one-dimensional subspace. Such a jammer can thus be nulled using linear spatial filtering at the cost of one degree of freedom. Frequency-selective channels are often transformed into multiple frequency-flat subcarriers with orthogonal frequency-division multiplexing (OFDM). We show that when a single-antenna jammer violates the OFDM protocol by not sending a cyclic prefix, the interference received on each subcarrier by a multi-antenna receiver is, in general, not confined to a subspace of dimension one (as a single-antenna jammer in a frequency-flat scenario would be), but of dimension L, where L is the jammer's number of channel taps. In MIMO-OFDM systems, a single-antenna jammer can therefore resemble an L-antenna jammer. Simulations corroborate our theoretical results. These findings imply that mitigating jammers with large delay spread through linear spatial filtering is infeasible. We discuss some (im)possibilities for the way forward.


title: Support-based transfer and contacting of individual nanomaterials for in-situ nanoscale investigations

abstract: Although in-situ transmission electron microscopy (TEM) of nanomaterials has been gaining importance in recent years, difficulties in sample preparation have limited the number of studies on electrical properties. Here, a support-based preparation method of individual 1D and 2D materials is presented, which yields a reproducible sample transfer for electrical investigation by in-situ TEM. Using a mechanically rigid support grid allows the reproducible transfer and contacting to in-situ chips by focused ion beam with minimum damage and contamination. The transfer quality is assessed by exemplary studies of different nanomaterials, including a monolayer of WS2. Preliminary results from in-situ test experiments give an overview of possible studies, which concern the interplay between structural properties and electrical characteristics on the individual nanomaterial level as well as failure analysis under electrical current or studies of electromigration, Joule heating and related effects. The TEM measurements can be enriched by additional correlative microscopy techniques, which allow the study with a spatial resolution in the range of a few microns. Although developed for in-situ TEM, the present transfer method is also applicable to transferring nanomaterials to similar chips for performing further studies or even for using them in potential electrical/optoelectronic/sensing devices.


title: Physically consistent gravitational waveform for capturing beyond general relativity effects in the compact object merger phase

abstract: The merger phase of compact binary coalescences is the strongest gravity regime that can be observed. To test the validity of general relativity (GR) in strong gravitational fields, we propose a gravitational waveform parameterized for deviations from GR in the dynamical and nonlinear regime of gravity. Our fundamental idea is that perturbative modifications to a GR waveform can capture possible deviations in the merger phase that are difficult to model in a specific theory of gravity. One of notable points is that our waveform is physically consistent in the sense that the additional radiative losses of energy and angular momentum associated with beyond-GR modifications are included. Our prescription to ensure physical consistency in the whole coalescence process is expected to be applicable to any deviation from the standard model of compact binary coalescence, such as the extended models of gravity or the environmental effects of compact objects, as long as perturbative modifications are considered. Based on the Fisher analysis and the compatibility with Einstein-dilaton Gauss-Bonnet waveforms, we show that our parameterization is a physically-consistent minimal one that captures the deviations in the nonlinear regime.


title: FeCAM: Exploiting the Heterogeneity of Class Distributions in Exemplar-Free Continual Learning

abstract: Exemplar-free class-incremental learning (CIL) poses several challenges since it prohibits the rehearsal of data from previous tasks and thus suffers from catastrophic forgetting. Recent approaches to incrementally learning the classifier by freezing the feature extractor after the first task have gained much attention. In this paper, we explore prototypical networks for CIL, which generate new class prototypes using the frozen feature extractor and classify the features based on the Euclidean distance to the prototypes. In an analysis of the feature distributions of classes, we show that classification based on Euclidean metrics is successful for jointly trained features. However, when learning from non-stationary data, we observe that the Euclidean metric is suboptimal and that feature distributions are heterogeneous. To address this challenge, we revisit the anisotropic Mahalanobis distance for CIL. In addition, we empirically show that modeling the feature covariance relations is better than previous attempts at sampling features from normal distributions and training a linear classifier. Unlike existing methods, our approach generalizes to both many- and few-shot CIL settings, as well as to domain-incremental settings. Interestingly, without updating the backbone network, our method obtains state-of-the-art results on several standard continual learning benchmarks. Code is available at https://github.com/dipamgoswami/FeCAM.


title: Preferential Multi-Target Search in Indoor Environments using Semantic SLAM

abstract: In recent years, the demand for service robots capable of executing tasks beyond autonomous navigation has grown. In the future, service robots will be expected to perform complex tasks like 'Set table for dinner'. High-level tasks like these, require, among other capabilities, the ability to retrieve multiple targets. This paper delves into the challenge of locating multiple targets in an environment, termed 'Find my Objects.' We present a novel heuristic designed to facilitate robots in conducting a preferential search for multiple targets in indoor spaces. Our approach involves a Semantic SLAM framework that combines semantic object recognition with geometric data to generate a multi-layered map. We fuse the semantic maps with probabilistic priors for efficient inferencing. Recognizing the challenges introduced by obstacles that might obscure a navigation goal and render standard point-to-point navigation strategies less viable, our methodology offers resilience to such factors. Importantly, our method is adaptable to various object detectors, RGB-D SLAM techniques, and local navigation planners. We demonstrate the 'Find my Objects' task in real-world indoor environments, yielding quantitative results that attest to the effectiveness of our methodology. This strategy can be applied in scenarios where service robots need to locate, grasp, and transport objects, taking into account user preferences. For a brief summary, please refer to our video: https://tinyurl.com/PrefTargetSearch


title: Helium-Electrospray: an improved sample delivery system for single-particle imaging with X-ray lasers

abstract: Imaging the structure and observing the dynamics of isolated proteins using single-particle X-ray diffractive imaging (SPI) is one of the potential applications of X-ray free-electron lasers (XFELs). Currently, SPI experiments on isolated proteins are limited by three factors: low signal strength, limited data and high background from gas scattering. The last two factors are largely due to the shortcomings of the aerosol sample delivery methods in use. Here we present our modified electrospray ionization (ESI) source, which we dubbed Helium-ESI (He-ESI). With it, we increased particle delivery into the interaction region by a factor of 10, for 26 nm-sized biological particles, and decreased the gas load in the interaction chamber corresponding to an 80% reduction in gas scattering when compared to the original ESI. These improvements will lead to a significant increase in the quality and quantity of SPI diffraction patterns in future experiments using He-ESI, resulting in higher-resolution structures.


title: AsymFormer: Asymmetrical Cross-Modal Representation Learning for Mobile Platform Real-Time RGB-D Semantic Segmentation

abstract: Understanding indoor scenes is crucial for urban studies. Considering the dynamic nature of indoor environments, effective semantic segmentation requires both real-time operation and high accuracy.To address this, we propose AsymFormer, a novel network that improves real-time semantic segmentation accuracy using RGB-D multi-modal information without substantially increasing network complexity. AsymFormer uses an asymmetrical backbone for multimodal feature extraction, reducing redundant parameters by optimizing computational resource distribution. To fuse asymmetric multimodal features, a Local Attention-Guided Feature Selection (LAFS) module is used to selectively fuse features from different modalities by leveraging their dependencies. Subsequently, a Cross-Modal Attention-Guided Feature Correlation Embedding (CMA) module is introduced to further extract cross-modal representations. The AsymFormer demonstrates competitive results with 54.1% mIoU on NYUv2 and 49.1% mIoU on SUNRGBD. Notably, AsymFormer achieves an inference speed of 65 FPS (79 FPS after implementing mixed precision quantization) on RTX3090, demonstrating that AsymFormer can strike a balance between high accuracy and efficiency.


title: (Anti-)BRST Symmetries in FLRW Model: Supervariable Approach

abstract: Friedmann-Lemaitre-Robertson-Walker (FLRW) model, representing the isotropic and homogeneous Universe, has an inherent diffeomorphism (or reparametrization) invariance. For a given local time-reparametrization symmetry transformation of (0+1)-dimensional (1D) diffeomorphism invariant FLRW model, we derive the off-shell nilpotent and absolutely anticommuting (anti-)BRST symmetry transformations in a consistent manner. The supervariable approach to BRST formalism is used as a guiding tool in finding the proper (anti-)BRST transformations. An application of (super-)diffeomorphism invariance, in the context of superspace formalism, yields horizontality conditions. Moreover, the celebrated CF-type condition which is universal for 1D diffeomorphism invariant theories, emerges as an off-shoot of the horizontality condition and provides the absolute anticommutativity of the (anti-)BRST transformations. In addition, this CF-type condition leads to the derivation of coupled (but equivalent) (anti-)BRST invariant quantum Lagrangians for FLRW model. We also capture the geometrical interpretation of the (anti-)BRST transformations and their properties in terms of the Grassmannian translational generators and supervariables.


title: Charge dynamics in the 2D/3D semiconductor heterostructure WSe$_2$/GaAs

abstract: Understanding the relaxation and recombination processes of excited states in two-dimensional (2D)/three-dimensional (3D) semiconductor heterojunctions is essential for developing efficient optical and (opto)electronic devices which integrate new 2D materials with more conventional 3D ones. In this work, we unveil the carrier dynamics and charge transfer in a monolayer of WSe$_2$ on a GaAs substrate. We use time-resolved differential reflectivity to study the charge relaxation processes involved in the junction and how they change when compared to an electrically decoupled heterostructure, WSe$_2$/hBN/GaAs. We observe that the monolayer in direct contact with the GaAs substrate presents longer optically-excited carrier lifetimes (3.5 ns) when compared with the hBN-isolated region (1 ns), consistent with a strong reduction of radiative decay and a fast charge transfer of a single polarity. Through low-temperature measurements, we find evidence of a type-II band alignment for this heterostructure with an exciton dissociation that accumulates electrons in the GaAs and holes in the WSe$_2$. The type-II band alignment and fast photo-excited carrier dissociation shown here indicate that WSe$_2$/GaAs is a promising junction for new photovoltaic and other optoelectronic devices, making use of the best properties of new (2D) and conventional (3D) semiconductors.


title: Soft Mixture Denoising: Beyond the Expressive Bottleneck of Diffusion Models

abstract: Because diffusion models have shown impressive performances in a number of tasks, such as image synthesis, there is a trend in recent works to prove (with certain assumptions) that these models have strong approximation capabilities. In this paper, we show that current diffusion models actually have an expressive bottleneck in backward denoising and some assumption made by existing theoretical guarantees is too strong. Based on this finding, we prove that diffusion models have unbounded errors in both local and global denoising. In light of our theoretical studies, we introduce soft mixture denoising (SMD), an expressive and efficient model for backward denoising. SMD not only permits diffusion models to well approximate any Gaussian mixture distributions in theory, but also is simple and efficient for implementation. Our experiments on multiple image datasets show that SMD significantly improves different types of diffusion models (e.g., DDPM), espeically in the situation of few backward iterations.


title: R\'enyi Topology of Charged-flat Black Hole: Hawking-Page and Van-der-Waals Phase Transitions

abstract: In this paper, we extend the proposed setup in [1,2] for finding the topological charges associated with the Hawking-Page and Van-der-Waals transition points as well as equilibrium phases to catch the nonextensive nature of the black hole entropy, Rigorously speaking we incorporate the R\'enyi statistics formalism in off-shell Bragg-Williams free energy landscape to examine topologically the Hawking-Page phase transition related to the uncharged/charged-flat black hole in grand canonical and the Van-der- Waals transition in the canonical ensemble and where a vortex/anti-vortex structure is found. For this purpose, we introduce three mappings, the $\psi$- and $\xi$-mapping, for phase transitions classification and the $\eta$-mapping for equilibrium phases classification. We found that Hawking-Page and Van-der-Waals phase transitions belong to different topological classes and exhibit an interplay of total charge values hinting to a possible new correspondence. Our topological study provides further substantiation for a possible conjecture positing a correspondence between the thermodynamic characteristics of black holes in asymptotically flat spacetime using R\'enyi statistics, and those in asymptotically Anti-de-Sitter spacetime employing Gibbs-Boltzmann statistics.


title: Scalar and tensor charmonium resonances in coupled-channel scattering from QCD

abstract: We determine $J^{PC}=0^{++}$ and $2^{++}$ hadron-hadron scattering amplitudes in the charmonium energy region up to 4100 MeV using lattice QCD, a first-principles approach to QCD. Working at $m_\pi\approx 391$ MeV, more than 200 finite-volume energy levels are computed and these are used in extensions of the L\"uscher formalism to determine infinite-volume coupled-channel scattering amplitudes. We find that this energy region contains a single $\chi_{c0}$ and a single $\chi_{c2}$ resonance. Both are found as pole singularities on the closest unphysical Riemann sheet, just below 4000 MeV with widths around 70 MeV. The largest couplings are to kinematically-closed $D^* \bar{D}^*$ channels in $S$-wave, and couplings to several decay channels consisting of pairs of open-charm mesons are found to be large and significant in both cases. Above the ground state $\chi_{c0}$, no other scalar bound-states or near-$D\bar{D}$ threshold resonances are found, in contrast to several theoretical and experimental studies.


title: Charmonium $\chi_{c0}$ and $\chi_{c2}$ resonances in coupled-channel scattering from lattice QCD

abstract: In order to explore the spectrum of hidden-charm scalar and tensor resonances, we study meson-meson scattering with $J^{PC}=0^{++}, 2^{++}$ in the charmonium energy region using lattice QCD. Employing a light-quark mass corresponding to $m_\pi \approx 391$ MeV, we determine coupled-channel scattering amplitudes up to around 4100 MeV considering all kinematically relevant channels consisting of a pair of open-charm mesons or a charmonium meson with a light meson. A single isolated scalar resonance near 4000 MeV is found with large couplings to $D\bar{D}$, $D_s \bar{D}_s$ and the kinematically closed $D^* \bar{D}^*$ channel. A single tensor resonance at a similar mass couples strongly to $D\bar{D}$, $D\bar{D}^*$ and $D^* \bar{D}^*$. We compare the extracted resonances to contemporary experimental candidate states, previous lattice results and theoretical modeling. In contrast to several other studies, we do not find any significant feature in the scalar amplitudes between the ground state $\chi_{c0}(1P)$ and the resonance found around 4000 MeV.


title: BoIR: Box-Supervised Instance Representation for Multi-Person Pose Estimation

abstract: Single-stage multi-person human pose estimation (MPPE) methods have shown great performance improvements, but existing methods fail to disentangle features by individual instances under crowded scenes. In this paper, we propose a bounding box-level instance representation learning called BoIR, which simultaneously solves instance detection, instance disentanglement, and instance-keypoint association problems. Our new instance embedding loss provides a learning signal on the entire area of the image with bounding box annotations, achieving globally consistent and disentangled instance representation. Our method exploits multi-task learning of bottom-up keypoint estimation, bounding box regression, and contrastive instance embedding learning, without additional computational cost during inference. BoIR is effective for crowded scenes, outperforming state-of-the-art on COCO val (0.8 AP), COCO test-dev (0.5 AP), CrowdPose (4.9 AP), and OCHuman (3.5 AP). Code will be available at https://github.com/uyoung-jeong/BoIR


title: Maximum Likelihood Estimation of Latent Variable Structural Equation Models: A Neural Network Approach

abstract: We propose a graphical structure for structural equation models that is stable under marginalization under linearity and Gaussianity assumptions. We show that computing the maximum likelihood estimation of this model is equivalent to training a neural network. We implement a GPU-based algorithm that computes the maximum likelihood estimation of these models.


title: FlexCast: genuine overlay-based atomic multicast

abstract: Atomic multicast is a communication abstraction where messages are propagated to groups of processes with reliability and order guarantees. Atomic multicast is at the core of strongly consistent storage and transactional systems. This paper presents FlexCast, the first genuine overlay-based atomic multicast protocol. Genuineness captures the essence of atomic multicast in that only the sender of a message and the message's destinations coordinate to order the message, leading to efficient protocols. Overlay-based protocols restrict how process groups can communicate. Limiting communication leads to simpler protocols and reduces the amount of information each process must keep about the rest of the system. FlexCast implements genuine atomic multicast using a complete DAG overlay. We experimentally evaluate FlexCast in a geographically distributed environment using gTPC-C, a variation of the TPC-C benchmark that takes into account geographical distribution and locality. We show that, by exploiting genuineness and workload locality, FlexCast outperforms well-established atomic multicast protocols without the inherent communication overhead of state-of-the-art non-genuine multicast protocols.


title: Bayesian inference of 3D densities of galactic HI and H2

abstract: Due to our vantage point in the disk of the Galaxy, its 3D structure is not directly accessible. However, knowing the spatial distribution, e.g. of atomic and molecular hydrogen gas is of great importance for interpreting and modelling cosmic ray data and diffuse emission. Using novel Bayesian inference techniques, we reconstruct the 3D densities of atomic and molecular hydrogen in the Galaxy together with (part of) the galactic velocity field. In order to regularise the infinite number of degrees of freedom and obtain information in regions with missing or insufficient data, we incorporate the correlation structure of the gas fields into our prior. Basis for these reconstructions are the data-sets from the HI4PI-survey on the 21-cm emission line and the CO-survey compilation by Dame et al. (2001) on the ($1\rightarrow0$) rotational transition together with a variable gas flow model. We present the preliminary estimated mean surface mass densities and corrections to the prior assumption of the galactic velocity field. In the future, we plan to relax assumptions on the optical thickness and include additional data to further constrain either the galactic velocity field or the gas densities.


title: Spectral Crossovers and Universality in Quantum Spin-chains Coupled to Random Fields

abstract: We study the spectral properties of and spectral-crossovers between different random matrix ensembles (Poissonian, GOE, GUE) in correlated spin-chain systems, in the presence of random magnetic fields, and the scalar spin-chirality term, competing with the usual isotropic and time-reversal invariant Heisenberg term. We have investigated these crossovers in the context of the level-spacing distribution and the level-spacing ratio distribution. We use random matrix theory (RMT) analytical results to fit the observed Poissonian-to-GOE and GOE-to-GUE crossovers, and examine the relationship between the RMT crossover parameter {\lambda} and scaled physical parameters of the spin-chain systems in terms of a scaling exponent. We find that the crossover behavior exhibits universality, in the sense that it becomes independent of lattice size in the large Hamiltonian matrix dimension limit.


title: Second-order optical response of superconductors induced by supercurrent injection

abstract: We develop a theory of the nonlinear optical responses in superconducting systems in the presence of a dc supercurrent. The optical transitions between particle-hole pair bands across the superconducting gap are allowed in clean superconductors as the inversion symmetry breaking by supercurrent. Vertex correction is included in optical conductivity to maintain the $U(1)$ gauge symmetry in the mean-field formalism, which contains the contributions from collective modes. We show two pronounced current-dependent peaks in the second-harmonic generalization $\sigma^{(2)}(2\omega,\omega,\omega)$ at the gap edge $2\hbar\omega=2\Delta$ and $\hbar\omega=2\Delta$ and one in the photocurrent effect $\sigma^{(2)}(0,\omega,-\omega)$ at $\hbar\omega=2\Delta$, all of which diverge in the clean limit. We demonstrate this in the models of a single-band superconductor with $s$-wave and $d$-wave pairings, and Dirac fermion systems with $s$-wave pairing. Our theory predicts that the current-induced peak in $\text{Im}[\sigma^{(2)}(\omega)]$ is proportional to the square of the supercurrent density in the $s$-wave single-band model, with the same order of magnitude as the recent experimental observation of second-harmonic generation in NbN by Nakamura et al. [Phys. Rev. Lett. 125, 097004 (2020)]. Supercurrent induced nonlinear optical spectroscopy provides a valuable toolbox to explore novel superconductors.


title: ODE-based Recurrent Model-free Reinforcement Learning for POMDPs

abstract: Neural ordinary differential equations (ODEs) are widely recognized as the standard for modeling physical mechanisms, which help to perform approximate inference in unknown physical or biological environments. In partially observable (PO) environments, how to infer unseen information from raw observations puzzled the agents. By using a recurrent policy with a compact context, context-based reinforcement learning provides a flexible way to extract unobservable information from historical transitions. To help the agent extract more dynamics-related information, we present a novel ODE-based recurrent model combines with model-free reinforcement learning (RL) framework to solve partially observable Markov decision processes (POMDPs). We experimentally demonstrate the efficacy of our methods across various PO continuous control and meta-RL tasks. Furthermore, our experiments illustrate that our method is robust against irregular observations, owing to the ability of ODEs to model irregularly-sampled time series.


title: Verification of Equivalence of Operator Bases in Unitarity Analysis

abstract: Equivalence theorem is a cornerstone of Standard Model Effective Field Theory, ensuring the equality of the S-matrix and reducing redundant operators. The Warsaw basis and the SILH basis of dimension-6 operators have been shown to be equivalent and connected through equations of motion and field redefinitions, but how to connect the two operator bases in interpreting data is not clear. Through a unitarity analysis we verify that the two operator bases are indeed equivalent, but achieved in a non-trivial way.


title: Analysis and Detection of Pathological Voice using Glottal Source Features

abstract: Automatic detection of voice pathology enables objective assessment and earlier intervention for the diagnosis. This study provides a systematic analysis of glottal source features and investigates their effectiveness in voice pathology detection. Glottal source features are extracted using glottal flows estimated with the quasi-closed phase (QCP) glottal inverse filtering method, using approximate glottal source signals computed with the zero frequency filtering (ZFF) method, and using acoustic voice signals directly. In addition, we propose to derive mel-frequency cepstral coefficients (MFCCs) from the glottal source waveforms computed by QCP and ZFF to effectively capture the variations in glottal source spectra of pathological voice. Experiments were carried out using two databases, the Hospital Universitario Principe de Asturias (HUPA) database and the Saarbrucken Voice Disorders (SVD) database. Analysis of features revealed that the glottal source contains information that discriminates normal and pathological voice. Pathology detection experiments were carried out using support vector machine (SVM). From the detection experiments it was observed that the performance achieved with the studied glottal source features is comparable or better than that of conventional MFCCs and perceptual linear prediction (PLP) features. The best detection performance was achieved when the glottal source features were combined with the conventional MFCCs and PLP features, which indicates the complementary nature of the features.


title: Dunkl-Pauli Equation in the Presence of a Magnetic Field

abstract: The Pauli equation, an important equation of quantum mechanics, allows us to study the dynamics of spin-$1/2$ particles. The Dunkl derivative, when used instead of the ordinary derivative, leads to obtaining parity-dependent solutions. Motivated by these facts, in this work, we consider a two-dimensional nonrelativistic spin-$1/2$ particle system in the presence of an external magnetic field, and we investigate its parity-dependent dynamics by solving the Pauli equation analytically. Next, we assume the system to be in thermal equilibrium, and we examine various thermal quantities of the system.


title: Imposing early and asymptotic constraints on LiGME with application to bivariate nonconvex enhancement of fused lasso models

abstract: For the constrained LiGME model, a nonconvexly regularized least squares estimation model, we present an iterative algorithm of guaranteed convergence to its globally optimal solution. The proposed algorithm can deal with two different types of constraints simultaneously. The first type constraint, called the asymptotic one, requires the limit of estimation sequence to achieve the corresponding condition. The second type constraint, called the early one, requires every vector in estimation sequence to achieve the condition. We also propose a bivariate nonconvex enhancement of fused lasso models with effective constraint for sparse piecewise constant signal estimations. (This is an improved version of [Yata and Yamada, ICASSP 2024].)


title: High-order aberrations of vortex constellations

abstract: When reflected from an interface, a laser beam generally drifts and tilts away from the path predicted by ray optics, an intriguing consequence of its finite transverse extent. Such beam shifts manifest more dramatically for structured light fields, and in particular for optical vortices. Upon reflection, a field containing a high-order optical vortex is expected to experience not only geometrical shifts, but an additional splitting of its high-order vortex into a constellation of unit-charge vortices, a phenomenon known as topological aberration. In this article, we report on the first direct observation of the topological aberration effect, measured through the transformation of a vortex constellation upon reflection. We develop a general theoretical framework to study topological aberrations in terms of the elementary symmetric polynomials of the coordinates of a vortex constellation, a mathematical abstraction which we prove to be the physical quantity of interest. Using this approach, we are able to verify experimentally the aberration of constellations of up to three vortices reflected from a thin metallic film. Our work not only deepens the understanding of the reflection of naturally occurring structured light fields such as vortex constellations but also sets forth a potential method for studying the interaction of twisted light fields with matter.


title: Comprehensive Overview of Named Entity Recognition: Models, Domain-Specific Applications and Challenges

abstract: In the domain of Natural Language Processing (NLP), Named Entity Recognition (NER) stands out as a pivotal mechanism for extracting structured insights from unstructured text. This manuscript offers an exhaustive exploration into the evolving landscape of NER methodologies, blending foundational principles with contemporary AI advancements. Beginning with the rudimentary concepts of NER, the study spans a spectrum of techniques from traditional rule-based strategies to the contemporary marvels of transformer architectures, particularly highlighting integrations such as BERT with LSTM and CNN. The narrative accentuates domain-specific NER models, tailored for intricate areas like finance, legal, and healthcare, emphasizing their specialized adaptability. Additionally, the research delves into cutting-edge paradigms including reinforcement learning, innovative constructs like E-NER, and the interplay of Optical Character Recognition (OCR) in augmenting NER capabilities. Grounding its insights in practical realms, the paper sheds light on the indispensable role of NER in sectors like finance and biomedicine, addressing the unique challenges they present. The conclusion outlines open challenges and avenues, marking this work as a comprehensive guide for those delving into NER research and applications.


title: New algebraic fast algorithms for $N$-body problems in two and three dimensions

abstract: This article presents two new algebraic algorithms to perform fast matrix-vector product for $N$-body problems in $d$ dimensions, namely nHODLR$d$D (nested algorithm) and s-nHODLR$d$D (semi-nested or partially nested algorithm). The nHODLR$d$D and s-nHODLR$d$D algorithms are the nested and semi-nested version of our previously proposed fast algorithm, the hierarchically off-diagonal low-rank matrix in $d$ dimensions (HODLR$d$D), respectively, where the admissible clusters are the certain far-field and the vertex-sharing clusters. We rely on algebraic low-rank approximation techniques (ACA and NCA) and develop both algorithms in a black-box (kernel-independent) fashion. The initialization time of the proposed hierarchical structures scales quasi-linearly. Using the nHODLR$d$D and s-nHODLR$d$D hierarchical structures, one can perform the multiplication of a dense matrix (arising out of $N$-body problems) with a vector that scales as $\mathcal{O}(pN)$ and $\mathcal{O}(pN \log(N))$, respectively, where $p$ grows at most poly logarithmically with $N$. The numerical results in $2$D and $3$D $(d=2,3)$ show that the proposed nHODLR$d$D algorithm is competitive to the algebraic Fast Multipole Method in $d$ dimensions with respect to the matrix-vector product time and space complexity. The C++ implementation with OpenMP parallelization of the proposed algorithms is available at \url{https://github.com/riteshkhan/nHODLRdD/}.


title: A selection of PID type controller settings via LQR approach for two-wheeled balancing robot

abstract: The problem of PID type controller tuning has been addressed in this paper. In particular, a method of selection of PD settings based on the solution of linear-quadratic optimisation problem using the energy criterion has been investigated. Thus, the possibility of transforming optimal settings of the linear-quadratic regulator into the settings of the controller in the classical control system has been given. The presented methodology has been used during synthesis of control system for a two-wheeled balancing robot. Finally, the performance of the proposed control system has been validated by simulation in Matlab-Simulink environment with the use of a two-wheeled balancing robot model.


title: Adaptive Three Layer Hybrid Reconfigurable Intelligent Surface for 6G Wireless Communication: Trade-offs and Performance

abstract: A potential candidate technology for the development of future 6G networks has been recognized as Reconfigurable Intelligent Surface (RIS). However, due to the variation in radio link quality, traditional passive RISs only accomplish a minimal signal gain in situations with strong direct links between user equipment (UE) and base station (BS). In order to get over this fundamental restriction of smaller gain, the idea of active RISs might be a suitable solution. In contrast to current passive RIS, which simply reflects and directs signals without any additional amplification, active RISs have the ability to enhance reflected signals by the incorporation of amplifiers inside its elements. However, with additional amplifiers, apart from the relatively complex attributes of RIS-assisted arrangements, the additional energy consumption of such technologies is often disregarded. So, there might be a tradeoff between the additional energy consumption for the RIS technologies and the overall gain acquired by deploying this potential advancement. The objective of this work is to provide a primary idea of a three-layer hybrid RIS-assisted configuration that is responsive to both active and passive RIS, as well as an additional dormant or inactive state. The single RIS structure should be capable of adjusting its overall configuration in response to fluctuations in transmit power and radio link quality. Furthermore, our fabricated passive RIS-assisted structure verifies a portion of the proposed idea, with simulations highlighting its advantages over standalone passive or active RIS-assisted technologies.


title: REPA: Client Clustering without Training and Data Labels for Improved Federated Learning in Non-IID Settings

abstract: Clustering clients into groups that exhibit relatively homogeneous data distributions represents one of the major means of improving the performance of federated learning (FL) in non-independent and identically distributed (non-IID) data settings. Yet, the applicability of current state-of-the-art approaches remains limited as these approaches cluster clients based on information, such as the evolution of local model parameters, that is only obtainable through actual on-client training. On the other hand, there is a need to make FL models available to clients who are not able to perform the training themselves, as they do not have the processing capabilities required for training, or simply want to use the model without participating in the training. Furthermore, the existing alternative approaches that avert the training still require that individual clients have a sufficient amount of labeled data upon which the clustering is based, essentially assuming that each client is a data annotator. In this paper, we present REPA, an approach to client clustering in non-IID FL settings that requires neither training nor labeled data collection. REPA uses a novel supervised autoencoder-based method to create embeddings that profile a client's underlying data-generating processes without exposing the data to the server and without requiring local training. Our experimental analysis over three different datasets demonstrates that REPA delivers state-of-the-art model performance while expanding the applicability of cluster-based FL to previously uncovered use cases.


title: BiSinger: Bilingual Singing Voice Synthesis

abstract: Although Singing Voice Synthesis (SVS) has made great strides with Text-to-Speech (TTS) techniques, multilingual singing voice modeling remains relatively unexplored. This paper presents BiSinger, a bilingual pop SVS system for English and Chinese Mandarin. Current systems require separate models per language and cannot accurately represent both Chinese and English, hindering code-switch SVS. To address this gap, we design a shared representation between Chinese and English singing voices, achieved by using the CMU dictionary with mapping rules. We fuse monolingual singing datasets with open-source singing voice conversion techniques to generate bilingual singing voices while also exploring the potential use of bilingual speech data. Experiments affirm that our language-independent representation and incorporation of related datasets enable a single model with enhanced performance in English and code-switch SVS while maintaining Chinese song performance. Audio samples are available at https://bisinger-svs.github.io.


title: Convolutional autoencoder-based multimodal one-class classification

abstract: One-class classification refers to approaches of learning using data from a single class only. In this paper, we propose a deep learning one-class classification method suitable for multimodal data, which relies on two convolutional autoencoders jointly trained to reconstruct the positive input data while obtaining the data representations in the latent space as compact as possible. During inference, the distance of the latent representation of an input to the origin can be used as an anomaly score. Experimental results using a multimodal macroinvertebrate image classification dataset show that the proposed multimodal method yields better results as compared to the unimodal approach. Furthermore, study the effect of different input image sizes, and we investigate how recently proposed feature diversity regularizers affect the performance of our approach. We show that such regularizers improve performance.


title: On the Benefit of Optimal Transport for Curriculum Reinforcement Learning

abstract: Curriculum reinforcement learning (CRL) allows solving complex tasks by generating a tailored sequence of learning tasks, starting from easy ones and subsequently increasing their difficulty. Although the potential of curricula in RL has been clearly shown in various works, it is less clear how to generate them for a given learning environment, resulting in various methods aiming to automate this task. In this work, we focus on framing curricula as interpolations between task distributions, which has previously been shown to be a viable approach to CRL. Identifying key issues of existing methods, we frame the generation of a curriculum as a constrained optimal transport problem between task distributions. Benchmarks show that this way of curriculum generation can improve upon existing CRL methods, yielding high performance in various tasks with different characteristics.


title: From OCEL to DOCEL -- Datasets and Automated Transformation

abstract: Object-centric event data represent processes from the point of view of all the involved object types. This perspective has gained interest in recent years as it supports the analysis of processes that previously could not be adequately captured, due to the lack of a clear case notion as well as an increasing amount of output data that needs to be stored. Although publicly available event logs are crucial artifacts for researchers to develop and evaluate novel process mining techniques, the currently available object-centric event logs have limitations in this regard. Specifically, they mainly focus on control-flow and rarely contain objects with attributes that change over time, even though this is not realistic, as the attribute values of objects can be altered during their lifecycle. This paper addresses this gap by providing two means of establishing object-centric datasets with dynamically evolving attributes. First, we provide event log generators, which allow researchers to generate customized, artificial logs with dynamic attributes in the recently proposed DOCEL format. Second, we propose and evaluate an algorithm to convert OCEL logs into DOCEL logs, which involves the detection of event attributes that capture evolving object information and the creation of dynamic attributes from these. Through these contributions, this paper supports the advancement of object-centric process analysis by providing researchers with new means to obtain relevant data to use during the development of new techniques.


title: Nuclear rings are the inner edge of a gap around the Lindblad Resonance

abstract: Gaseous nuclear rings are large-scale coherent structures commonly found at the centres of barred galaxies. We propose that they are an accumulation of gas at the inner edge of an extensive gap that forms around the Inner Lindblad Resonance (ILR). The gap initially opens because the bar potential excites strong trailing waves near the ILR, which remove angular momentum from the gas disc and transport the gas inwards. The gap then widens because the bar potential continuously excites trailing waves at the inner edge of the gap, which remove further angular momentum, moving the edge further inwards until it stops at a distance of several wavelengths from the ILR. The gas accumulating at the inner edge of the gap forms the nuclear ring. The speed at which the gap edge moves and its final distance from the ILR strongly depend on the sound speed, explaining the puzzling dependence of the nuclear ring radius on the sound speed in simulations.


title: VoiceLens: Controllable Speaker Generation and Editing with Flow

abstract: Currently, many multi-speaker speech synthesis and voice conversion systems address speaker variations with an embedding vector. Modeling it directly allows new voices outside of training data to be synthesized. GMM based approaches such as Tacospawn are favored in literature for this generation task, but there are still some limitations when difficult conditionings are involved. In this paper, we propose VoiceLens, a semi-supervised flow-based approach, to model speaker embedding distributions for multi-conditional speaker generation. VoiceLens maps speaker embeddings into a combination of independent attributes and residual information. It allows new voices associated with certain attributes to be \textit{generated} for existing TTS models, and attributes of known voices to be meaningfully \textit{edited}. We show in this paper, VoiceLens displays an unconditional generation capacity that is similar to Tacospawn while obtaining higher controllability and flexibility when used in a conditional manner. In addition, we show synthesizing less noisy speech from known noisy speakers without re-training the TTS model is possible via solely editing their embeddings with a SNR conditioned VoiceLens model. Demos are available at sos1sos2sixteen.github.io/voicelens.


title: Velocity-resolved high-J CO emission from massive star-forming clumps

abstract: (Abridged) Context. Massive star formation is associated with energetic processes, which result in significant gas cooling via far-infrared (IR) lines. Velocity-resolved observations can constrain the kinematics of the gas, allowing the identification of the physical mechanisms responsible for gas heating. Aims. Our aim is to quantify far-infrared CO line emission toward high-mass star-forming regions, identify the high-velocity gas component associated with outflows, and estimate the physical conditions required for the excitation of the observed lines. Methods. Velocity-resolved SOFIA/GREAT spectra of 13 high-mass star forming clumps of various luminosities and evolutionary stages are studied using CO 11-10 and 16-15 lines. Results. All targets show strong high-J CO emission in the far-IR, characterized by broad line wings associated with outflows, thereby significantly increasing the sample of sources with velocity-resolved high-J CO spectra. The contribution of the emission in the line wings does not correlate with the envelope mass or evolutionary stage. Gas rotational temperatures cover a narrow range of 120-220 K for the line wings. The non-LTE radiative transfer models indicate gas densities of 1e5-1e7 cm-3 and N(CO) of 1e17- 1e18 cm-2, similar to physical conditions in deeply-embedded low- and high-mass protostars. The velocity-integrated CO line fluxes correlate with the bolometric luminosity over 7 orders of magnitude including data on the low-mass protostars, suggesting similar processes are responsible for the high-J CO excitation over a significant range of physical scales. Conclusions. Velocity-resolved line profiles allow the detection of outflows toward massive star-forming clumps spanning a broad range of evolutionary stages. The lack of clear evolutionary trends suggest that mass accretion and ejection prevail during the entire lifetime of star-forming clumps.


title: Tracking Control for a Spherical Pendulum via Curriculum Reinforcement Learning

abstract: Reinforcement Learning (RL) allows learning non-trivial robot control laws purely from data. However, many successful applications of RL have relied on ad-hoc regularizations, such as hand-crafted curricula, to regularize the learning performance. In this paper, we pair a recent algorithm for automatically building curricula with RL on massively parallelized simulations to learn a tracking controller for a spherical pendulum on a robotic arm via RL. Through an improved optimization scheme that better respects the non-Euclidean task structure, we allow the method to reliably generate curricula of trajectories to be tracked, resulting in faster and more robust learning compared to an RL baseline that does not exploit this form of structured learning. The learned policy matches the performance of an optimal control baseline on the real system, demonstrating the potential of curriculum RL to jointly learn state estimation and control for non-linear tracking tasks.


title: How do users design scientific workflows? The Case of Snakemake

abstract: Scientific workflows automate the analysis of large-scale scientific data, fostering the reuse of data processing operators as well as the reproducibility and traceability of analysis results. In exploratory research, however, workflows are continuously adapted, utilizing a wide range of tools and software libraries, to test scientific hypotheses. Script-based workflow engines cater to the required flexibility through direct integration of programming primitives but lack abstractions for interactive exploration of the workflow design by a user during workflow execution. To derive requirements for such interactive workflows, we conduct an empirical study on the use of Snakemake, a popular Python-based workflow engine. Based on workflows collected from 1602 GitHub repositories, we present insights on common structures of Snakemake workflows, as well as the language features typically adopted in their specification.


title: Computer Science Framework to Teach Community-Based Environmental Literacy and Data Literacy to Diverse Students

abstract: This study introduces an integrated curriculum designed to empower underrepresented students by combining environmental literacy, data literacy, and computer science. The framework promotes environmental awareness, data literacy, and civic engagement using a culturally sustaining approach. This integrated curriculum is embedded with resources to support language development, technology skills, and coding skills to accommodate the diverse needs of students. To evaluate the effectiveness of this curriculum, we conducted a pilot study in a 5th-grade special education classroom with multilingual Latinx students. During the pilot, students utilized Scratch, a block-based coding language, to create interactive projects that showcased locally collected data, which they used to communicate environmental challenges and propose solutions to community leaders. This approach allowed students to engage with environmental literacy at a deeper level, harnessing their creativity and community knowledge in the digital learning environment. Moreover, this curriculum equipped students with the skills to critically analyze political and socio-cultural factors impacting environmental sustainability. Students not only gained knowledge within the classroom but also applied their learning to address real environmental issues within their community. The results of the pilot study underscore the efficacy of this integrated approach.


title: Counting geodesic loops on surfaces of genus at least 2 without conjugate points

abstract: In this paper we prove asymptotic estimates for closed geodesic loops on compact surfaces with no conjugate points. These generalize the classical counting results of Huber and Margulis and sector theorems for surfaces of strictly negative curvature. We will also prove more general sector theorems, generalizing results of Nicholls and Sharp for special case of surfaces of strictly negative curvature.


title: Dimension of the isometry group in spacetimes with an invariant frame

abstract: The necessary and sufficient conditions for a spacetime with an invariant frame to admit a group of isometries of dimension $r$ are given in terms of the connection tensor $H$ associated with this frame. In Petrov-Bel types I, II and III, and in other spacetimes where an invariant frame algebraically defined by the curvature tensor exists, the connection tensor $H$ is given in terms of the Weyl and Ricci tensors without an explicit determination of the frame. Thus, an IDEAL (intrinsic, deductive, explicit and algorithmic) characterization of these spacetimes follows. Some examples show that this algorithm can be easily implemented on the xAct Mathematica suite of packages.


title: Coulomb potential screening via charged carriers and charge-neutral dipoles/excitons in two-dimensional case

abstract: With the shrink of dimensionality, Coulomb interaction displays a distinct role owing to the reduced dielectric screening in out-of-plane direction. Apart from the dielectric screening, the free charge carriers and/or dipoles can also make nonnegligible contribution to Coulomb interaction. While the Thomas Fermi model is effective in describing charge carrier screening in three dimensions, the extent of screening to two-dimension resulting from charge-neutral dipoles and carriers remains quantitatively unclear. To address this gap, we present a simple analytical solution based on linear response theory, offering a comprehensive depiction of the Coulomb screened potential in both 2D and 3D systems, where screening effects from both charge carriers and charge-neutral dipoles are addressed. Our work provides a handy tool for directly analysing and evaluating Coulomb interaction strength in atomically thin materials and particularly in the context of electronic and optoelectronic engineering. As a demonstration, we utilize the derived modified Coulomb potential for the exciton system to estimate the exciton binding energy variation arising from exciton density fluctuation and the temperature dependent exciton polarizability, yielding excellent agreement with the experimental and computational findings.


title: Normalization of direct citations in publication-level networks: Evaluation of six approaches

abstract: Clustering of publication networks is an efficient way to obtain classifications of large collections of research publications. Such classifications can be used to, e.g., detect research topics, normalize citation relations, or explore the publication output of a unit. Citation networks can be created using a variety of approaches. Best practices to obtain classifications using clustering have been investigated, in particular the performance of different publication-publication relatedness measures. However, evaluation of different approaches to normalization of citation relations have not been explored to the same extent. In this paper, we evaluate five approaches to normalization of direct citation relations with respect to clustering solution quality in four data sets. A sixth approach is evaluated using no normalization. To assess the quality of clustering solutions, we use three measures. (1) We compare the clustering solution to the reference lists of a set of publications using the Adjusted Rand Index. (2) Using the Sihouette width measure, we quantity to which extent the publications have relations to other clusters than the one they have been assigned to. (3) We propose a measure that captures publications that have probably been inaccurately assigned. The results clearly show that normalization is preferred over unnormalized direct citation relations. Furthermore, the results indicate that the fractional normalization approach, which can be considered the standard approach, causes inaccurate assignments. The geometric normalization approach has a similar performance as the fractional approach regarding Adjusted Rand Index and Silhouette width but leads to fewer inaccurate assignments. We therefore believe that the geometric approach may be preferred over the fractional approach.


title: The Upper Clique Transversal Problem

abstract: A clique transversal in a graph is a set of vertices intersecting all maximal cliques. The problem of determining the minimum size of a clique transversal has received considerable attention in the literature. In this paper, we initiate the study of the ''upper'' variant of this parameter, the upper clique transversal number, defined as the maximum size of a minimal clique transversal. We investigate this parameter from the algorithmic and complexity points of view, with a focus on various graph classes. We show that the corresponding decision problem is NP-complete in the classes of chordal graphs, chordal bipartite graphs, cubic planar bipartite graphs, and line graphs of bipartite graphs, but solvable in linear time in the classes of split graphs, proper interval graphs, and cographs, and in polynomial time for graphs of bounded cliquewidth. We conclude the paper with a number of open questions.


title: Affective Game Computing: A Survey

abstract: This paper surveys the current state of the art in affective computing principles, methods and tools as applied to games. We review this emerging field, namely affective game computing, through the lens of the four core phases of the affective loop: game affect elicitation, game affect sensing, game affect detection and game affect adaptation. In addition, we provide a taxonomy of terms, methods and approaches used across the four phases of the affective game loop and situate the field within this taxonomy. We continue with a comprehensive review of available affect data collection methods with regards to gaming interfaces, sensors, annotation protocols, and available corpora. The paper concludes with a discussion on the current limitations of affective game computing and our vision for the most promising future research directions in the field.


title: Lie Groupoids

abstract: A Lie groupoid can be thought of as a generalization of a Lie group in which the multiplication is only defined for certain pairs of elements. From another perspective, Lie groupoids can be regarded as manifolds endowed with a type of action codifying internal and external symmetries. The vigorous development of their theory in the last few decades has been largely stimulated by their connections with such areas as Poisson geometry and non-commutative geometry, as well as several topics in mathematical physics, including classical mechanics, quantization and topological field theories. This article is an overview on Lie groupoids, including basic definitions, key examples and constructions, and topics such as actions and representations, local models, Morita equivalence and cohomology.


title: Performance study update of observations in divergent mode for the Cherenkov Telescope Array

abstract: Due to the limited field of view (FoV) of Cherenkov telescopes, the time needed to achieve target sensitivity for surveys of the extragalactic and Galactic sky is large. To optimize the time spent to perform such surveys, a so-called "divergent mode" of the Cherenkov Telescope Array Observatory (CTAO) was proposed as an alternative observation strategy to the traditional parallel pointing. In the divergent mode, each telescope points to a position in the sky that is slightly offset, in the outward direction, from the original center of the field of view. This bring the advantage of increasing the total instantaneous arrays' FoV. From an enlarged field of view also benefits the search for very-high-energy transient sources, making it possible to cover large sky regions in follow-up observations, or to quickly cover the probability sky map in case of Gamma Ray Bursts (GRB), Gravitational Waves (GW), and other transient events. In this contribution, we present the proposed implementation of the divergent pointing mode and its first preliminary performance estimation for the southern CTAO array.


title: Wav2vec-based Detection and Severity Level Classification of Dysarthria from Speech

abstract: Automatic detection and severity level classification of dysarthria directly from acoustic speech signals can be used as a tool in medical diagnosis. In this work, the pre-trained wav2vec 2.0 model is studied as a feature extractor to build detection and severity level classification systems for dysarthric speech. The experiments were carried out with the popularly used UA-speech database. In the detection experiments, the results revealed that the best performance was obtained using the embeddings from the first layer of the wav2vec model that yielded an absolute improvement of 1.23% in accuracy compared to the best performing baseline feature (spectrogram). In the studied severity level classification task, the results revealed that the embeddings from the final layer gave an absolute improvement of 10.62% in accuracy compared to the best baseline features (mel-frequency cepstral coefficients).


title: A Common Approach to Singular Perturbation and Homogenization II: Semilinear Elliptic Systems

abstract: We consider periodic homogenization of boundary value problems for second-order semilinear elliptic systems in 2D of the type $$ \partial_{x_i}\left(a_{ij}^{\alpha \beta}(x/\varepsilon)\partial_{x_j}u(x)+b_i^\alpha(x,u(x))\right)=b^\alpha(x,u(x)) \mbox{ for } x \in \Omega. $$ For small $\varepsilon>0$ we prove existence of weak solutions $u=u_\varepsilon$ as well as their local uniqueness for $\|u-u_0\|_\infty \approx 0$, where $u_0$ is a given non-degenerate weak solution to the homogenized boundary value problem, and we estimate the rate of convergence to zero of $\|u_\varepsilon-u_0\|_\infty$ for $\varepsilon \to 0$. Our assumptions are, roughly speaking, as follows: The functions $a_{ij}^{\alpha \beta}$ are bounded, measurable and $\mathbb{Z}^2$-periodic, the functions $b_i^\alpha(\cdot,u)$ and $b^\alpha(\cdot,u)$ are bounded and measurable, the functions $b_i^\alpha(x,\cdot)$ and $b^\alpha(x,\cdot)$ are $C^1$-smooth, and $\Omega$ is a bounded Lipschitz domain in $\mathbb{R}^2$. Neither global solution uniqueness is supposed nor growth restrictions of $b_i^\alpha(x,\cdot)$ or $b^\alpha(x,\cdot)$ nor higher regularity of $u_0$, and cross-diffusion is allowed. The main tool of the proofs is an abstract result of implicit function theorem type which in the past has been applied to singularly perturbed nonlinear ODEs and elliptic and parabolic PDEs and, hence, which permits a common approach to existence, local uniqueness and error estimates for singularly perturbed problems and and for homogenization problems.


title: Haha-Pod: An Attempt for Laughter-based Non-Verbal Speaker Verification

abstract: It is widely acknowledged that discriminative representation for speaker verification can be extracted from verbal speech. However, how much speaker information that non-verbal vocalization carries is still a puzzle. This paper explores speaker verification based on the most ubiquitous form of non-verbal voice, laughter. First, we use a semi-automatic pipeline to collect a new Haha-Pod dataset from open-source podcast media. The dataset contains over 240 speakers' laughter clips with corresponding high-quality verbal speech. Second, we propose a Two-Stage Teacher-Student (2S-TS) framework to minimize the within-speaker embedding distance between verbal and non-verbal (laughter) signals. Considering Haha-Pod as a test set, two trials (S2L-Eval) are designed to verify the speaker's identity through laugh sounds. Experimental results demonstrate that our method can significantly improve the performance of the S2L-Eval test set with only a minor degradation on the VoxCeleb1 test set. The resources for the Haha-Pod dataset can be found at https://github.com/nevermoreLin/HahaPod.