title: FFT: Towards Harmlessness Evaluation and Analysis for LLMs with Factuality, Fairness, Toxicity

abstract: The widespread of generative artificial intelligence has heightened concerns about the potential harms posed by AI-generated texts, primarily stemming from factoid, unfair, and toxic content. Previous researchers have invested much effort in assessing the harmlessness of generative language models. However, existing benchmarks are struggling in the era of large language models (LLMs), due to the stronger language generation and instruction following capabilities, as well as wider applications. In this paper, we propose FFT, a new benchmark with 2116 elaborated-designed instances, for LLM harmlessness evaluation with factuality, fairness, and toxicity. To investigate the potential harms of LLMs, we evaluate 9 representative LLMs covering various parameter scales, training stages, and creators. Experiments show that the harmlessness of LLMs is still under-satisfactory, and extensive analysis derives some insightful findings that could inspire future research for harmless LLM research.


title: A characterization of capillary spherical caps by a partially overdetermined problem in a half ball

abstract: In this note, we study a Serrin-type partially overdetermined problem proposed by Guo-Xia (Calc. Var. Partial Differential Equations 58: no. 160, 2019. https://doi.org/10.1007/s00526-019-1603-3, and prove a rigidity result that characterizes capillary spherical caps in a half ball.


title: On weakly Einstein submanifolds in space forms satisfying certain equalities

abstract: We classify weakly Einstein submanifolds in space forms that satisfy Chen's equality. We also give a classification of weakly Einstein hypersurfaces in space forms that satisfy the semisymmetric condition. In addition, we discuss some characterizations of weakly Einstein submanifolds in space forms whose normal connection is flat.


title: Antiferromagnetic droplet soliton driven by spin current

abstract: We demonstrate that a spin current flowing through a nano-contact into a uniaxial antiferromagnet with first- and second-order anisotropy can excite a self-localized dynamic magnetic soliton, known as a spin-wave droplet in ferromagnets. The droplet nucleates at a certain threshold current with the frequency of the N\'eel vector precession laying below the antiferromagnetic resonance. The frequency exhibits nonlinear behavior with the increasing of applied current. At the high value of applied torque, the soliton mode transforms, and the oscillator emits spin waves propagating in the antiferromagnetic layer.


title: First-order multivariate integer-valued autoregressive model with multivariate mixture distributions

abstract: The univariate integer-valued time series has been extensively studied, but literature on multivariate integer-valued time series models is quite limited and the complex correlation structure among the multivariate integer-valued time series is barely discussed. In this study, we proposed a first-order multivariate integer-valued autoregressive model to characterize the correlation among multivariate integer-valued time series with higher flexibility. Under the general conditions, we established the stationarity and ergodicity of the proposed model. With the proposed method, we discussed the models with multivariate Poisson-lognormal distribution and multivariate geometric-logitnormal distribution and the corresponding properties. The estimation method based on EM algorithm was developed for the model parameters and extensive simulation studies were performed to evaluate the effectiveness of proposed estimation method. Finally, a real crime data was analyzed to demonstrate the advantage of the proposed model with comparison to the other models.


title: Rigidity and quantitative stability for partially overdetermined problems and capillary CMC hypersurfaces

abstract: In this paper, we first prove a rigidity result for a Serrin-type partially overdetermined problem in the half-space, which gives a characterization of capillary spherical caps by the overdetermined problem. In the second part, we prove quantitative stability results for the Serrin-type partially overdetermined problem, as well as capillary almost constant mean curvature hypersurfaces in the half-space.


title: Local Minimizers of Nonconvex Functions in Banach Spaces via Moreau Envelopes

abstract: This paper investigates the preservation of local minimizers and strong minimizers of extended-real-valued lower semicontinuous functions under taking their Moreau envelopes. We address a general setting of Banach spaces, while all the obtained results are new even for functions in finite dimensions. Our main motivation came from applications to numerical methods in nonsmooth optimization dealing with broad classes of nondifferentiable and nonconvex functions. The paper also formulates and discusses some open questions stemming from this study.


title: Continuous 16-bit Training: Accelerating 32-bit Pre-Trained Neural Networks

abstract: In the field of deep learning, the prevalence of models initially trained with 32-bit precision is a testament to its robustness and accuracy. However, the continuous evolution of these models often demands further training, which can be resource-intensive. This study introduces a novel approach where we continue the training of these pre-existing 32-bit models using 16-bit precision. This technique not only caters to the need for efficiency in computational resources but also significantly improves the speed of additional training phases. By adopting 16-bit precision for ongoing training, we are able to substantially decrease memory requirements and computational burden, thereby accelerating the training process in a resource-limited setting. Our experiments show that this method maintains the high standards of accuracy set by the original 32-bit training while providing a much-needed boost in training speed. This approach is especially pertinent in today's context, where most models are initially trained in 32-bit and require periodic updates and refinements. The findings from our research suggest that this strategy of 16-bit continuation training can be a key solution for sustainable and efficient deep learning, offering a practical way to enhance pre-trained models rapidly and in a resource-conscious manner.


title: Optimizing ZX-Diagrams with Deep Reinforcement Learning

abstract: ZX-diagrams are a powerful graphical language for the description of quantum processes with applications in fundamental quantum mechanics, quantum circuit optimization, tensor network simulation, and many more. The utility of ZX-diagrams relies on a set of local transformation rules that can be applied to them without changing the underlying quantum process they describe. These rules can be exploited to optimize the structure of ZX-diagrams for a range of applications. However, finding an optimal sequence of transformation rules is generally an open problem. In this work, we bring together ZX-diagrams with reinforcement learning, a machine learning technique designed to discover an optimal sequence of actions in a decision-making problem and show that a trained reinforcement learning agent can significantly outperform other optimization techniques like a greedy strategy or simulated annealing. The use of graph neural networks to encode the policy of the agent enables generalization to diagrams much bigger than seen during the training phase.


title: Yang-Mills algebra and symmetry transformations of vertex operators

abstract: Linearized solutions of SUGRA equations of motion are described in the pure spinor formalism by vertex operators. Under supersymmetry transformations, they transform covariantly only up to BRST exact terms. We identify the cohomology class which is the obstacle for exact covariance. Computations are simplified by using the formalism of quadratic algebras.


title: Suppression of blow-up in 3-D Keller-Segel model via Couette flow in whole space

abstract: In this paper, we study the 3-D parabolic-parabolic and parabolic-elliptic Keller-Segel models with Couette flow in $\mathbb{R}^3$. We prove that the blow-up phenomenon of solution can be suppressed by enhanced dissipation of large Couette flows. Here we develop Green's function method to describe the enhanced dissipation via a more precise space-time structure and obtain the global existence together with pointwise estimates of the solutions. The result of this paper shows that the enhanced dissipation exists for all frequencies in the case of whole space and it is reason that we obtain global existence for 3-D Keller-Segel models here. It is totally different from the case with the periodic spatial variable $x$ in [2,10]. This paper provides a new methodology to capture dissipation enhancement and also a surprising result which shows a totally new mechanism.


title: A note on $L^p$-factorizations of representations

abstract: In this paper we give an overview on $L^p$-factorizations of Lie group representations and introduce the notion of smooth $L^p$-factorization.


title: Semantic-Aware Frame-Event Fusion based Pattern Recognition via Large Vision-Language Models

abstract: Pattern recognition through the fusion of RGB frames and Event streams has emerged as a novel research area in recent years. Current methods typically employ backbone networks to individually extract the features of RGB frames and event streams, and subsequently fuse these features for pattern recognition. However, we posit that these methods may suffer from key issues like sematic gaps and small-scale backbone networks. In this study, we introduce a novel pattern recognition framework that consolidates the semantic labels, RGB frames, and event streams, leveraging pre-trained large-scale vision-language models. Specifically, given the input RGB frames, event streams, and all the predefined semantic labels, we employ a pre-trained large-scale vision model (CLIP vision encoder) to extract the RGB and event features. To handle the semantic labels, we initially convert them into language descriptions through prompt engineering, and then obtain the semantic features using the pre-trained large-scale language model (CLIP text encoder). Subsequently, we integrate the RGB/Event features and semantic features using multimodal Transformer networks. The resulting frame and event tokens are further amplified using self-attention layers. Concurrently, we propose to enhance the interactions between text tokens and RGB/Event tokens via cross-attention. Finally, we consolidate all three modalities using self-attention and feed-forward layers for recognition. Comprehensive experiments on the HARDVS and PokerEvent datasets fully substantiate the efficacy of our proposed SAFE model. The source code will be made available at https://github.com/Event-AHU/SAFE_LargeVLM.


title: A New Old Idea: Beam-Steering Reflectarrays for Efficient Sub-THz Multiuser MIMO

abstract: We present a novel, power- & hardware-efficient, multiuser, multibeam RIS (Reflective Intelligent Surface) architecture for multiuser MIMO, especially for very high frequency bands (e.g., high mmWave and sub-THz), where channels are typically sparse in the beamspace and LOS is the dominant component. The key module is formed by an active multiantenna feeder (AMAF) with a small number of active antennas, placed in the near field of a RIS with a much larger number of passive controllable reflecting elements. We propose a pragmatic approach to obtain a steerable beam with high gain and very low sidelobes. Then K independently controlled beams can be achieved by closely stacking K such AMAF-RIS modules. Our analysis includes the mutual interference between the modules and the fact that, due to the delay difference of propagation through the AMAF-RIS structure, the resulting channel matrix is frequency selective even for pure LOS propagation. We consider a 3D geometry and show that "beam focusing" is in fact possible (and much more effective in terms of coverage) also in the far-field, by creating spotbeams with limited footprint both in angle and in range. Our results show that: 1) simple RF beamforming (BF) without computationally expensive baseband multiuser precoding is sufficient to practically eliminate multiuser interference when the users are chosen with sufficient angular/range separation, thanks to the extremely low sidelobe beams; 2) the impact of beam pointing errors with standard deviation as large as 2.5 deg and RIS quantized phase-shifters with quantization bits > 2 is essentially negligible; 3) The proposed architecture is more power efficient & much simpler from a hardware implementation viewpoint than standard active arrays with the same BF performance. We show also that the array gain of the proposed AMAF-RIS structure is linear with the RIS aperture.


title: Stable homology of Lie algebras of derivations and homotopy invariants of wheeled operads

abstract: We prove a theorem that computes, for any augmented operad $\mathcal{O}$, the stable homology of the Lie algebra of derivations of the free algebra $\mathcal{O}(V)$ with twisted bivariant coefficients (which can be used to prove uniform mixed representation stability for the homology with constant coefficients of the positive part of that Lie algebra) out of the homology of wheeled bar construction of $\mathcal{O}$. This generalizes both the Loday-Quillen-Tsygan theorem on the homology of the Lie algebra of infinite matrices and the Fuchs stability theorem for the homology of the Lie algebra of vector fields. We also prove analogous theorems for the Lie algebras of derivations with constant and zero divergence, in which case one has to consider the wheeled bar construction of the wheeled completion of $\mathcal{O}$. Similarly to how cyclic homology of an algebra $A$ may be viewed as an additive version of the algebraic $K$-theory of $A$, our results hint at the additive $K$-theoretic nature of the wheeled bar construction.


title: DEFT: Distributed, Elastic, and Fault-tolerant State Management of Network Functions

abstract: Network function virtualization is the key to developing elastically scalable and fault-tolerant network functions (e.g. load balancer, firewall etc.). By integrating NFV and SDN technologies, it is feasible to dynamically reroute traffic to new network function (NF) instances in the event of an NF failure or overload scenario. The fact that the majority of network functions are stateful makes the task more challenging. State migration and state replication are common approaches in achieving elasticity and fault tolerance. The majority of the studies in the literature either emphasize fault tolerance or elastic scalability while designing a state management system for network functions. In this paper, we have designed a complete state management system, called DEFT, that meets both elasticity and fault-tolerance goals. Our system also supports strong consistency on global state updates. While existing designs rely on a central controller or remote central storage to achieve strong consistency on state updates, DEFT utilizes distributed consensus mechanism to achieve the same. We have done a proof of concept implementation of DEFT and extensively tested DEFT under several model conditions to evaluate its scalability and performance. Our experimental results show that DEFT is scalable and maintains a considerably high throughput throughout. It incurs minimal performance overhead while achieving strong consistency on state updates.


title: Positive eigenvectors and simple nonlinear maps

abstract: For linear operators $L, T$ and nonlinear maps $P$, we describe classes of simple maps $F = I - P T$, $F = L - P$ between Banach and Hilbert spaces, for which no point has more than two preimages. The classes encompass known examples (homeomorphisms, global folds) and the weaker, geometric, hypotheses suggest new ones. The operator $L$ may be the Laplacian with various boundary conditions, as in the original Ambrosetti-Prodi theorem, or the operators associated with the quantum harmonic oscillator, the hydrogen atom, a spectral fractional Laplacian, elliptic operators in non-divergent form. The maps $P$ include the Nemitskii map $P(u) = f(u)$ but may be non-local, even non-variational. For self-adjoint operators $L$, we employ familiar results on the nondegeneracy of the ground state. On Banach spaces, we use a variation of the Krein-Rutman theorem.


title: Internal noise interference in anticipation of tipping points of generic multi-dimensional dynamical systems

abstract: A deterministic complex system that slowly passes through a generic fold-type (saddle-node) bifurcation can be reduced to one-dimensional dynamics close to the bifurcation because of the centre manifold theorem. It is often tacitly assumed that the same is true in the presence of stochasticity or noise so that, for example, critical slowing down (CSD) indicators can be applied as if the system were one-dimensional. In this work, we show that this may not be the case; specifically, we demonstrate that noise in other dimensions may interfere with indicators of CSD, also referred to as early warning signals (EWS). We point out a generic mechanism by which both variance and AC(1), as well as other EWS, can fail to signal an approaching bifurcation. This can in principle occur whenever one noise source drives multiple components of the system simultaneously. Even under the favourable assumptions of uncoupled deterministic dynamics and stationary noise, observables of the system can then exhibit false negative or false positive CSD indications. We isolate this phenomenon in an example that represents a generic two-dimensional fold-type bifurcation setting.


abstract: Optimising deep neural networks is a challenging task due to complex training dynamics, high computational requirements, and long training times. To address this difficulty, we propose the framework of Generalisable Agents for Neural Network Optimisation (GANNO) -- a multi-agent reinforcement learning (MARL) approach that learns to improve neural network optimisation by dynamically and responsively scheduling hyperparameters during training. GANNO utilises an agent per layer that observes localised network dynamics and accordingly takes actions to adjust these dynamics at a layerwise level to collectively improve global performance. In this paper, we use GANNO to control the layerwise learning rate and show that the framework can yield useful and responsive schedules that are competitive with handcrafted heuristics. Furthermore, GANNO is shown to perform robustly across a wide variety of unseen initial conditions, and can successfully generalise to harder problems than it was trained on. Our work presents an overview of the opportunities that this paradigm offers for training neural networks, along with key challenges that remain to be overcome.


title: Joint Detection Algorithm for Multiple Cognitive Users in Spectrum Sensing

abstract: Spectrum sensing technology is a crucial aspect of modern communication technology, serving as one of the essential techniques for efficiently utilizing scarce information resources in tight frequency bands. This paper first introduces three common logical circuit decision criteria in hard decisions and analyzes their decision rigor. Building upon hard decisions, the paper further introduces a method for multi-user spectrum sensing based on soft decisions. Then the paper simulates the false alarm probability and detection probability curves corresponding to the three criteria. The simulated results of multi-user collaborative sensing indicate that the simulation process significantly reduces false alarm probability and enhances detection probability. This approach effectively detects spectrum resources unoccupied during idle periods, leveraging the concept of time-division multiplexing and rationalizing the redistribution of information resources. The entire computation process relies on the calculation principles of power spectral density in communication theory, involving threshold decision detection for noise power and the sum of noise and signal power. It provides a secondary decision detection, reflecting the perceptual decision performance of logical detection methods with relative accuracy.


title: Artificial bees collect diverse conformers of small organic molecules

abstract: The conformational mobility of organic molecules defined as a variability of practically accessible conformers plays a critical role in determining electronic, chemical, and physical properties within computational methods. At the same time, there is a challenge of identifying compact set of global and local conformers for the comprehensive description of potential energy surface. Here we apply nature-inspired algorithms to resolve this issue. Among all the considered algorithms, the artificial bee colony optimizer exhibits the highest performance in discovering conformers detected both in gas and condensed phases. We hope that our approach enables researchers to make a next step in organic crystal packing studies.


title: A method for multi-leader-multi-follower games by smoothing the followers' response function

abstract: The multi-leader--multi-follower game (MLMFG) involves two or more leaders and followers and serves as a generalization of the Stackelberg game and the single-leader--multi-follower game (SLMFG). Although MLMFG covers wide range of real-world applications, its research is still sparse. Notably, fundamental solution methods for this class of problems remain insufficiently established. A prevailing approach is to recast the MLMFG as an equilibrium problem with equilibrium constraints (EPEC) and solve it using a solver. Meanwhile, interpreting the solution to the EPEC in the context of MLMFG may be complex due to shared decision variables among all leaders, followers' strategies that each leader can unilaterally change, but the variables are essentially controlled by followers. To address this issue, we introduce a response function of followers' noncooperative game that is a function with leaders' strategies as a variable. Employing this approach allows the MLMFG to be solved as a single-level differentiable variational inequality using a smoothing scheme for the followers' response function. We also demonstrate that the sequence of solutions to the smoothed variational inequality converges to a stationary equilibrium of the MLMFG. Finally, we illustrate the behavior of the smoothing method by numerical experiments and confirm its validity.


title: Massive propagating modes of torsion

abstract: The dynamics of the torsion field is analyzed in the framework of the Covariant Canonical Gauge Theory of Gravity (CCGG), a De~Donder-Weyl Hamiltonian formulation of gauge gravity. The action is quadratic in both, the torsion and the Riemann-Cartan tensor. Since the latter adds the derivative of torsion to the equations of motion, torsion is no longer identical to spin density, as in the Einstein-Cartan theory, but an additional propagating degree of freedom. As torsion turns out to be totally anti-symmetric, it can be parametrised via a single axial vector. It is shown in this paper that, in the weak torsion limit, the axial vector obeys a wave equation with an effective mass term which is partially dependent on the scalar curvature. The source of torsion is thereby given by the fermion axial current which is the net fermionic spin density of the system. Possible measurable effects and approaches to experimental analysis are addressed. For example, neutron star mergers could act as a dipoles or quadrupoles for torsional radiation, and an analysis of radiation of pulsars could lead to a detection of torsion wave background radiation.


title: Energy conservative isogeometric techniques for the wave equation

abstract: We analyze the wave equation in mixed form, with periodic and/or Dirichlet homogeneous boundary conditions, and nonconstant coefficients that depend on the spatial variable. For the discretization, the weak form of the second equation is replaced by a strong form, written in terms of a projection operator. The system of equations is discretized with B-splines forming a De Rham complex along with suitable commutative projectors for the approximation of the second equation. The discrete scheme is energy conservative when discretized in time with a conservative method such as Crank-Nicolson. We propose a convergence analysis of the method to study the dependence with respect to the mesh size $h$, with focus on the consistency error. Numerical results show optimal convergence of the error in energy norm, and a relative error in energy conservation for long-time simulations of the order of machine precision.


title: Barwise Music Structure Analysis with the Correlation Block-Matching Segmentation Algorithm

abstract: Music Structure Analysis (MSA) is a Music Information Retrieval task consisting of representing a song in a simplified, organized manner by breaking it down into sections typically corresponding to ``chorus'', ``verse'', ``solo'', etc. In this work, we extend an MSA algorithm called the Correlation Block-Matching (CBM) algorithm introduced by (Marmoret et al., 2020, 2022b). The CBM algorithm is a dynamic programming algorithm that segments self-similarity matrices, which are a standard description used in MSA and in numerous other applications. In this work, self-similarity matrices are computed from the feature representation of an audio signal and time is sampled at the bar-scale. This study examines three different standard similarity functions for the computation of self-similarity matrices. Results show that, in optimal conditions, the proposed algorithm achieves a level of performance which is competitive with supervised state-of-the-art methods while only requiring knowledge of bar positions. In addition, the algorithm is made open-source and is highly customizable.


title: Learning Triangular Distribution in Visual World

abstract: Convolution neural network is successful in pervasive vision tasks, including label distribution learning, which usually takes the form of learning an injection from the non-linear visual features to the well-defined labels. However, how the discrepancy between features is mapped to the label discrepancy is ambient, and its correctness is not guaranteed.To address these problems, we study the mathematical connection between feature and its label, presenting a general and simple framework for label distribution learning. We propose a so-called Triangular Distribution Transform (TDT) to build an injective function between feature and label, guaranteeing that any symmetric feature discrepancy linearly reflects the difference between labels. The proposed TDT can be used as a plug-in in mainstream backbone networks to address different label distribution learning tasks. Experiments on Facial Age Recognition, Illumination Chromaticity Estimation, and Aesthetics assessment show that TDT achieves on-par or better results than the prior arts.


title: Pinching estimates of hypersurfaces by a generalized Gauss curvature flow

abstract: A variant of the Gauss curvature flow for closed and convex hypersurfaces is considered. We reveal that if the initial hypersurface is pinched enough, then this property is preserved. Furthermore, based on some structure assumptions on the speed function of the shrinking flow, we show that the flow converges to a sphere. This may generalize the result of B. Chow\cite{CW85} to the possible non-homogeneous curvature flows.


title: Effect of color randomization on $p_T$ broadening of fast partons in turbulent quark-gluon plasma

abstract: We analyze the effect of the parton color randomization on $p_T$ broadening in the quark-gluon plasma with turbulent color fields. We calculate the transport coefficient for a simplified model of fluctuating color fields in the form of alternating sequential transverse layers with homogenous transverse chromomagnetic fields with random orientation in the SU(3) group and gaussian distribution in the magnitude. Our numerical results show that the color randomization can lead to a sizable reduction of the turbulent contribution to $\hat{q}$. The magnitude of the effect grows with increasing ratio of the electric and magnetic screening masses.


title: Contrastive Denoising Score for Text-guided Latent Diffusion Image Editing

abstract: With the remarkable advent of text-to-image diffusion models, image editing methods have become more diverse and continue to evolve. A promising recent approach in this realm is Delta Denoising Score (DDS) - an image editing technique based on Score Distillation Sampling (SDS) framework that leverages the rich generative prior of text-to-image diffusion models. However, relying solely on the difference between scoring functions is insufficient for preserving specific structural elements from the original image, a crucial aspect of image editing. To address this, here we present an embarrassingly simple yet very powerful modification of DDS, called Contrastive Denoising Score (CDS), for latent diffusion models (LDM). Inspired by the similarities and differences between DDS and the contrastive learning for unpaired image-to-image translation(CUT), we introduce a straightforward approach using CUT loss within the DDS framework. Rather than employing auxiliary networks as in the original CUT approach, we leverage the intermediate features of LDM, specifically those from the self-attention layers, which possesses rich spatial information. Our approach enables zero-shot image-to-image translation and neural radiance field (NeRF) editing, achieving structural correspondence between the input and output while maintaining content controllability. Qualitative results and comparisons demonstrates the effectiveness of our proposed method. Project page: https://hyelinnam.github.io/CDS/


title: ArthModel: Enhance Arithmetic Skills to Large Language Model

abstract: With the great success of ChatGPT, the research of large language models has become increasingly popular. However, the models have several limitations, such as toxicity and pool performance of arithmetic solving. Meanwhile, LLM may have some potential abilities that have yet to be exploited. In this paper, we choose a different way to enhance the arithmetic ability of LLM. We propose to train LLM to generate a postfix expression related to the arithmetic problem and incorporate it with small pretrained models. Moreover, this small model transfers the token embeddings into real dense numbers and invokes native functions of a deep learning platform to get the correct answer. To generate the final result, we propose prompt injection for adding the result outputs by the small model to LLM. This work provides different ways of thinking, training and using a language model. The codes and models will be released at \url{https://github.com/eteced/arithmetic_finetuning_v1}.


title: DiffCAD: Weakly-Supervised Probabilistic CAD Model Retrieval and Alignment from an RGB Image

abstract: Perceiving 3D structures from RGB images based on CAD model primitives can enable an effective, efficient 3D object-based representation of scenes. However, current approaches rely on supervision from expensive annotations of CAD models associated with real images, and encounter challenges due to the inherent ambiguities in the task -- both in depth-scale ambiguity in monocular perception, as well as inexact matches of CAD database models to real observations. We thus propose DiffCAD, the first weakly-supervised probabilistic approach to CAD retrieval and alignment from an RGB image. We formulate this as a conditional generative task, leveraging diffusion to learn implicit probabilistic models capturing the shape, pose, and scale of CAD objects in an image. This enables multi-hypothesis generation of different plausible CAD reconstructions, requiring only a few hypotheses to characterize ambiguities in depth/scale and inexact shape matches. Our approach is trained only on synthetic data, leveraging monocular depth and mask estimates to enable robust zero-shot adaptation to various real target domains. Despite being trained solely on synthetic data, our multi-hypothesis approach can even surpass the supervised state-of-the-art on the Scan2CAD dataset by 5.9% with 8 hypotheses.


title: Generalized hypergeometric functions with several variables

abstract: We introduce a hypergoemetirc series with two complex variables, which generalizes Appell's, Lauricella's and Kemp\'e de F\'eriet's hypergeometric series, and study the system of differential equations that it satisfies. We determine the singularities, the rank and the condition for the reducibility of the system. We give complete local solutions of the system at many singular points of the system and solve the connection problem among these local solutions. Under some assumptions, the system is written as a KZ equation. We determine its spectral type in the direction of coordinates as well as simultaneous eigenspace decompositions of residue matrices. The system may or may not be rigid in the sense of N.~Katz viewed as an ordinary differential equation in some direction. We also show that the system is a special case of Gel'fand-Kapranov-Zelevinsky system. From this point of view, we discuss multivariate generalizations.


title: Cancer-Net PCa-Gen: Synthesis of Realistic Prostate Diffusion Weighted Imaging Data via Anatomic-Conditional Controlled Latent Diffusion

abstract: In Canada, prostate cancer is the most common form of cancer in men and accounted for 20% of new cancer cases for this demographic in 2022. Due to recent successes in leveraging machine learning for clinical decision support, there has been significant interest in the development of deep neural networks for prostate cancer diagnosis, prognosis, and treatment planning using diffusion weighted imaging (DWI) data. A major challenge hindering widespread adoption in clinical use is poor generalization of such networks due to scarcity of large-scale, diverse, balanced prostate imaging datasets for training such networks. In this study, we explore the efficacy of latent diffusion for generating realistic prostate DWI data through the introduction of an anatomic-conditional controlled latent diffusion strategy. To the best of the authors' knowledge, this is the first study to leverage conditioning for synthesis of prostate cancer imaging. Experimental results show that the proposed strategy, which we call Cancer-Net PCa-Gen, enhances synthesis of diverse prostate images through controllable tumour locations and better anatomical and textural fidelity. These crucial features make it well-suited for augmenting real patient data, enabling neural networks to be trained on a more diverse and comprehensive data distribution. The Cancer-Net PCa-Gen framework and sample images have been made publicly available at https://www.kaggle.com/datasets/deetsadi/cancer-net-pca-gen-dataset as a part of a global open-source initiative dedicated to accelerating advancement in machine learning to aid clinicians in the fight against cancer.


title: Wasserstein GANs are Minimax Optimal Distribution Estimators

abstract: We provide non asymptotic rates of convergence of the Wasserstein Generative Adversarial networks (WGAN) estimator. We build neural networks classes representing the generators and discriminators which yield a GAN that achieves the minimax optimal rate for estimating a certain probability measure $\mu$ with support in $\mathbb{R}^p$. The probability $\mu$ is considered to be the push forward of the Lebesgue measure on the $d$-dimensional torus $\mathbb{T}^d$ by a map $g^\star:\mathbb{T}^d\rightarrow \mathbb{R}^p$ of smoothness $\beta+1$. Measuring the error with the $\gamma$-H\"older Integral Probability Metric (IPM), we obtain up to logarithmic factors, the minimax optimal rate $O(n^{-\frac{\beta+\gamma}{2\beta +d}}\vee n^{-\frac{1}{2}})$ where $n$ is the sample size, $\beta$ determines the smoothness of the target measure $\mu$, $\gamma$ is the smoothness of the IPM ($\gamma=1$ is the Wasserstein case) and $d\leq p$ is the intrinsic dimension of $\mu$. In the process, we derive a sharp interpolation inequality between H\"older IPMs. This novel result of theory of functions spaces generalizes classical interpolation inequalities to the case where the measures involved have densities on different manifolds.


title: Anatomy and Physiology of Artificial Intelligence in PET Imaging

abstract: The influence of artificial intelligence (AI) within the field of nuclear medicine has been rapidly growing. Many researchers and clinicians are seeking to apply AI within PET, and clinicians will soon find themselves engaging with AI-based applications all along the chain of molecular imaging, from image reconstruction to enhanced reporting. This expanding presence of AI in PET imaging will result in greater demand for educational resources for those unfamiliar with AI. The objective of this article to is provide an illustrated guide to the core principles of modern AI, with specific focus on aspects that are most likely to be encountered in PET imaging. We describe convolutional neural networks, algorithm training, and explain the components of the commonly used U-Net for segmentation and image synthesis.


title: Two-scale exponential integrators with uniform accuracy for three-dimensional charged-particle dynamics under strong magnetic field

abstract: The numerical simulation of three-dimensional charged-particle dynamics (CPD) under strong magnetic field is challenging. In this paper, we introduce a new methodology to design two-scale exponential integrators for three-dimensional CPD whose magnetic field's strength is inversely proportional to a dimensionless parameter $0<\varepsilon \ll 1$. By dealing with the transformed form of three-dimensional CPD, we linearize the magnetic field and put the rest part in a nonlinear function which can be shown to be small. Based on which and the proposed two-scale exponential integrators, a class of novel integrators is formulated. The corresponding uniform accuracy over $\mathcal{O}(1/\varepsilon^{\beta})$ time interval is $\mathcal{O}(\varepsilon^{r\beta} h^r)$ for the $r$-th order integrator with the time stepsize $h$, $r=1,2,3,4$ and $0<\beta<1$. A rigorous proof of this error bound is presented and a numerical test is performed to illustrate the error behaviour of the proposed integrators.


title: Quantum dynamics of a fully-blockaded Rydberg atom ensemble

abstract: Classical simulation of quantum systems plays an important role in the study of many-body phenomena and in the benchmarking and verification of quantum technologies. Exact simulation is often limited to small systems because the dimension of the Hilbert space increases exponentially with the size of the system. For systems that possess a high degree of symmetry, however, classical simulation can reach much larger sizes. Here, we consider an ensemble of strongly interacting atoms with permutation symmetry, enabling the simulation of dynamics of hundreds of atoms at arbitrarily long evolution times. The system is realized by an ensemble of three-level atoms, where one of the levels corresponds to a highly excited Rydberg state. In the limit of all-to-all Rydberg blockade, the Hamiltonian is invariant under permutation of the atoms. Using techniques from representation theory, we construct a block-diagonal form of the Hamiltonian, where the size of the largest block increases only linearly with the system size. We apply this formalism to derive efficient pulse sequences to prepare arbitrary permutation-invariant quantum states. Moreover, we study the quantum dynamics following a quench, uncovering a parameter regime in which the system thermalizes slowly and exhibits pronounced revivals. Our results create new opportunities for the experimental and theoretical study of large interacting and nonintegrable quantum systems.


title: The Talenti comparison result in a quantitative form

abstract: In this paper, we obtain a quantitative version of the classical comparison result of Talenti for elliptic problems with Dirichlet boundary conditions. The key role is played by quantitative versions of the P\'olya-Szego inequality and of the Hardy-Littlewood inequality.


title: JPPF: Multi-task Fusion for Consistent Panoptic-Part Segmentation

abstract: Part-aware panoptic segmentation is a problem of computer vision that aims to provide a semantic understanding of the scene at multiple levels of granularity. More precisely, semantic areas, object instances, and semantic parts are predicted simultaneously. In this paper, we present our Joint Panoptic Part Fusion (JPPF) that combines the three individual segmentations effectively to obtain a panoptic-part segmentation. Two aspects are of utmost importance for this: First, a unified model for the three problems is desired that allows for mutually improved and consistent representation learning. Second, balancing the combination so that it gives equal importance to all individual results during fusion. Our proposed JPPF is parameter-free and dynamically balances its input. The method is evaluated and compared on the Cityscapes Panoptic Parts (CPP) and Pascal Panoptic Parts (PPP) datasets in terms of PartPQ and Part-Whole Quality (PWQ). In extensive experiments, we verify the importance of our fair fusion, highlight its most significant impact for areas that can be further segmented into parts, and demonstrate the generalization capabilities of our design without fine-tuning on 5 additional datasets.


title: Experimental study of the binding energy of NH3 on different types of ice and its impact on the snow line of NH3 and H2O

abstract: N-bearing molecules (like N2H+ or NH3) are excellent tracers of high-density, low-temperature regions like dense cloud cores and could shed light into snowlines in protoplanetary disks and the chemical evolution of comets. However, uncertainties exist about the grain surface chemistry of these molecules -- which could play an important role in their formation and evolution. This study explores experimentally the behaviour of NH$_3$ on surfaces mimicking grains under interstellar conditions alongside other major interstellar ice components (ie. H$_2$O, CO, CO$_2$). We performed co-deposition experiments using the Ultra High Vacuum (UHV) setup VENUS (VErs des NoUvelles Syntheses) of NH$_3$ along with other adsorbates (here, H$_2$O, $^{13}$CO and CO$_2$) and performed Temperature Programmed Desorption (TPD) and Temperature Programmed-During Exposure Desorption (TP-DED) experiments. We obtained binding Energy (BE) distribution of NH$_3$ on Crystalline Ice(CI) and compact-Amorphous Solid Water (c-ASW) by analyses of the TPD profiles of NH3 on the substrates. We observe a significant delay in the desorption and a decrease in the desorption rate of NH$_3$ when H$_2$O is introduced into the co-deposited mixture of NH$_3$-$^{13}$Co or NH$_3$-CO$_2$, absent without H$_2$O. Secondly, H$_2$O traps nearly 5-9 per cent of the co-deposited NH3, released during water's amorphous-to-crystalline phase change. Thirdly, for CI, we obtained a BE distribution between 3780K-4080K, and c-ASW between 3780K-5280K -- using a pre-exponential factor A = 1.94$\times 10^{15}$/s. We conclude that NH$_3$ behaviour is significantly influenced by the presence of H$_2$O due to the formation of hydrogen bonds, in line with quantum calculations. This interaction preserves NH$_3$ on grain surfaces to higher temperatures making it available to the central protostar in protoplanetary disks. It also explains why NH$_3$ freeze out in pre-stellar cores is efficient.


title: Data-driven prediction of tool wear using Bayesian-regularized artificial neural networks

abstract: The prediction of tool wear helps minimize costs and enhance product quality in manufacturing. While existing data-driven models using machine learning and deep learning have contributed to the accurate prediction of tool wear, they often lack generality and require substantial training data for high accuracy. In this paper, we propose a new data-driven model that uses Bayesian Regularized Artificial Neural Networks (BRANNs) to precisely predict milling tool wear. BRANNs combine the strengths and leverage the benefits of artificial neural networks (ANNs) and Bayesian regularization, whereby ANNs learn complex patterns and Bayesian regularization handles uncertainty and prevents overfitting, resulting in a more generalized model. We treat both process parameters and monitoring sensor signals as BRANN input parameters. We conducted an extensive experimental study featuring four different experimental data sets, including the NASA Ames milling dataset, the 2010 PHM Data Challenge dataset, the NUAA Ideahouse tool wear dataset, and an in-house performed end-milling of the Ti6Al4V dataset. We inspect the impact of input features, training data size, hidden units, training algorithms, and transfer functions on the performance of the proposed BRANN model and demonstrate that it outperforms existing state-of-the-art models in terms of accuracy and reliability.


title: Evaluating the feasibility of short-integration scans based on the 2022 VGOS-R&D program

abstract: In this work, we report on activities focusing on improving the observation strategy of the Very Long Baseline Interferometry (VLBI) Global Observing System (VGOS). During six dedicated 24-hour Research and Development (R&D) sessions conducted in 2022, the effectiveness of a signal-to-noise ratio (SNR)-based scheduling approach with observation times as short as 5-20 seconds was explored. The sessions utilized a full 8 Gbps observing mode and incorporated elements such as dedicated calibration scans, a VGOS frequency source-flux catalog, improved sky-coverage parameterization, and more. The number of scans scheduled per station increased by 2.34 times compared to operational VGOS-OPS sessions, resulting in a 2.58 times increase in the number of observations per station. Remarkably, the percentage of successful observations per baseline matched the fixed 30-second observation approach employed in VGOS-OPS, demonstrating the effectiveness of the SNR-based scheduling approach. The impact on the geodetic results was examined based on statistical analysis, revealing a significant improvement when comparing the VGOS-R\&D program with VGOS-OPS. The formal errors in estimated station coordinates decreased by 50 %. The repeatability of baseline lengths improved by 30 %, demonstrating the enhanced precision of geodetic measurements. Furthermore, Earth orientation parameters exhibited substantial improvements, with a 60 % reduction in formal errors, 27 % better agreement w.r.t. IVS-R1/R4, and 13 % better agreement w.r.t. IERS EOP 20C04. Overall, these findings strongly indicate the superiority of the VGOS-R&D program, positioning it as a role model for future operational VGOS observations.


title: Modelling Einstein cluster using Einasto profile

abstract: We demonstrate a general relativistic approach to model dark matter halos using the Einstein cluster, with the matter stress-energy generated by collisionless particles moving on circular geodesics in all possible angular directions and orbital radii. Such matter, as is known, allows an anisotropic pressure profile with non-zero tangential but zero radial pressure. We use the Einasto density profile for the Einstein cluster. Analytical studies on its properties (metric functions) and stability issues are investigated. Further, to establish this model (with the Einasto profile) as one for a dark matter halo, we use the SPARC galactic rotation curve data and estimate the best-fit values for the model parameters. General relativistic features (beyond the Keplerian velocities) such as the tangential pressure profile, are quantitatively explored. Thus, Einstein clusters with the Einasto profile, which tally well with observations, may be considered as a viable model for dark matter halos.


title: Accurate Dielectric Response of Solids: Combining the Bethe-Salpeter Equation with the Random Phase Approximation

abstract: The Bethe-Salpeter equation (BSE) can provide an accurate description of low-energy optical spectra of insulating crystals - even when excitonic effects are important. However, due to high computational costs it is only possible to include a few bands in the BSE Hamiltonian. As a consequence, the dielectric screening given by the real part of the dielectric function can be significantly underestimated by the BSE. Here we show that universally accurate optical response functions can be obtained by combining a four-point BSE-like equation for the irreducible polarisability with a two-point Dyson equation which includes the higher-lying transitions within the random phase approximation (RPA). The new method is referred to as BSE+. It has a computational cost comparable to the BSE but a much faster convergence with respect to the size of the electron-hole basis. We use the method to calculate refractive indices and electron energy loss spectra for a test set of semiconductors and insulators. In all cases the BSE+ yields excellent agreement with experimental data across a wide frequency range and outperforms both BSE and RPA.


title: Detecting nitrogen-vacancy-hydrogen centers on the nanoscale using nitrogen-vacancy centers in diamond

abstract: In diamond, nitrogen defects like the substitutional nitrogen defect (Ns) or the nitrogen-vacancy-hydrogen complex (NVH) outnumber the nitrogen vacancy (NV) defect by at least one order of magnitude creating a dense spin bath. While neutral Ns has an impact on the coherence of the NV spin state, the atomic structure of NVH reminds of a NV center decorated with a hydrogen atom. As a consequence, the formation of NVH centers could compete with that of NV centers possibly lowering the N-to-NV conversion efficiency in diamond grown with hydrogen-plasma-assisted chemical vapor deposition (CVD). Therefore, monitoring and controlling the spin bath is essential to produce and understand engineered diamond material with high NV concentrations for quantum applications. While the incorporation of Ns in diamond has been investigated on the nano- and mesoscale for years, studies concerning the influence of CVD parameters and the crystal orientation on the NVH formation have been restricted to bulk N-doped diamond providing high-enough spin numbers for electron paramagnetic resonance and optical absorption spectroscopy techniques. Here, we investigate sub-micron-thick (100)-diamond layers with nitrogen contents of (13.8 +- 1.6) ppm and (16.7 +- 3.6) ppm, and exploiting the NV centers in the layers as local nano-sensors, we demonstrate the detection of NVH- centers using double-electron-electron-resonance (DEER). To determine the NVH- densities, we quantitatively fit the hyperfine structure of NVH- and confirm the results with the DEER method usually used for determining Ns0 densities. With our experiments, we access the spin bath composition on the nanoscale and enable a fast feedback-loop in CVD recipe optimization with thin diamond layers instead of resource- and time-intensive bulk crystals.


title: Investor-patent networks as mutualistic networks

abstract: Venture capital investments in startups have come to represent an important driver of technological innovation, in parallel to corporate- and government-directed efforts. Part of the future of artificial intelligence, medicine and quantum computing now depends upon a large number of venture investment decisions whose robustness against increasingly frequent crises has therefore become crucial. To shed light on this issue, and by combining large-scale financial, startup and patent datasets, we analyze the interactions between venture capitalists and technologies as an explicit bipartite patent-investor network. Our results reveal that this network is topologically mutualistic because of the prevalence of links between generalist investors, whose portfolios are technologically diversified, and general-purpose technologies, characterized by a broad spectrum of use. As a consequence, the robustness of venture-funded technological innovation against different types of crises is affected by the high nestedness and low modularity, with high connectance, associated with mutualistic networks.


title: Hilbert series and degrees of regularity of Oil $\&$ Vinegar and Mixed quadratic systems

abstract: In this paper, we analyze the algebraic invariants for two classes of multivariate quadratic systems: systems made by OV quadratic polynomials and systems made by both OV polynomials and fully quadratic ones. For such systems, we explicitly compute the Hilbert series, and we give bounds on the degree of regularity, solving degree and first fall degree that are useful in cryptographic applications.


title: Microlensing Events in Five Years of Photometry from the Zwicky Transient Facility

abstract: Microlensing has a unique advantage for detecting dark objects in the Milky Way, such as free floating planets, neutron stars, and stellar-mass black holes. Most microlensing surveys focus towards the Galactic bulge, where higher stellar density leads to a higher event rate. However, microlensing events in the Galactic plane are closer, and take place over longer timescales. This enables a better measurement of the microlensing parallax, which serves as an independent constraint on the mass of the dark lens. In this work, we systematically searched for microlensing events in Zwicky Transient Facility (ZTF) Data Release 17 from 2018--2023 in the Galactic plane region $|b| < 20^\circ$. We find 124 high-confidence microlensing events and 54 possible events. In the event selection, we use the efficient \texttt{EventFinder} algorithm to detect microlensing signals, which could be used for large datasets such as future ZTF data releases or data from the Rubin Observatory Legacy Survey of Space and Time (LSST). With detection efficiencies of ZTF fields from catalog-level simulations, we calculate the mean Einstein timescale to be $\langle t_\mathrm{E}\rangle = 51.7 \pm 3.3$ days, smaller than previous results of the Galactic plane to within 1.5-$\sigma$. We calculate optical depths and event rates, which we interpret with caution due to the use of visual inspection in creating our final sample. With two years of additional ZTF data in DR17, we have more than doubled the amount of microlensing events (60) found in the three-year DR5 search and found events with longer Einstein timescales than before.


title: A Lightweight Clustering Framework for Unsupervised Semantic Segmentation

abstract: Unsupervised semantic segmentation aims to categorize each pixel in an image into a corresponding class without the use of annotated data. It is a widely researched area as obtaining labeled datasets is expensive. While previous works in the field have demonstrated a gradual improvement in model accuracy, most required neural network training. This made segmentation equally expensive, especially when dealing with large-scale datasets. We thus propose a lightweight clustering framework for unsupervised semantic segmentation. We discovered that attention features of the self-supervised Vision Transformer exhibit strong foreground-background differentiability. Therefore, clustering can be employed to effectively separate foreground and background image patches. In our framework, we first perform multilevel clustering across the Dataset-level, Category-level, and Image-level, and maintain consistency throughout. Then, the binary patch-level pseudo-masks extracted are upsampled, refined and finally labeled. Furthermore, we provide a comprehensive analysis of the self-supervised Vision Transformer features and a detailed comparison between DINO and DINOv2 to justify our claims. Our framework demonstrates great promise in unsupervised semantic segmentation and achieves state-of-the-art results on PASCAL VOC and MS COCO datasets.


title: Thermodynamics of a minimal collective heat engine: Comparison between engine designs

abstract: Collective effects have attracted remarkable recent interest, not only for their presence in several systems in nature but also for the possibility of being used for the construction of efficient engine setups. Notwithstanding, little is known about the influence of the engine design and most studies are restricted to the simplest cases (e.g. simultaneous contact with two thermal baths), not necessarily constituting a realistic setup implementation. Aimed at partially filling this gap, we introduce the collisional/sequential description for a minimal model for collective effects, composed of two interacting nanomachines placed in contact with a distinct thermal reservoir and nonequilibrium worksource at each stage/stroke. Thermodynamic quantities are exactly obtained irrespectively the model details. Distinct kinds of engines are investigated and the influence of the interaction, temperature, period, and time asymmetry have been undertaken. Results show that a careful design of interaction provides a superior performance than the interactionless case, including optimal power outputs and efficiencies at maximum power greater than known bounds or even the system presenting efficiencies close to the ideal (Carnot) limit. We also show that the case of the system simultaneously placed in contact with two thermal reservoirs constitutes a particular case of our framework.

categories: cond-mat.stat-mech cond-mat.mes-hall cond-mat.other cond-mat.soft


title: SATHUR: Self Augmenting Task Hallucinal Unified Representation for Generalized Class Incremental Learning

abstract: Class Incremental Learning (CIL) is inspired by the human ability to learn new classes without forgetting previous ones. CIL becomes more challenging in real-world scenarios when the samples in each incremental step are imbalanced. This creates another branch of problem, called Generalized Class Incremental Learning (GCIL) where each incremental step is structured more realistically. Grow When Required (GWR) network, a type of Self-Organizing Map (SOM), dynamically create and remove nodes and edges for adaptive learning. GWR performs incremental learning from feature vectors extracted by a Convolutional Neural Network (CNN), which acts as a feature extractor. The inherent ability of GWR to form distinct clusters, each corresponding to a class in the feature vector space, regardless of the order of samples or class imbalances, is well suited to achieving GCIL. To enhance GWR's classification performance, a high-quality feature extractor is required. However, when the convolutional layers are adapted at each incremental step, the GWR nodes corresponding to prior knowledge are subject to near-invalidation. This work introduces the Self Augmenting Task Hallucinal Unified Representation (SATHUR), which re-initializes the GWR network at each incremental step, aligning it with the current feature extractor. Comprehensive experimental results demonstrate that our proposed method significantly outperforms other state-of-the-art GCIL methods on CIFAR-100 and CORe50 datasets.


title: W-symmetries, anomalies and heterotic backgrounds with non-compact holonomy

abstract: We determine the algebra of holonomy symmetries of sigma models propagating on supersymmetric heterotic backgrounds with a non-compact holonomy group. We demonstrate that these close as a W-algebra, which in turn is specified by a Lie algebra structure on the space of covariantly constant forms that generate the holonomy symmetries. In addition, we identify the chiral anomalies associated with these symmetries. We argue that these anomalies are consistent and can be cancelled up to two loops in the sigma model perturbation theory.


title: Observation of structures at $\sim 17$ and $\sim 38$ MeV/c$^{2}$ in the $\gamma\gamma$ invariant mass spectra in pC, dC, and dCu collisions at $\textit{p}_{lab}$ of a few GeV/c per nucleon

abstract: The results of an analysis of the invariant mass spectra of photon pairs produced in dC, pC and dCu interactions at momenta of 2.75, 5.5 and 3.83 GeV/c per nucleon respectively, are presented. Signals in the form of enhanced structures at invariant masses of about 17 and 38 MeV/c2 are observed. The results of testing of the observed signals, including the results of the Monte Carlo simulation are presented. The test results support the conclusion that the observed signals are the consequence of detection of the particles with masses of about 17 and 38 MeV/c2 decaying into a pair of photons.


title: The joint spectral radius is pointwise H\"older continuous

abstract: We show that the joint spectral radius is pointwise H\"older continuous. In addition, the joint spectral radius is locally H\"older continuous for $\varepsilon$-inflations. In the two-dimensional case, local H\"older continuity holds on the matrix sets with positive joint spectral radius.


title: Maximal exponent of the Lorentz cones

abstract: We show that the maximal exponent (i.e., the minimum number of iterations required for a primitive map to become strictly positive) of the n-dimensional Lorentz cone is equal to n. As a byproduct, we show that the optimal exponent in the quantum Wielandt inequality for qubit channels is equal to 3.


title: DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatars

abstract: DiffusionAvatars synthesizes a high-fidelity 3D head avatar of a person, offering intuitive control over both pose and expression. We propose a diffusion-based neural renderer that leverages generic 2D priors to produce compelling images of faces. For coarse guidance of the expression and head pose, we render a neural parametric head model (NPHM) from the target viewpoint, which acts as a proxy geometry of the person. Additionally, to enhance the modeling of intricate facial expressions, we condition DiffusionAvatars directly on the expression codes obtained from NPHM via cross-attention. Finally, to synthesize consistent surface details across different viewpoints and expressions, we rig learnable spatial features to the head's surface via TriPlane lookup in NPHM's canonical space. We train DiffusionAvatars on RGB videos and corresponding fitted NPHM meshes of a person and test the obtained avatars in both self-reenactment and animation scenarios. Our experiments demonstrate that DiffusionAvatars generates temporally consistent and visually appealing videos for novel poses and expressions of a person, outperforming existing approaches.


title: End-to-end Autonomous Driving using Deep Learning: A Systematic Review

abstract: End-to-end autonomous driving is a fully differentiable machine learning system that takes raw sensor input data and other metadata as prior information and directly outputs the ego vehicle's control signals or planned trajectories. This paper attempts to systematically review all recent Machine Learning-based techniques to perform this end-to-end task, including, but not limited to, object detection, semantic scene understanding, object tracking, trajectory predictions, trajectory planning, vehicle control, social behavior, and communications. This paper focuses on recent fully differentiable end-to-end reinforcement learning and deep learning-based techniques. Our paper also builds taxonomies of the significant approaches by sub-grouping them and showcasing their research trends. Finally, this survey highlights the open challenges and points out possible future directions to enlighten further research on the topic.


title: Reductive Perturbation Method in Magnetized Plasma and Role of Negative Ions

abstract: An analysis of reductive perturbation method (RPM) is presented to show that why the solitary structures of nonlinear ion acoustic waves (IAWs) cannot be obtained in magnetized electron ion plasma by employing this technique. In RPM, the nonlinear Korteweg-de Vries (KdV) equation is derived using stretched coordinates in the reference frame of the wave phase speed, considering the dispersion to be a higher-order effect which balances the nonlinearity to produce a solitary structure. The maximum amplitude $\mid \Phi_m \mid$ of the nonlinear solitary wave turns out to be larger than one which contradicts the small amplitude approximation. In the presence of negative ions, the maximum amplitude satisfies the condition $\mid\Phi_m\mid <1$. To elaborate these points, the results have been applied to an experimental plasma consisting of positive ions of xenon $(Xe^{+})$ and negative ions of fluorene $(F^{-})$ along with electrons. The amplitude and width of the solitary structures depend upon the ratio of the electron to positive ion density ($\frac{n_{e0}}{n_{i0}}$). Since the nonlinear coefficient turns out to be negative, rarefied (dip) solitons are formed in the magnetized $Xe^{+}-F^{-}-e$ plasma.


title: Group actions on monoidal triangulated categories and Balmer spectra

abstract: Let $G$ be a group acting on a left or right rigid monoidal triangulated category ${\mathbf K}$ which has a Noetherian Balmer spectrum. We prove that the Balmer spectrum of the crossed product category of ${\mathbf K}$ by $G$ is homeomorphic to the space of $G$-prime ideals of ${\mathbf K}$, give a concrete description of this space, and classify the $G$-invariant thick ideals of ${\mathbf K}$. Under some additional technical conditions, we prove that the Balmer spectrum of the equivariantization of ${\mathbf K}$ by $G$ is also homeomorphic to the space of $G$-prime ideals. Examples of stable categories of finite tensor categories and perfect derived categories of coherent sheaves on Noetherian schemes are used to illustrate the theory.


title: Targeted Reduction of Causal Models

abstract: Why does a phenomenon occur? Addressing this question is central to most scientific inquiries and often relies on simulations of scientific models. As models become more intricate, deciphering the causes behind phenomena in high-dimensional spaces of interconnected variables becomes increasingly challenging. Causal Representation Learning (CRL) offers a promising avenue to uncover interpretable causal patterns within these simulations through an interventional lens. However, developing general CRL frameworks suitable for practical applications remains an open challenge. We introduce Targeted Causal Reduction (TCR), a method for condensing complex intervenable models into a concise set of causal factors that explain a specific target phenomenon. We propose an information theoretic objective to learn TCR from interventional data of simulations, establish identifiability for continuous variables under shift interventions and present a practical algorithm for learning TCRs. Its ability to generate interpretable high-level explanations from complex models is demonstrated on toy and mechanical systems, illustrating its potential to assist scientists in the study of complex phenomena in a broad range of disciplines.


title: The detection, extraction and parameter estimation of extreme-mass-ratio inspirals with deep learning

abstract: One of the primary goals of space-borne gravitational wave detectors is to detect and analyze extreme-mass-ratio inspirals (EMRIs). This endeavor presents a significant challenge due to the complex and lengthy EMRI signals, further compounded by their inherently faint nature. In this letter, we introduce a 2-layer Convolutional Neural Network (CNN) approach to detect EMRI signals for space-borne detectors, achieving a true positive rate (TPR) of 96.9 % at a 1 % false positive rate (FPR) for signal-to-noise ratio (SNR) from 50 to 100. Especially, the key intrinsic parameters of EMRIs such as mass and spin of the supermassive black hole (SMBH) and the initial eccentricity of the orbit can be inferred directly by employing a VGG network. The mass and spin of the SMBH can be determined at 99 % and 92 % respectively. This will greatly reduce the parameter spaces and computing cost for the following Bayesian parameter estimation. Our model also has a low dependency on the accuracy of the waveform model. This study underscores the potential of deep learning methods in EMRI data analysis, enabling the rapid detection of EMRI signals and efficient parameter estimation .


title: CrimeGAT: Leveraging Graph Attention Networks for Enhanced Predictive Policing in Criminal Networks

abstract: In this paper, we present CrimeGAT, a novel application of Graph Attention Networks (GATs) for predictive policing in criminal networks. Criminal networks pose unique challenges for predictive analytics due to their complex structure, multi-relational links, and dynamic behavior. Traditional methods often fail to capture these complexities, leading to suboptimal predictions. To address these challenges, we propose the use of GATs, which can effectively leverage both node features and graph structure to make predictions. Our proposed CrimeGAT model integrates attention mechanisms to weigh the importance of a node's neighbors, thereby capturing the local and global structures of criminal networks. We formulate the problem as learning a function that maps node features and graph structure to a prediction of future criminal activity. The experimental results on real-world datasets demonstrate that CrimeGAT out-performs conventional methods in predicting criminal activities, thereby providing a powerful tool for law enforcement agencies to proactively deploy resources. Furthermore, the interpretable nature of the attentionmechanism inGATs offers insights into the key players and relationships in criminal networks. This research opens new avenues for applying deep learning techniques in the Aeld of predictive policing and criminal network analysis.


title: Stability of determining a Dirichlet-Laplace-Beltrami operator from its boundary spectral data

abstract: We establish stability inequalities for the problem of determining a Dirichlet-Laplace-Beltrami operator from its boundary spectral data. We study the case of complete spectral data as well as the case of partial spectral data.


title: IoT-based Analysis for Smart Energy Management

abstract: Smart energy management based on the Internet of Things (IoT) aims to achieve optimal energy utilization through real-time energy monitoring and analyses of power consumption patterns in IoT networks (e.g., residential homes and offices) supported by wireless technologies. This is of great significance for the sustainable development of energy. Energy disaggregation is an important technology to realize smart energy management, as it can determine the power consumption of each appliance from the total load (e.g., aggregated data). Also, it gives us clear insights into users' daily power-consumption-related behaviours, which can enhance their awareness of power-saving and lead them to a more sustainable lifestyle. This paper reviews the state-of-the-art algorithms for energy disaggregation and public datasets of power consumption. Also, potential use cases for smart energy management based on IoT networks are presented along with a discussion of open issues for future study.


title: Exploring the hierarchical structure of human plans via program generation

abstract: Human behavior is inherently hierarchical, resulting from the decomposition of a task into subtasks or an abstract action into concrete actions. However, behavior is typically measured as a sequence of actions, which makes it difficult to infer its hierarchical structure. In this paper, we explore how people form hierarchically-structured plans, using an experimental paradigm that makes hierarchical representations observable: participants create programs that produce sequences of actions in a language with explicit hierarchical structure. This task lets us test two well-established principles of human behavior: utility maximization (i.e. using fewer actions) and minimum description length (MDL; i.e. having a shorter program). We find that humans are sensitive to both metrics, but that both accounts fail to predict a qualitative feature of human-created programs, namely that people prefer programs with reuse over and above the predictions of MDL. We formalize this preference for reuse by extending the MDL account into a generative model over programs, modeling hierarchy choice as the induction of a grammar over actions. Our account can explain the preference for reuse and provides the best prediction of human behavior, going beyond simple accounts of compressibility to highlight a principle that guides hierarchical planning.


title: Stochastic Vision Transformers with Wasserstein Distance-Aware Attention

abstract: Self-supervised learning is one of the most promising approaches to acquiring knowledge from limited labeled data. Despite the substantial advancements made in recent years, self-supervised models have posed a challenge to practitioners, as they do not readily provide insight into the model's confidence and uncertainty. Tackling this issue is no simple feat, primarily due to the complexity involved in implementing techniques that can make use of the latent representations learned during pre-training without relying on explicit labels. Motivated by this, we introduce a new stochastic vision transformer that integrates uncertainty and distance awareness into self-supervised learning (SSL) pipelines. Instead of the conventional deterministic vector embedding, our novel stochastic vision transformer encodes image patches into elliptical Gaussian distributional embeddings. Notably, the attention matrices of these stochastic representational embeddings are computed using Wasserstein distance-based attention, effectively capitalizing on the distributional nature of these embeddings. Additionally, we propose a regularization term based on Wasserstein distance for both pre-training and fine-tuning processes, thereby incorporating distance awareness into latent representations. We perform extensive experiments across different tasks such as in-distribution generalization, out-of-distribution detection, dataset corruption, semi-supervised settings, and transfer learning to other datasets and tasks. Our proposed method achieves superior accuracy and calibration, surpassing the self-supervised baseline in a wide range of experiments on a variety of datasets.


title: Robust-to-Noise Algorithms for Distributed Resource Allocation and Scheduling

abstract: Efficient resource allocation and scheduling algorithms are essential for various distributed applications, ranging from wireless networks and cloud computing platforms to autonomous multi-agent systems and swarm robotic networks. However, real-world environments are often plagued by uncertainties and noise, leading to sub-optimal performance and increased vulnerability of traditional algorithms. This paper addresses the challenge of robust resource allocation and scheduling in the presence of noise and disturbances. The proposed study introduces a novel sign-based dynamics for developing robust-to-noise algorithms distributed over a multi-agent network that can adaptively handle external disturbances. Leveraging concepts from convex optimization theory, control theory, and network science the framework establishes a principled approach to design algorithms that can maintain key properties such as resource-demand balance and constraint feasibility. Meanwhile, notions of uniform-connectivity and versatile networking conditions are also addressed.


title: Long-term temporal stability of the DarkSide-50 dark matter detector

abstract: The stability of a dark matter detector on the timescale of a few years is a key requirement due to the large exposure needed to achieve a competitive sensitivity. It is especially crucial to enable the detector to potentially detect any annual event rate modulation, an expected dark matter signature. In this work, we present the performance history of the DarkSide-50 dual-phase argon time projection chamber over its almost three-year low-radioactivity argon run. In particular, we focus on the electroluminescence signal that enables sensitivity to sub-keV energy depositions. The stability of the electroluminescence yield is found to be better than 0.5%. Finally, we show the temporal evolution of the observed event rate around the sub-keV region being consistent to the background prediction.


title: Tropical Quiver Grassmannians

abstract: We introduce quivers of valuated matroids and study their tropical parameter spaces. We define quiver Dressians, which parametrize containment of tropical linear spaces after tropical matrix multiplication, and show that tropicalizations of quiver Grassmannians parametrize the realizable analogue. We further introduce affine morphisms of valuated matroids and show compatibility with weakly monomial quiver representations. Finally, we show that starting in ambient dimension 2, quiver Dressians can have nonrealizable points.


title: Simple Semantic-Aided Few-Shot Learning

abstract: Learning from a limited amount of data, namely Few-Shot Learning, stands out as a challenging computer vision task. Several works exploit semantics and design complicated semantic fusion mechanisms to compensate for rare representative features within restricted data. However, relying on naive semantics such as class names introduces biases due to their brevity, while acquiring extensive semantics from external knowledge takes a huge time and effort. This limitation severely constrains the potential of semantics in Few-Shot Learning. In this paper, we design an automatic way called Semantic Evolution to generate high-quality semantics. The incorporation of high-quality semantics alleviates the need for complex network structures and learning algorithms used in previous works. Hence, we employ a simple two-layer network termed Semantic Alignment Network to transform semantics and visual features into robust class prototypes with rich discriminative features for few-shot classification. The experimental results show our framework outperforms all previous methods on six benchmarks, demonstrating a simple network with high-quality semantics can beat intricate multi-modal modules on few-shot classification tasks. Code is available at https://github.com/zhangdoudou123/SemFew.


title: Perturbative Construction of Coherent States

abstract: The perturbative consistency of coherent states within interacting quantum field theory requires them to be altered beyond the simple non-squeezed form. Building on this point, we perform explicit construction of consistent squeezed coherent states, required by the finiteness of physical quantities at the one-loop order. Extending this analysis to two-loops, we demonstrate that a non-Gaussian alteration of squeezed coherent states is necessary. The modifications of the coherent state we propose are perturbative in $\hbar$ and may be an indication that coherence must be viewed through a nonlinearly redefined, background-dependent, degree of freedom.


title: LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning

abstract: Recent advances in Large Multimodal Models (LMM) have made it possible for various applications in human-machine interactions. However, developing LMMs that can comprehend, reason, and plan in complex and diverse 3D environments remains a challenging topic, especially considering the demand for understanding permutation-invariant point cloud 3D representations of the 3D scene. Existing works seek help from multi-view images, and project 2D features to 3D space as 3D scene representations. This, however, leads to huge computational overhead and performance degradation. In this paper, we present LL3DA, a Large Language 3D Assistant that takes point cloud as direct input and respond to both textual-instructions and visual-prompts. This help LMMs better comprehend human interactions and further help to remove the ambiguities in cluttered 3D scenes. Experiments show that LL3DA achieves remarkable results, and surpasses various 3D vision-language models on both 3D Dense Captioning and 3D Question Answering.


title: Spectral asymptotics for linear elasticity: the case of mixed boundary conditions

abstract: We establish two-term spectral asymptotics for the operator of linear elasticity with mixed boundary conditions on a smooth compact Riemannian manifold of arbitrary dimension. We illustrate our results by explicit examples in dimension two and three, thus verifying our general formulae both analytically and numerically.


title: Examples of extended geometrically finite representations

abstract: This is the second of a pair of papers on extended geometrically finite (EGF) representations, which were originally posted as a single article under the title "An extended definition of Anosov representation for relatively hyperbolic groups." In this paper, we prove that the holonomy representation of a projectively convex cocompact manifold with relatively hyperbolic fundamental group is always an EGF representation. We also prove that EGF representations arise as holonomy representations of convex projective manifolds with generalized cusps and as compositions of projectively convex cocompact representations with symmetric representations of SL(d, R). We additionally show that any small deformation of a representation of the latter form is still EGF.


title: Detailed Human-Centric Text Description-Driven Large Scene Synthesis

abstract: Text-driven large scene image synthesis has made significant progress with diffusion models, but controlling it is challenging. While using additional spatial controls with corresponding texts has improved the controllability of large scene synthesis, it is still challenging to faithfully reflect detailed text descriptions without user-provided controls. Here, we propose DetText2Scene, a novel text-driven large-scale image synthesis with high faithfulness, controllability, and naturalness in a global context for the detailed human-centric text description. Our DetText2Scene consists of 1) hierarchical keypoint-box layout generation from the detailed description by leveraging large language model (LLM), 2) view-wise conditioned joint diffusion process to synthesize a large scene from the given detailed text with LLM-generated grounded keypoint-box layout and 3) pixel perturbation-based pyramidal interpolation to progressively refine the large scene for global coherence. Our DetText2Scene significantly outperforms prior arts in text-to-large scene synthesis qualitatively and quantitatively, demonstrating strong faithfulness with detailed descriptions, superior controllability, and excellent naturalness in a global context.


title: OISA: Architecting an Optical In-Sensor Accelerator for Efficient Visual Computing

abstract: Targeting vision applications at the edge, in this work, we systematically explore and propose a high-performance and energy-efficient Optical In-Sensor Accelerator architecture called OISA for the first time. Taking advantage of the promising efficiency of photonic devices, the OISA intrinsically implements a coarse-grained convolution operation on the input frames in an innovative minimum-conversion fashion in low-bit-width neural networks. Such a design remarkably reduces the power consumption of data conversion, transmission, and processing in the conventional cloud-centric architecture as well as recently-presented edge accelerators. Our device-to-architecture simulation results on various image data-sets demonstrate acceptable accuracy while OISA achieves 6.68 TOp/s/W efficiency. OISA reduces power consumption by a factor of 7.9 and 18.4 on average compared with existing electronic in-/near-sensor and ASIC accelerators.


title: Evaluating Lebesgue constants by Chebyshev polynomial meshes on cube, simplex and ball

abstract: We show that product Chebyshev polynomial meshes can be used, in a fully discrete way, to evaluate with rigorous error bounds the Lebesgue constant, i.e. the maximum of the Lebesgue function, for a class of polynomial projectors on cube, simplex and ball, including interpolation, hyperinterpolation and weighted least-squares. Several examples are presented and possible generalizations outlined. A numerical software package implementing the method is freely available online.


title: Extension and convergence analysis of Iterative Filtering to spherical data

abstract: Many real-life signals are defined on spherical domains, in particular in geophysics and physics applications. In this work, we tackle the problem of extending the iterative filtering algorithm, developed for the decomposition of non-stationary signals defined in Euclidean spaces, to spherical domains. We review the properties of the classical Iterative Filtering method, present its extension, and study its convergence in the discrete setting. In particular, by leveraging the Generalized Locally Toeplitz sequence theory, we are able to characterize spectrally the operators associated with the spherical extension of Iterative Filtering, and we show a counterexample of its convergence. Finally, we propose a convergent version, called Spherical Iterative Filtering, and present numerical results of its application to spherical data.


title: ArcMMLU: A Library and Information Science Benchmark for Large Language Models

abstract: In light of the rapidly evolving capabilities of large language models (LLMs), it becomes imperative to develop rigorous domain-specific evaluation benchmarks to accurately assess their capabilities. In response to this need, this paper introduces ArcMMLU, a specialized benchmark tailored for the Library & Information Science (LIS) domain in Chinese. This benchmark aims to measure the knowledge and reasoning capability of LLMs within four key sub-domains: Archival Science, Data Science, Library Science, and Information Science. Following the format of MMLU/CMMLU, we collected over 6,000 high-quality questions for the compilation of ArcMMLU. This extensive compilation can reflect the diverse nature of the LIS domain and offer a robust foundation for LLM evaluation. Our comprehensive evaluation reveals that while most mainstream LLMs achieve an average accuracy rate above 50% on ArcMMLU, there remains a notable performance gap, suggesting substantial headroom for refinement in LLM capabilities within the LIS domain. Further analysis explores the effectiveness of few-shot examples on model performance and highlights challenging questions where models consistently underperform, providing valuable insights for targeted improvements. ArcMMLU fills a critical gap in LLM evaluations within the Chinese LIS domain and paves the way for future development of LLMs tailored to this specialized area.


title: Comparison of Autoscaling Frameworks for Containerised Machine-Learning-Applications in a Local and Cloud Environment

abstract: When deploying machine learning (ML) applications, the automated allocation of computing resources-commonly referred to as autoscaling-is crucial for maintaining a consistent inference time under fluctuating workloads. The objective is to maximize the Quality of Service metrics, emphasizing performance and availability, while minimizing resource costs. In this paper, we compare scalable deployment techniques across three levels of scaling: at the application level (TorchServe, RayServe) and the container level (K3s) in a local environment (production server), as well as at the container and machine levels in a cloud environment (Amazon Web Services Elastic Container Service and Elastic Kubernetes Service). The comparison is conducted through the study of mean and standard deviation of inference time in a multi-client scenario, along with upscaling response times. Based on this analysis, we propose a deployment strategy for both local and cloud-based environments.


title: Nanoscale confinement and control of excitonic complexes in a monolayer WSe2

abstract: Nanoscale control and observation of photophysical processes in semiconductors is critical for basic understanding and applications from optoelectronics to quantum information processing. In particular, there are open questions and opportunities in controlling excitonic complexes in two-dimensional materials such as excitons, trions or biexcitons. However, neither conventional diffraction-limited optical spectroscopy nor lithography-limited electric control provides a proper tool to investigate these quasiparticles at the nanometer-scale at cryogenic temperature. Here, we introduce a cryogenic capacitive confocal optical microscope (C3OM) as a tool to study quasiparticle dynamics at the nanometer scale. Using a conductive atomic force microscope (AFM) tip as a gate electrode, we can modulate the electronic doping at the nanometer scale in WSe2 at 4K. This tool allows us to modulate with nanometer-scale confinement the exciton and trion peaks, as well a distinct photoluminescence line associated with a larger excitonic complex that exhibits distinctive nonlinear optical response. Our results demonstrate nanoscale confinement and spectroscopy of exciton complexes at arbitrary positions, which should prove an important tool for quantitative understanding of complex optoelectronic properties in semiconductors as well as for applications ranging from quantum spin liquids to superresolution measurements to control of quantum emitters.


title: Learning Part Segmentation from Synthetic Animals

abstract: Semantic part segmentation provides an intricate and interpretable understanding of an object, thereby benefiting numerous downstream tasks. However, the need for exhaustive annotations impedes its usage across diverse object types. This paper focuses on learning part segmentation from synthetic animals, leveraging the Skinned Multi-Animal Linear (SMAL) models to scale up existing synthetic data generated by computer-aided design (CAD) animal models. Compared to CAD models, SMAL models generate data with a wider range of poses observed in real-world scenarios. As a result, our first contribution is to construct a synthetic animal dataset of tigers and horses with more pose diversity, termed Synthetic Animal Parts (SAP). We then benchmark Syn-to-Real animal part segmentation from SAP to PartImageNet, namely SynRealPart, with existing semantic segmentation domain adaptation methods and further improve them as our second contribution. Concretely, we examine three Syn-to-Real adaptation methods but observe relative performance drop due to the innate difference between the two tasks. To address this, we propose a simple yet effective method called Class-Balanced Fourier Data Mixing (CB-FDM). Fourier Data Mixing aligns the spectral amplitudes of synthetic images with real images, thereby making the mixed images have more similar frequency content to real images. We further use Class-Balanced Pseudo-Label Re-Weighting to alleviate the imbalanced class distribution. We demonstrate the efficacy of CB-FDM on SynRealPart over previous methods with significant performance improvements. Remarkably, our third contribution is to reveal that the learned parts from synthetic tiger and horse are transferable across all quadrupeds in PartImageNet, further underscoring the utility and potential applications of animal part segmentation.


title: Solving the Team Orienteering Problem with Transformers

abstract: Route planning for a fleet of vehicles is an important task in applications such as package delivery, surveillance, or transportation. This problem is usually modeled as a Combinatorial Optimization problem named as Team Orienteering Problem. The most popular Team Orienteering Problem solvers are mainly based on either linear programming, which provides accurate solutions by employing a large computation time that grows with the size of the problem, or heuristic methods, which usually find suboptimal solutions in a shorter amount of time. In this paper, a multi-agent route planning system capable of solving the Team Orienteering Problem in a very fast and accurate manner is presented. The proposed system is based on a centralized Transformer neural network that can learn to encode the scenario (modeled as a graph) and the context of the agents to provide fast and accurate solutions. Several experiments have been performed to demonstrate that the presented system can outperform most of the state-of-the-art works in terms of computation speed. In addition, the code is publicly available at http://gti.ssr.upm.es/data.


title: Choosing the parameter of the Fermat distance: navigating geometry and noise

abstract: The Fermat distance has been recently established as a useful tool for machine learning tasks when a natural distance is not directly available to the practitioner or to improve the results given by Euclidean distances by exploding the geometrical and statistical properties of the dataset. This distance depends on a parameter $\alpha$ that greatly impacts the performance of subsequent tasks. Ideally, the value of $\alpha$ should be large enough to navigate the geometric intricacies inherent to the problem. At the same, it should remain restrained enough to sidestep any deleterious ramifications stemming from noise during the process of distance estimation. We study both theoretically and through simulations how to select this parameter.


title: Multi-task learning with cross-task consistency for improved depth estimation in colonoscopy

abstract: Colonoscopy screening is the gold standard procedure for assessing abnormalities in the colon and rectum, such as ulcers and cancerous polyps. Measuring the abnormal mucosal area and its 3D reconstruction can help quantify the surveyed area and objectively evaluate disease burden. However, due to the complex topology of these organs and variable physical conditions, for example, lighting, large homogeneous texture, and image modality estimating distance from the camera aka depth) is highly challenging. Moreover, most colonoscopic video acquisition is monocular, making the depth estimation a non-trivial problem. While methods in computer vision for depth estimation have been proposed and advanced on natural scene datasets, the efficacy of these techniques has not been widely quantified on colonoscopy datasets. As the colonic mucosa has several low-texture regions that are not well pronounced, learning representations from an auxiliary task can improve salient feature extraction, allowing estimation of accurate camera depths. In this work, we propose to develop a novel multi-task learning (MTL) approach with a shared encoder and two decoders, namely a surface normal decoder and a depth estimator decoder. Our depth estimator incorporates attention mechanisms to enhance global context awareness. We leverage the surface normal prediction to improve geometric feature extraction. Also, we apply a cross-task consistency loss among the two geometrically related tasks, surface normal and camera depth. We demonstrate an improvement of 14.17% on relative error and 10.4% improvement on $\delta_{1}$ accuracy over the most accurate baseline state-of-the-art BTS approach. All experiments are conducted on a recently released C3VD dataset; thus, we provide a first benchmark of state-of-the-art methods.


title: Pose Estimation and Tracking for ASIST

abstract: Aircraft Ship Integrated Secure and Traverse (ASIST) is a system designed to arrest helicopters safely and efficiently on ships. Originally, a precision Helicopter Position Sensing Equipment (HPSE) tracked and monitored the position of the helicopter relative to the Rapid Securing Device (RSD). However, using the HPSE component was determined to be infeasible in the transition of the ASIST system due to the hardware installation requirements. As a result, sailors track the position of the helicopters with their eyes with no sensor or artificially intelligent decision aid. Manually tracking the helicopter takes additional time and makes recoveries more difficult, especially at high sea states. Performing recoveries without the decision aid leads to higher uncertainty and cognitive load. PETA (Pose Estimation and Tracking for ASIST) is a research effort to create a helicopter tracking system prototype without hardware installation requirements for ASIST system operators. Its overall goal is to improve situational awareness and reduce operator uncertainty with respect to the aircrafts position relative to the RSD, and consequently increase the allowable landing area. The authors produced a prototype system capable of tracking helicopters with respect to the RSD. The software included a helicopter pose estimation component, camera pose estimation component, and a user interface component. PETA demonstrated the potential for state-of-the-art computer vision algorithms Faster R-CNN and HRNet (High-Resolution Network) to be used to estimate the pose of helicopters in real-time, returning ASIST to its originally intended capability. PETA also demonstrated that traditional methods of encoder-decoders could be used to estimate the orientation of the helicopter and could be used to confirm the output from HRNet.


title: Action Recognition in Video Recordings from Gynecologic Laparoscopy

abstract: Action recognition is a prerequisite for many applications in laparoscopic video analysis including but not limited to surgical training, operation room planning, follow-up surgery preparation, post-operative surgical assessment, and surgical outcome estimation. However, automatic action recognition in laparoscopic surgeries involves numerous challenges such as (I) cross-action and intra-action duration variation, (II) relevant content distortion due to smoke, blood accumulation, fast camera motions, organ movements, object occlusion, and (III) surgical scene variations due to different illuminations and viewpoints. Besides, action annotations in laparoscopy surgeries are limited and expensive due to requiring expert knowledge. In this study, we design and evaluate a CNN-RNN architecture as well as a customized training-inference framework to deal with the mentioned challenges in laparoscopic surgery action recognition. Using stacked recurrent layers, our proposed network takes advantage of inter-frame dependencies to negate the negative effect of content distortion and variation in action recognition. Furthermore, our proposed frame sampling strategy effectively manages the duration variations in surgical actions to enable action recognition with high temporal resolution. Our extensive experiments confirm the superiority of our proposed method in action recognition compared to static CNNs.