title: Learning for CasADi: Data-driven Models in Numerical Optimization

abstract: While real-world problems are often challenging to analyze analytically, deep learning excels in modeling complex processes from data. Existing optimization frameworks like CasADi facilitate seamless usage of solvers but face challenges when integrating learned process models into numerical optimizations. To address this gap, we present the Learning for CasADi (L4CasADi) framework, enabling the seamless integration of PyTorch-learned models with CasADi for efficient and potentially hardware-accelerated numerical optimization. The applicability of L4CasADi is demonstrated with two tutorial examples: First, we optimize a fish's trajectory in a turbulent river for energy efficiency where the turbulent flow is represented by a PyTorch model. Second, we demonstrate how an implicit Neural Radiance Field environment representation can be easily leveraged for optimal control with L4CasADi. L4CasADi, along with examples and documentation, is available under MIT license at https://github.com/Tim-Salzmann/l4casadi


title: Thermoelectric Properties of Armchair Graphene Nanoribbons with Array Characteristics

abstract: The thermoelectric properties of armchair graphene nanoribbons (AGNRs) with array characteristics are investigated theoretically using the tight-binding model and Green's function technique. The AGNR structures with array characteristics are created by embedding a narrow boron nitride nanoribbon (BNNR) into a wider AGNR, resulting in two narrow AGNRs. This system is denoted as w-AGNR/n-BNNR, where 'w' and 'n' represent the widths of the wider AGNR and narrow BNNR, respectively. We elucidate the coupling effect between two narrow symmetrical AGNRs on the electronic structure of w-AGNR/n-BNNR. A notable discovery is that the power factor of the 15-AGNR/5-BNNR with the minimum width surpasses the quantum limitation of power factor for 1D ideal systems. The energy level degeneracy observed in the first subbands of w-AGNR/n-BNNR structures proves to be highly advantageous in enhancing the electrical power outputs of graphene nanoribbon devices.


title: Class-Aware Pruning for Efficient Neural Networks

abstract: Deep neural networks (DNNs) have demonstrated remarkable success in various fields. However, the large number of floating-point operations (FLOPs) in DNNs poses challenges for their deployment in resource-constrained applications, e.g., edge devices. To address the problem, pruning has been introduced to reduce the computational cost in executing DNNs. Previous pruning strategies are based on weight values, gradient values and activation outputs. Different from previous pruning solutions, in this paper, we propose a class-aware pruning technique to compress DNNs, which provides a novel perspective to reduce the computational cost of DNNs. In each iteration, the neural network training is modified to facilitate the class-aware pruning. Afterwards, the importance of filters with respect to the number of classes is evaluated. The filters that are only important for a few number of classes are removed. The neural network is then retrained to compensate for the incurred accuracy loss. The pruning iterations end until no filter can be removed anymore, indicating that the remaining filters are very important for many classes. This pruning technique outperforms previous pruning solutions in terms of accuracy, pruning ratio and the reduction of FLOPs. Experimental results confirm that this class-aware pruning technique can significantly reduce the number of weights and FLOPs, while maintaining a high inference accuracy.


title: Target search on DNA -- effect of coiling

abstract: Some proteins can find their targets on DNA faster than by pure diffusion in the three-dimensional cytoplasm, through the process of facilitated diffusion: They can loosely bind to DNA and temporarily slide along it, thus being guided by the DNA molecule itself to the target. This chapter examines this process in mathematical detail with a focus on including the effect of DNA coiling on the search process.

categories: q-bio.BM cond-mat.stat-mech physics.bio-ph q-bio.SC


title: Proceedings of the 2023 XCSP3 Competition

abstract: This document represents the proceedings of the 2023 XCSP3 Competition. The results of this competition of constraint solvers were presented at CP'23 (the 29th International Conference on Principles and Practice of Constraint Programming, held in Toronto, Canada from 27th to 31th August, 2023).


title: Skew Probabilistic Neural Networks for Learning from Imbalanced Data

abstract: Real-world datasets often exhibit imbalanced data distribution, where certain class levels are severely underrepresented. In such cases, traditional pattern classifiers have shown a bias towards the majority class, impeding accurate predictions for the minority class. This paper introduces an imbalanced data-oriented approach using probabilistic neural networks (PNNs) with a skew normal probability kernel to address this major challenge. PNNs are known for providing probabilistic outputs, enabling quantification of prediction confidence and uncertainty handling. By leveraging the skew normal distribution, which offers increased flexibility, particularly for imbalanced and non-symmetric data, our proposed Skew Probabilistic Neural Networks (SkewPNNs) can better represent underlying class densities. To optimize the performance of the proposed approach on imbalanced datasets, hyperparameter fine-tuning is imperative. To this end, we employ a population-based heuristic algorithm, Bat optimization algorithms, for effectively exploring the hyperparameter space. We also prove the statistical consistency of the density estimates which suggests that the true distribution will be approached smoothly as the sample size increases. Experimental simulations have been conducted on different synthetic datasets, comparing various benchmark-imbalanced learners. Our real-data analysis shows that SkewPNNs substantially outperform state-of-the-art machine learning methods for both balanced and imbalanced datasets in most experimental settings.


title: Wild Motion Unleashed: Markerless 3D Kinematics and Force Estimation in Cheetahs

abstract: The complex dynamics of animal manoeuvrability in the wild is extremely challenging to study. The cheetah ($\textit{Acinonyx jubatus}$) is a perfect example: despite great interest in its unmatched speed and manoeuvrability, obtaining complete whole-body motion data from these animals remains an unsolved problem. This is especially difficult in wild cheetahs, where it is essential that the methods used are remote and do not constrain the animal's motion. In this work, we use data obtained from cheetahs in the wild to present a trajectory optimisation approach for estimating the 3D kinematics and joint torques of subjects remotely. We call this approach kinetic full trajectory estimation (K-FTE). We validate the method on a dataset comprising synchronised video and force plate data. We are able to reconstruct the 3D kinematics with an average reprojection error of 17.69 pixels (62.94 $\%$ PCK using the nose-to-eye(s) length segment as a threshold), while the estimates produce an average root-mean-square error of 171.3 N ($\approx$ 17.16 $\%$ of peak force during stride) for the estimated ground reaction force when compared against the force plate data. While the joint torques cannot be directly validated against ground truth data, as no such data is available for cheetahs, the estimated torques agree with previous studies of quadrupeds in controlled settings. These results will enable deeper insight into the study of animal locomotion in a more natural environment for both biologists and roboticists.


title: Data-driven optimal stopping: A pure exploration analysis

abstract: The standard theory of optimal stopping is based on the idealised assumption that the underlying process is essentially known. In this paper, we drop this restriction and study data-driven optimal stopping for a general diffusion process, focusing on investigating the statistical performance of the proposed estimator of the optimal stopping barrier. More specifically, we derive non-asymptotic upper bounds on the simple regret, along with uniform and non-asymptotic PAC bounds. Minimax optimality is verified by completing the upper bound results with matching lower bounds on the simple regret. All results are shown both under general conditions on the payoff functions and under more refined assumptions that mimic the margin condition used in binary classification, leading to an improved rate of convergence. Additionally, we investigate how our results on the simple regret transfer to the cumulative regret for a specific exploration-exploitation strategy, both with respect to lower bounds and upper bounds.


title: Maximum capacity path problem with loss factors

abstract: The maximum capacity path problem is to find a path from a source to a sink which has the maximum capacity among all paths. This paper addresses an extension of this problem which considers loss factors. It is called the generalized maximum capacity path problem. The problem is a network flow optimization problem whose network contains capacities as well as loss factors for arcs. The aim of the problem is to find a path from an origin to a destination so as to send a maximum flow along the path considering loss factors and respecting capacity constraints. The paper presents a zero-one formulation of the problem and moreover, it presents two efficient algorithms which solve the problem in polynomial time.


title: Convergence Rate Analysis in Limit Theorems for Nonlinear Functionals of the Second Wiener Chaos

abstract: The purpose of this paper is to analyze the distribution distance between random vectors derived from the magnitude of the analytic wavelet transform of the squared envelopes of Gaussian processes and their large-scale limits. When the Hurst index of the underlying Gaussian process falls below 1/2, the large-scale limit takes the form of a combination of the second and fourth Wiener chaos. In this case, we employ the non-Stein approach to determine the convergence rate in the Kolmogorov metric. In scenarios where the Hurst index of the underlying Gaussian process exceeds 1/2, the large-scale limit is a correlated chi-distributed random process with two degrees of freedom. The convergence rate in the Wasserstein metric is derived through the application of Malliavin calculus and multidimensional Stein's method. Although the large-scale limits are the same for Hurst indices within the interval (1/2,1), notable differences in the upper bounds of convergence rates are observed among Hurst indices falling within the subintervals (1/2,3/4) and (3/4,1).


title: Using deep neural networks to improve the precision of fast-sampled particle timing detectors

abstract: Measurements from particle timing detectors are often affected by the time walk effect caused by statistical fluctuations in the charge deposited by passing particles. The constant fraction discriminator (CFD) algorithm is frequently used to mitigate this effect both in test setups and in running experiments, such as the CMS-PPS system at the CERN's LHC. The CFD is simple and effective but does not leverage all voltage samples in a time series. Its performance could be enhanced with deep neural networks, which are commonly used for time series analysis, including computing the particle arrival time. We evaluated various neural network architectures using data acquired at the test beam facility in the DESY-II synchrotron, where a precise MCP (MicroChannel Plate) detector was installed in addition to PPS diamond timing detectors. MCP measurements were used as a reference to train the networks and compare the results with the standard CFD method. Ultimately, we improved the timing precision by 8% to 23%, depending on the detector's readout channel. The best results were obtained using a UNet-based model, which outperformed classical convolutional networks and the multilayer perceptron.


title: A General Analytical Framework for the Resolution of Near-Field Beamforming

abstract: The resolution is an important performance metric of near-field communication networks. In particular, the resolution of near field beamforming measures how effectively users can be distinguished in the distance-angle domain, which is one of the most significant features of near-field communications. In a comparison, conventional far-field beamforming can distinguish users in the angle domain only, which means that near-field communication yields the full utilization of user spatial resources to improve spectrum efficiency. In the literature of near-field communications, there have been a few studies on whether the resolution of near-field beamforming is perfect. However, each of the existing results suffers its own limitations, e.g., each is accurate for special cases only, and cannot precisely and comprehensively characterize the resolution. In this letter, a general analytical framework is developed to evaluate the resolution of near-field beamforming. Based on this derived expression, the impacts of parameters on the resolution are investigated, which can shed light on the design of the near-field communications, including the designs of beamforming and multiple access tequniques.


title: Adaptive Parameter Selection for Kernel Ridge Regression

abstract: This paper focuses on parameter selection issues of kernel ridge regression (KRR). Due to special spectral properties of KRR, we find that delicate subdivision of the parameter interval shrinks the difference between two successive KRR estimates. Based on this observation, we develop an early-stopping type parameter selection strategy for KRR according to the so-called Lepskii-type principle. Theoretical verifications are presented in the framework of learning theory to show that KRR equipped with the proposed parameter selection strategy succeeds in achieving optimal learning rates and adapts to different norms, providing a new record of parameter selection for kernel methods.


title: Edge-connectivity keeping trees in $k$-edge-connected graphs

abstract: Mader [J. Combin. Theory Ser. B 40 (1986) 152-158] proved that every $k$-edge-connected graph $G$ with minimum degree at least $k+1$ contains a vertex $u$ such that $G-\{u\}$ is still $k$-edge-connected. In this paper, we prove that every $k$-edge-connected graph $G$ with minimum degree at least $k+2$ contains an edge $uv$ such that $G-\{u,v\}$ is $k$-edge-connected for any positive integer $k$. In addition, we show that for any tree $T$ of order $m$, every $k$-edge-connected graph $G$ with minimum degree greater than $4(k+m)^2$ contains a subtree $T'$ isomorphic to $T$ such that $G-V(T')$ is $k$-edge-connected.


title: Three-dimensional numerical schemes for the segmentation of the psoas muscle in X-ray computed tomography images

abstract: The analysis of the psoas muscle in morphological and functional imaging has proved to be an accurate approach to assess sarcopenia, i.e. a systemic loss of skeletal muscle mass and function that may be correlated to multifactorial etiological aspects. The inclusion of sarcopenia assessment into a radiological workflow would need the implementation of computational pipelines for image processing that guarantee segmentation reliability and a significant degree of automation. The present study utilizes three-dimensional numerical schemes for psoas segmentation in low-dose X-ray computed tomography images. Specifically, here we focused on the level set methodology and compared the performances of two standard approaches, a classical evolution model and a three-dimension geodesic model, with the performances of an original first-order modification of this latter one. The results of this analysis show that these gradient-based schemes guarantee reliability with respect to manual segmentation and that the first-order scheme requires a computational burden that is significantly smaller than the one needed by the second-order approach.


title: Anomalous dimensions of twist-two operators in extended N=2 and N=4 super Yang-Mills theories

abstract: We perform direct diagrammatic calculations of the anomalous dimensions of twist-two operators in extended N=2 and N=4 super Yang-Mills theories (SYM). In the case of N=4 SYM, we compute the four-loop anomalous dimension of the twist-two operator for several fixed values of Lorentz spin. This is the first direct diagrammatic calculation of this kind, and we confirm results previously obtained by means of integrability. For N=2 SYM, we obtain the general result for the anomalous dimension at third order of perturbation theory and find the three-loop Cusp anomalous dimension.


title: SuperPrimitive: Scene Reconstruction at a Primitive Level

abstract: Joint camera pose and dense geometry estimation from a set of images or a monocular video remains a challenging problem due to its computational complexity and inherent visual ambiguities. Most dense incremental reconstruction systems operate directly on image pixels and solve for their 3D positions using multi-view geometry cues. Such pixel-level approaches suffer from ambiguities or violations of multi-view consistency (e.g. caused by textureless or specular surfaces). We address this issue with a new image representation which we call a SuperPrimitive. SuperPrimitives are obtained by splitting images into semantically correlated local regions and enhancing them with estimated surface normal directions, both of which are predicted by state-of-the-art single image neural networks. This provides a local geometry estimate per SuperPrimitive, while their relative positions are adjusted based on multi-view observations. We demonstrate the versatility of our new representation by addressing three 3D reconstruction tasks: depth completion, few-view structure from motion, and monocular dense visual odometry.


title: Scaling #DNN-Verification Tools with Efficient Bound Propagation and Parallel Computing

abstract: Deep Neural Networks (DNNs) are powerful tools that have shown extraordinary results in many scenarios, ranging from pattern recognition to complex robotic problems. However, their intricate designs and lack of transparency raise safety concerns when applied in real-world applications. In this context, Formal Verification (FV) of DNNs has emerged as a valuable solution to provide provable guarantees on the safety aspect. Nonetheless, the binary answer (i.e., safe or unsafe) could be not informative enough for direct safety interventions such as safety model ranking or selection. To address this limitation, the FV problem has recently been extended to the counting version, called #DNN-Verification, for the computation of the size of the unsafe regions in a given safety property's domain. Still, due to the complexity of the problem, existing solutions struggle to scale on real-world robotic scenarios, where the DNN can be large and complex. To address this limitation, inspired by advances in FV, in this work, we propose a novel strategy based on reachability analysis combined with Symbolic Linear Relaxation and parallel computing to enhance the efficiency of existing exact and approximate FV for DNN counters. The empirical evaluation on standard FV benchmarks and realistic robotic scenarios shows a remarkable improvement in scalability and efficiency, enabling the use of such techniques even for complex robotic applications.


title: A conservative hybrid physics-informed neural network method for Maxwell-Amp\`{e}re-Nernst-Planck equations

abstract: Maxwell-Amp\`{e}re-Nernst-Planck (MANP) equations were recently proposed to model the dynamics of charged particles. In this study, we enhance a numerical algorithm of this system with deep learning tools. The proposed hybrid algorithm provides an automated means to determine a proper approximation for the dummy variables, which can otherwise only be obtained through massive numerical tests. In addition, the original method is validated for 2-dimensional problems. However, when the spatial dimension is one, the original curl-free relaxation component is inapplicable, and the approximation formula for dummy variables, which works well in a 2-dimensional scenario, fails to provide a reasonable output in the 1-dimensional case. The proposed method can be readily generalised to cases with one spatial dimension. Experiments show numerical stability and good convergence to the steady-state solution obtained from Poisson-Boltzmann type equations in the 1-dimensional case. The experiments conducted in the 2-dimensional case indicate that the proposed method preserves the conservation properties.


title: Quasiparticle dynamics in a superconducting qubit irradiated by a localized infrared source

abstract: A known source of decoherence in superconducting qubits is the presence of broken Cooper pairs, or quasiparticles. These can be generated by high-energy radiation, either present in the environment or purposefully introduced, as in the case of some hybrid quantum devices. Here, we systematically study the properties of a transmon qubit under illumination by focused infrared radiation with various powers, durations, and spatial locations. Despite the high energy of incident photons, our observations agree well with a model of low-energy quasiparticle dynamics dominated by trapping. This technique can be used for understanding and potentially mitigating the effects of high-energy radiation on superconducting circuits with a variety of geometries and materials.


title: Phase Diagram of the Square-Lattice $t$-$J$-$V$ Model for Electron-Doped Cuprates

abstract: Motivated by significant discrepancies between experimental observations of electron-doped cuprates and numerical results of the Hubbard and $t$-$J$ models, we investigate the role of inter-site interactions $V$ by studying the $t$-$J$-$V$ model on square lattices. Based on large-scale density matrix renormalization group simulations, we identify the ground-state phase diagram across varying inter-site interactions $V$ and doping concentration $\delta$. We find that the phase diagram with finite inter-site interactions $2\lesssim V/J\lesssim3$ offers a more accurate description of electron-doped cuprates than the conventional Hubbard and $t$-$J$ models. Moreover, we reveal the role of inter-site interactions $V$ at varying doping levels: at light doping, inter-site interactions favor N\'{e}el antiferromagnetic order, and suppress both superconductivity and charge density wave; around optimal doping, these interactions support a pseudogap-like phase while suppressing superconductivity, and we further perform the slave boson mean-field analysis to understand the numerical results microscopically; at higher doping, the effects of inter-site interactions become insignificant, with our numerical predictions suggesting the emergence of incommensurate spin density wave phase. Our specific focus around optimal doping with various inter-site interactions identifies successive phases including phase separation, uniform $d$-wave SC and a pseudogap-like phase, and reveals a relative insensitivity of charge density wave to superconductivity. Our study suggests the $t$-$J$-$V$ model as the minimal model to capture the essential physics of the electron-doped cuprates.


title: An atomic probe of dark matter differential interactions with elementary particles

abstract: Searching for physics beyond the Standard Model is one of the main tasks of experimental physics. Candidates for dark matter include axion-like ultralight bosonic particles. Comagnetometers form ultra-high sensitivity probes for such particles and any exotic field that interacts with the spin of an atom. Here, we propose a multi-atom-species probe that enables not only to discover such fields and measure their spectrum but also to determine the ratios of their coupling strengths to sub-atomic elementary particles, electrons, neutrons and protons. We further show that the multi-faceted capabilities of this probe may be demonstrated with synthetic exotic fields generated by a combination of regular magnetic fields and light-induced fictitious magnetic fields in alkali atoms. These synthetic fields also enable the accurate calibration of any magnetometer or comagnetometer probe for exotic physics.


title: Information content and optimization of self-organized developmental systems

abstract: A key feature of many developmental systems is their ability to self-organize spatial patterns of functionally distinct cell fates. To ensure proper biological function, such patterns must be established reproducibly, by controlling and even harnessing intrinsic and extrinsic fluctuations. While the relevant molecular processes are increasingly well understood, we lack a principled framework to quantify the performance of such stochastic self-organizing systems. To that end, we introduce a new information-theoretic measure for self-organized fate specification during embryonic development. We show that the proposed measure assesses the total information content of fate patterns, and decomposes it into interpretable contributions corresponding to the positional and correlational information. By optimizing the proposed measure, our framework provides a normative theory for developmental circuits, which we demonstrate on lateral inhibition, cell type proportioning, and reaction-diffusion models of self-organization. This paves a way towards a classification of developmental systems based on a common information-theoretic language, thereby organizing the zoo of implicated chemical and mechanical signaling processes.

categories: physics.bio-ph cond-mat.stat-mech nlin.AO nlin.PS q-bio.TO


title: A robust assessment of the local anisotropy of the Hubble constant

abstract: Magnitude predictions of $\Lambda$CDM, as parametrized by the Planck collaboration, are not consistent with the supernova data of the whole Pantheon+ sample even when, in order to take into account the uncertainty about its value, the Hubble constant is adjusted. This is a likely consequence of the increase of the number of low-redshift supernovae in the Pantheon+ sample, with respect to previous such samples. Indeed, when supernovae at redshifts below 0.035 are ignored, with H0=73.4 km/s/Mpc, $\Lambda$CDM predictions become consistent with Pantheon+ data. Interestingly, this is also the case when subsets of low-redshift supernovae roughly centered on the direction of the CMB dipole are considered, together with high-redshift ones, at least when CMB and peculiar velocities corrections are taken into account for the redshifts. These results seem robust, since they are also obtained with a simple, single-parameter tired-light model.


title: PSCR: Patches Sampling-based Contrastive Regression for AIGC Image Quality Assessment

abstract: In recent years, Artificial Intelligence Generated Content (AIGC) has gained widespread attention beyond the computer science community. Due to various issues arising from continuous creation of AI-generated images (AIGI), AIGC image quality assessment (AIGCIQA), which aims to evaluate the quality of AIGIs from human perception perspectives, has emerged as a novel topic in the field of computer vision. However, most existing AIGCIQA methods directly regress predicted scores from a single generated image, overlooking the inherent differences among AIGIs and scores. Additionally, operations like resizing and cropping may cause global geometric distortions and information loss, thus limiting the performance of models. To address these issues, we propose a patches sampling-based contrastive regression (PSCR) framework. We suggest introducing a contrastive regression framework to leverage differences among various generated images for learning a better representation space. In this space, differences and score rankings among images can be measured by their relative scores. By selecting exemplar AIGIs as references, we also overcome the limitations of previous models that could not utilize reference images on the no-reference image databases. To avoid geometric distortions and information loss in image inputs, we further propose a patches sampling strategy. To demonstrate the effectiveness of our proposed PSCR framework, we conduct extensive experiments on three mainstream AIGCIQA databases including AGIQA-1K, AGIQA-3K and AIGCIQA2023. The results show significant improvements in model performance with the introduction of our proposed PSCR framework. Code will be available at \url{https://github.com/jiquan123/PSCR}.


title: Dynamic Spatiotemporal ARCH Models: Small and Large Sample Results

abstract: This paper explores the estimation of a dynamic spatiotemporal autoregressive conditional heteroscedasticity (ARCH) model. The log-volatility term in this model can depend on (i) the spatial lag of the log-squared outcome variable, (ii) the time-lag of the log-squared outcome variable, (iii) the spatiotemporal lag of the log-squared outcome variable, (iv) exogenous variables, and (v) the unobserved heterogeneity across regions and time, i.e., the regional and time fixed effects. We examine the small and large sample properties of two quasi-maximum likelihood estimators and a generalized method of moments estimator for this model. We first summarize the theoretical properties of these estimators and then compare their finite sample properties through Monte Carlo simulations.


title: Supporting punishment via taxation in a structured population

abstract: Taxes are an essential and uniformly applied institution for maintaining modern societies. However, the levels of taxation remain an intensive debate topic among citizens. If each citizen contributes to common goals, a minimal tax would be sufficient to cover common expenses. However, this is only achievable at high cooperation level; hence, a larger tax bracket is required. A recent study demonstrated that if an appropriate tax partially covers the punishment of defectors, cooperation can be maintained above a critical level of the multiplication factor, characterizing the synergistic effect of common ventures. Motivated by real-life experiences, we revisited this model by assuming an interactive structure among competitors. All other model elements, including the key parameters characterizing the cost of punishment, fines, and tax level, remain unchanged. The aim was to determine how the spatiality of a population influences the competition of strategies when punishment is partly based on a uniform tax paid by all participants. This extension results in a more subtle system behavior in which different ways of coexistence can be observed, including dynamic pattern formation owing to cyclic dominance among competing strategies.


title: Deep-Learning-Assisted Analysis of Cataract Surgery Videos

abstract: Following the technological advancements in medicine, the operation rooms are evolving into intelligent environments. The context-aware systems (CAS) can comprehensively interpret the surgical state, enable real-time warning, and support decision-making, especially for novice surgeons. These systems can automatically analyze surgical videos and perform indexing, documentation, and post-operative report generation. The ever-increasing demand for such automatic systems has sparked machine-learning-based approaches for surgical video analysis. This thesis addresses the significant challenges in cataract surgery video analysis to pave the way for building efficient context-aware systems. The main contributions of this thesis are five folds: (1) This thesis demonstrates that spatio-temporal localization of the relevant content can considerably improve phase recognition accuracy. (2) This thesis proposes a novel deep-learning-based framework for relevance-based compression to enable real-time streaming and adaptive storage of cataract surgery videos. (3) Several convolutional modules are proposed to boost the networks' semantic interpretation performance in challenging conditions. These challenges include blur and reflection distortion, transparency, deformability, color and texture variation, blunt edges, and scale variation. (4) This thesis proposes and evaluates the first framework for automatic irregularity detection in cataract surgery videos. (5) To alleviate the requirement for manual pixel-based annotations, this thesis proposes novel strategies for self-supervised representation learning adapted to semantic segmentation.


title: An Effective Field Theory study of medium heavy quark evolution

abstract: The evolution of hard probes in a medium is a complex multiscale problem that significantly benefits from the use of Effective Field Theories (EFTs). Within the EFT framework, we aim to define a series of EFTs in a way that addresses each energy scale individually in separate steps. However, studying hard probes in a medium presents challenges. This is because an EFT is typically constructed by formulating the most general Lagrangian compatible with the problem's symmetries. Nevertheless, medium effects may not always be encoded adequately in an effective action. In this paper, we construct an EFT that is valid for studying the evolution of a heavy quark in a QCD plasma containing few other heavy quarks, where degrees of freedom with an energy of the order of the temperature scale are integrated out. Through this example, we explicitly demonstrate how to handle the doubling of degrees that arise in non-equilibrium field theory. As a result, we derive a Fokker-Planck equation using only symmetry and power counting arguments. The methods introduced in this paper will pave the way for future developments in the study of quarkonium suppression.


title: A planet or primordial black hole in the outer region of the Solar system and the dust flow near Earth orbit

abstract: In recent years, evidence has been obtained that in the outer region of the Solar System (in the inner part of the Oort cloud), at a distance $\sim300-700$ AU from the Sun, there may be a captured planet or a primordial black hole. In this paper, we show that the gravitational scattering of dust particles in the same region on this object can transfer them to new elongated orbits reaching the Earth's orbit. With the mass of the captured object of the order of 5-10 Earth masses, the calculated dust flow near the Earth $\sim0.1-3$$\mu$g m$^{-2}$ yr$^{-1}$ is comparable in order of magnitude with the observed flow. This effect gives a joint restriction on the parameters of the captured object and on the amount of dust in the Oort cloud.


title: Universal patterns of skyrmion magnetizations unveiled by defect implantation

abstract: Skyrmions are spin-swirling textures hosting wonderful properties with potential implications in information technology. Such magnetic particles carry a magnetization, whose amplitude is crucial to establish them as robust magnetic bits, while their topological nature gives rise to a plethora of exquisite features such as topological protection, the skyrmion and topological Hall effects as well as the topological orbital moment. These effects are all induced by an emergent magnetic field directly proportional to the three-spin scalar chirality, $\chi= (\mathbf{S}_i\times\mathbf{S}_j)\cdot \mathbf{S}_k$, and shaped by the peculiar spatial dependence of the magnetization. Here, we demonstrate the existence of novel chiral magnetizations emerging from the interplay of spin-orbit interaction and either $\chi$ or the two-spin vector chirality $\boldsymbol{\kappa} = \mathbf{S}_i\times\mathbf{S}_j$. By scrutinizing correlations among the spin, orbital (trivial and chiral) magnetizations, we unveil from ab-initio universal patterns, quantify the rich set of magnetizations carried by single skyrmions generated in PdFe bilayer on Ir(111) surface and demonstrate the ability to engineer their magnitude via controlled implantation of impurities. We anticipate that our findings can guide the design of disruptive storage devices based on skyrmionic bits by encoding the desired magnetization with strategic seeding of defects.


title: Small Schwarzschild de Sitter black holes, the future boundary and islands

abstract: We continue the study of 4-dimensional Schwarzschild de Sitter black holes in the regime where the black hole mass is small compared with the de Sitter scale, following arXiv:2207.10724 [hep-th]. The de Sitter temperature is very low compared with that of the black hole. We consider the future boundary as the location where the black hole Hawking radiation is collected. Using 2-dimensional tools, we find unbounded growth of the entanglement entropy of radiation as the radiation region approaches the entire future boundary. Self-consistently including appropriate late time islands emerging just inside the black hole horizon leads to a reasonable Page curve. We also discuss other potential island solutions which show inconsistencies.


title: Improving Subgraph-GNNs via Edge-Level Ego-Network Encodings

abstract: We present a novel edge-level ego-network encoding for learning on graphs that can boost Message Passing Graph Neural Networks (MP-GNNs) by providing additional node and edge features or extending message-passing formats. The proposed encoding is sufficient to distinguish Strongly Regular Graphs, a family of challenging 3-WL equivalent graphs. We show theoretically that such encoding is more expressive than node-based sub-graph MP-GNNs. In an empirical evaluation on four benchmarks with 10 graph datasets, our results match or improve previous baselines on expressivity, graph classification, graph regression, and proximity tasks -- while reducing memory usage by 18.1x in certain real-world settings.


title: Characterization and regulation of statistical properties in Er-doped random fiber laser

abstract: Er-doped random fiber laser (ERFL) is a complex physical system, and understanding its intrinsic physical mechanisms is crucial for promoting applications. In this paper, we experimentally investigate the time-domain statistical properties of ERFL under full-bandwidth condition for the first time. We also analyze the effects of the transmission process and amplification process on the output characteristics of ERFL, on the basis of which we realize its regulation. This study guides RFL systems requiring transmission and amplification, offering fresh insights for regulating the time-domain stability.


title: Hypergraph-Guided Disentangled Spectrum Transformer Networks for Near-Infrared Facial Expression Recognition

abstract: With the strong robusticity on illumination variations, near-infrared (NIR) can be an effective and essential complement to visible (VIS) facial expression recognition in low lighting or complete darkness conditions. However, facial expression recognition (FER) from NIR images presents more challenging problem than traditional FER due to the limitations imposed by the data scale and the difficulty of extracting discriminative features from incomplete visible lighting contents. In this paper, we give the first attempt to deep NIR facial expression recognition and proposed a novel method called near-infrared facial expression transformer (NFER-Former). Specifically, to make full use of the abundant label information in the field of VIS, we introduce a Self-Attention Orthogonal Decomposition mechanism that disentangles the expression information and spectrum information from the input image, so that the expression features can be extracted without the interference of spectrum variation. We also propose a Hypergraph-Guided Feature Embedding method that models some key facial behaviors and learns the structure of the complex correlations between them, thereby alleviating the interference of inter-class similarity. Additionally, we have constructed a large NIR-VIS Facial Expression dataset that includes 360 subjects to better validate the efficiency of NFER-Former. Extensive experiments and ablation studies show that NFER-Former significantly improves the performance of NIR FER and achieves state-of-the-art results on the only two available NIR FER datasets, Oulu-CASIA and Large-HFE.


title: Multi-Energy Guided Image Translation with Stochastic Differential Equations for Near-Infrared Facial Expression Recognition

abstract: Illumination variation has been a long-term challenge in real-world facial expression recognition(FER). Under uncontrolled or non-visible light conditions, Near-infrared (NIR) can provide a simple and alternative solution to obtain high-quality images and supplement the geometric and texture details that are missing in the visible domain. Due to the lack of existing large-scale NIR facial expression datasets, directly extending VIS FER methods to the NIR spectrum may be ineffective. Additionally, previous heterogeneous image synthesis methods are restricted by low controllability without prior task knowledge. To tackle these issues, we present the first approach, called for NIR-FER Stochastic Differential Equations (NFER-SDE), that transforms face expression appearance between heterogeneous modalities to the overfitting problem on small-scale NIR data. NFER-SDE is able to take the whole VIS source image as input and, together with domain-specific knowledge, guide the preservation of modality-invariant information in the high-frequency content of the image. Extensive experiments and ablation studies show that NFER-SDE significantly improves the performance of NIR FER and achieves state-of-the-art results on the only two available NIR FER datasets, Oulu-CASIA and Large-HFE.


title: On the rank of the communication matrix for deterministic two-way finite automata

abstract: The communication matrix for two-way deterministic finite automata (2DFA) with $n$ states is defined for an automaton over a full alphabet of all $(2n+1)^n$ possible symbols: its rows and columns are indexed by strings, and the entry $(u, v)$ is $1$ if $uv$ is accepted by the automaton, and $0$ otherwise. With duplicate rows and columns removed, this is a square matrix of order $n(n^n-(n-1)^n)+1$, and its rank is known to be a lower bound on the number of states necessary to transform an $n$-state 2DFA to a one-way unambiguous finite automaton (UFA). This paper determines this rank, showing that it is exactly $f(n)=\sum_{k=1}^n \binom{n}{k-1} \binom{n}{k} \binom{2k-2}{k-1} =(1+o(1)) \frac{3\sqrt{3}}{8\pi n} 9^n$, and this function becomes the new lower bound on the state complexity of the 2DFA to UFA transformation, thus improving a recent lower bound by S. Petrov and Okhotin (``On the transformation of two-way deterministic finite automata to unambiguous finite automata'', Inf. Comput., 2023). The key element of the proof is determining the rank of a $k! \times k!$ submatrix, with its rows and columns indexed by permutations, where the entry $(\pi, \sigma)$ is $1$ if $\sigma \circ \pi$ is a cycle of length $k$, and 0 otherwise; using the methods of group representation theory it is shown that its rank is exactly $\binom{2k-2}{k-1}$, and this implies the above formula for $f(n)$.


title: Ensemble Kalman Filtering Meets Gaussian Process SSM for Non-Mean-Field and Online Inference

abstract: The Gaussian process state-space models (GPSSMs) represent a versatile class of data-driven nonlinear dynamical system models. However, the presence of numerous latent variables in GPSSM incurs unresolved issues for existing variational inference approaches, particularly under the more realistic non-mean-field (NMF) assumption, including extensive training effort, compromised inference accuracy, and infeasibility for online applications, among others. In this paper, we tackle these challenges by incorporating the ensemble Kalman filter (EnKF), a well-established model-based filtering technique, into the NMF variational inference framework to approximate the posterior distribution of the latent states. This novel marriage between EnKF and GPSSM not only eliminates the need for extensive parameterization in learning variational distributions, but also enables an interpretable, closed-form approximation of the evidence lower bound (ELBO). Moreover, owing to the streamlined parameterization via the EnKF, the new GPSSM model can be easily accommodated in online learning applications. We demonstrate that the resulting EnKF-aided online algorithm embodies a principled objective function by ensuring data-fitting accuracy while incorporating model regularizations to mitigate overfitting. We also provide detailed analysis and fresh insights for the proposed algorithms. Comprehensive evaluation across diverse real and synthetic datasets corroborates the superior learning and inference performance of our EnKF-aided variational inference algorithms compared to existing methods.


title: A leave-one-out approach to approximate message passing

abstract: Approximate message passing (AMP) has emerged both as a popular class of iterative algorithms and as a powerful analytic tool in a wide range of statistical estimation problems and statistical physics models. A well established line of AMP theory proves Gaussian approximations for the empirical distributions of the AMP iterate in the high dimensional limit, under the GOE random matrix model and its variants. This paper provides a non-asymptotic, leave-one-out representation for the AMP iterate that holds under a broad class of Gaussian random matrix models with general variance profiles. In contrast to the typical AMP theory that describes the empirical distributions of the AMP iterate via a low dimensional state evolution, our leave-one-out representation yields an intrinsically high dimensional state evolution formula which provides non-asymptotic characterizations for the possibly heterogeneous, entrywise behavior of the AMP iterate under the prescribed random matrix models. To exemplify some distinct features of our AMP theory in applications, we analyze, in the context of regularized linear estimation, the precise stochastic behavior of the Ridge estimator for independent and non-identically distributed observations whose covariates exhibit general variance profiles. We find that its finite-sample distribution is characterized via a weighted Ridge estimator in a heterogeneous Gaussian sequence model. Notably, in contrast to the i.i.d. sampling scenario, the effective noise and regularization are now full dimensional vectors determined via a high dimensional system of equations. Our leave-one-out method of proof differs significantly from the widely adopted conditioning approach for rotational invariant ensembles, and relies instead on an inductive method that utilizes almost solely integration-by-parts and concentration techniques.


title: Circular objects do not melt the slowest in water

abstract: We report on the melting dynamics of ice suspended in fresh water and subject to natural convective flows. Using direct numerical simulations we investigate the melt rate of ellipsoidal objects for $2.32\times 10^4 \leq \text{Ra} \leq 7.61\times 10^8$, where \text{Ra} is the Rayleigh number defined with the temperature difference between the ice and the surrounding water. We reveal that the system exhibits non-monotonic behavior in three control parameters. As a function of the aspect ratio of the ellipsoidal, the melting time shows a distinct minimum that is different from a disk which has the minimum perimeter. Furthermore, also with \text{Ra} the system shows a non-monotonic trend, since for large \text{Ra} and large aspect ratio the flow separates, leading to distinctly different dynamics. Lastly, since the density of water is non-monotonic with temperature, the melt rate depends non-monotonically also on the ambient temperature, as for intermediate temperatures ($\unit{4}{\celsius}$--$\unit{7}{\celsius}$) the flow is (partially) reversed. In general, the shape which melts the slowest is quite distinct from that of a disk.


title: Ordered structures with no finite monomorphic decomposition. Application to the profile of hereditary classes

abstract: We present a structural approach of some results about jumps in the behavior of the profile (alias generating function) of hereditary classes of finite structures. We consider the following notion due to N.Thi\'ery and the second author. A \emph{monomorphic decomposition} of a relational structure $R$ is a partition of its domain $V(R)$ into a family of sets $(V_x)_{x\in X}$ such that the restrictions of $R$ to two finite subsets $A$ and $A'$ of $V(R)$ are isomorphic provided that the traces $A\cap V_x$ and $A'\cap V_x$ have the same size for each $x\in X$. Let $\mathscr S_\mu $ be the class of relational structures of signature $\mu$ which do not have a finite monomorphic decomposition. We show that if a hereditary subclass $\mathscr D$ of $\mathscr S_\mu $ is made of ordered relational structures then it contains a finite subset $\mathfrak A$ such that every member of $\mathscr D$ embeds some member of $\mathfrak A$. Furthermore, for each $R\in \mathfrak A$ the profile of the age $\age(R)$ of $R$ (made of finite substructures of $R$) is at least exponential. We deduce that if the profile of a hereditary class of finite ordered structures is not bounded above by a polynomial then it is at least exponential. For ordered graphs, this result is a part of classification obtained by Balogh, Bollob\'as and Morris (2006).


title: Auslander-Reiten Conjecture, Finite $C$-Injective Dimension of $\operatorname{Hom}$, and vanishing of $\operatorname{Ext}$

abstract: Let $R$ be a Noetherian local ring, and let $C$ be a semidualizing $R$-module. In this paper, we present some results concerning to vanishing of $\operatorname{Ext}$ and finite injective dimension of $\operatorname{Hom}$. Additionally, we extend these results in terms of finite $C$-injective dimension of $\operatorname{Hom}$. We also investigate the consequences of some of these extensions in the case where $R$ is Cohen-Macaulay, and $C$ is a canonical module for $R.$ Furthermore, we provide positive answers to the Auslander-Reiten conjecture for finitely generated $R$-modules $M$ such that $\mathcal{I}_C\operatorname{-id}_R(\operatorname{Hom}_R(M,R))<\infty$ or $M \in \mathcal{A}_C(R)$ with $\mathcal{I}_C \operatorname{-id}_R(\operatorname{Hom}_R(M,M))<\infty$. Moreover, we derive a number of criteria for a semidualizing $R$-module $C$ to be a canonical module for $R$ in terms of the vanishing of $\operatorname{Ext}$ and the finite $C$-injective dimension of $\operatorname{Hom}$.


title: Diffusion for Natural Image Matting

abstract: We aim to leverage diffusion to address the challenging image matting task. However, the presence of high computational overhead and the inconsistency of noise sampling between the training and inference processes pose significant obstacles to achieving this goal. In this paper, we present DiffMatte, a solution designed to effectively overcome these challenges. First, DiffMatte decouples the decoder from the intricately coupled matting network design, involving only one lightweight decoder in the iterations of the diffusion process. With such a strategy, DiffMatte mitigates the growth of computational overhead as the number of samples increases. Second, we employ a self-aligned training strategy with uniform time intervals, ensuring a consistent noise sampling between training and inference across the entire time domain. Our DiffMatte is designed with flexibility in mind and can seamlessly integrate into various modern matting architectures. Extensive experimental results demonstrate that DiffMatte not only reaches the state-of-the-art level on the Composition-1k test set, surpassing the best methods in the past by 5% and 15% in the SAD metric and MSE metric respectively, but also show stronger generalization ability in other benchmarks.


title: Switching Frequency Limitation with Finite Control Set Model Predictive Control via Slack Variables

abstract: Past work proposed an extension to finite control set model predictive control to track both a current reference and a switching frequency reference, simultaneously. Such an objective can jeopardize the current tracking performance, and this can potentially be alleviated by instead limiting the switching frequency. To this end, we propose to limit the switching frequency in finite control set model predictive control. The switching frequency is captured with an infinite impulse response filter and bounded by an inequality constraint; its corresponding slack variable is penalized in the cost function. To solve the resulting problem efficiently, a sphere decoder with a computational speed-up is presented.


title: Polarization dynamics from moment equations

abstract: We derive an expression for the local transverse polarization of a boost-invariant expanding system of massive particles, which involves a set of dynamical spin moments. Starting from spin kinetic theory, we obtain a closed set of equations of motion for these spin moments. These equations are valid during the full evolution of the system, from free streaming to local equilibrium, and can be used to study polarization phenomena in relativistic heavy-ion collisions.


title: Van Hove singularity-induced negative magnetoresistance in Dirac semimetals

abstract: Negative magnetoresistance (NMR) is a marked feature of Dirac semimetals, and may be caused by multiple mechanisms, such as the chiral anomaly, the Zeeman energy, the quantum interference effect, and the orbital moment. Recently, an experiment on Dirac semimetal Cd$_3$As$_2$ thin films revealed a new NMR feature that depends strongly on the thickness of the sample [T. Schumann, \emph{et al}., Phys. Rev. B 95, 241113(R) (2017)]. Here, we introduce a new mechanism of inducing NMR via the presence of the van Hove singularity (VHS) in the density of states. Theoretical fitting of the experimental data on magnetoconductivity and magnetoresistance shows good agreement, indicating that the observed NMR in thin films of Cd$_3$As$_2$ can be attributed to the VHS. This work provides new insights into the underlying of Dirac semimetals.


title: A Logical Framework with Infinitary Terms

abstract: Logical frameworks are successful in modeling proof systems. Recently, CoLF extended the logical framework LF to support higher-order rational terms that enable adequate encoding of circular objects and derivations. In this paper, we propose CoLF$^\omega$ as an alternative interpretation of CoLF-style signatures where terms are taken to be all possibly infinitary terms that are consistent with a given signature. In particular, we propose the notion of productive B\"ohm trees, a particular kind of typed $\bot$-free B\"ohm trees that are closed under hereditary substitution. We show that the productive B\"ohm trees are capable of meta-encoding their own structure. Overall, we hope to establish CoLF$^\omega$ as a new formal framework for the encoding of infinitary regular and non-regular structures.


title: Local Randomized Neural Networks with Hybridized Discontinuous Petrov-Galerkin Methods for Stokes-Darcy Flows

abstract: This paper introduces a new numerical approach that integrates local randomized neural networks (LRNNs) and the hybridized discontinuous Petrov-Galerkin (HDPG) method for solving coupled fluid flow problems. The proposed method partitions the domain of interest into several subdomains and constructs an LRNN on each subdomain. Then, the HDPG scheme is used to couple the LRNNs to approximate the unknown functions. We develop LRNN-HDPG methods based on velocity-stress formulation to solve two types of problems: Stokes-Darcy problems and Brinkman equations, which model the flow in porous media and free flow. We devise a simple and effective way to deal with the interface conditions in the Stokes-Darcy problems without adding extra terms to the numerical scheme. We conduct extensive numerical experiments to demonstrate the stability, efficiency, and robustness of the proposed method. The numerical results show that the LRNN-HDPG method can achieve high accuracy with a small number of degrees of freedom.


title: Dig-CSI: A Distributed and Generative Model Assisted CSI Feedback Training Framework

abstract: The advent of deep learning (DL)-based models has significantly advanced Channel State Information (CSI) feedback mechanisms in wireless communication systems. However, traditional approaches often suffer from high communication overhead and potential privacy risks due to the centralized nature of CSI data processing. To address these challenges, we design a CSI feedback training framework called Dig-CSI, in which the dataset for training the CSI feedback model is produced by the distributed generators uploaded by each user equipment (UE), but not through local data upload. Each UE trains an autoencoder, where the decoder is considered as the distributed generator, with local data to gain reconstruction accuracy and the ability to generate. Experimental results show that Dig-CSI can train a global CSI feedback model with comparable performance to the model trained with classical centralized learning with a much lighter communication overhead.


title: Chern-Simons theory and string topology

abstract: We construct chain-level $S^1$-equivariant string topology for each simply connected closed manifold. This amounts to constructing a Maurer-Cartan element for the canonical involutive Lie bialgebra (IBL) structure on the dual cyclic bar complex of its de Rham cohomology which is unique up to ${\rm IBL}_\infty$ gauge equivalence. The construction involves integrals over configuration spaces associated to trivalent ribbon graphs, which can be seen as a version of perturbative Chern-Simons theory in arbitrary dimension.


title: Weakly Supervised Video Individual CountingWeakly Supervised Video Individual Counting

abstract: Video Individual Counting (VIC) aims to predict the number of unique individuals in a single video. % Existing methods learn representations based on trajectory labels for individuals, which are annotation-expensive. % To provide a more realistic reflection of the underlying practical challenge, we introduce a weakly supervised VIC task, wherein trajectory labels are not provided. Instead, two types of labels are provided to indicate traffic entering the field of view (inflow) and leaving the field view (outflow). % We also propose the first solution as a baseline that formulates the task as a weakly supervised contrastive learning problem under group-level matching. In doing so, we devise an end-to-end trainable soft contrastive loss to drive the network to distinguish inflow, outflow, and the remaining. % To facilitate future study in this direction, we generate annotations from the existing VIC datasets SenseCrowd and CroHD and also build a new dataset, UAVVIC. % Extensive results show that our baseline weakly supervised method outperforms supervised methods, and thus, little information is lost in the transition to the more practically relevant weakly supervised task. The code and trained model will be public at \href{https://github.com/streamer-AP/CGNet}{CGNet}


title: Data-Free Hard-Label Robustness Stealing Attack

abstract: The popularity of Machine Learning as a Service (MLaaS) has led to increased concerns about Model Stealing Attacks (MSA), which aim to craft a clone model by querying MLaaS. Currently, most research on MSA assumes that MLaaS can provide soft labels and that the attacker has a proxy dataset with a similar distribution. However, this fails to encapsulate the more practical scenario where only hard labels are returned by MLaaS and the data distribution remains elusive. Furthermore, most existing work focuses solely on stealing the model accuracy, neglecting the model robustness, while robustness is essential in security-sensitive scenarios, e.g., face-scan payment. Notably, improving model robustness often necessitates the use of expensive techniques such as adversarial training, thereby further making stealing robustness a more lucrative prospect. In response to these identified gaps, we introduce a novel Data-Free Hard-Label Robustness Stealing (DFHL-RS) attack in this paper, which enables the stealing of both model accuracy and robustness by simply querying hard labels of the target model without the help of any natural data. Comprehensive experiments demonstrate the effectiveness of our method. The clone model achieves a clean accuracy of 77.86% and a robust accuracy of 39.51% against AutoAttack, which are only 4.71% and 8.40% lower than the target model on the CIFAR-10 dataset, significantly exceeding the baselines. Our code is available at: https://github.com/LetheSec/DFHL-RS-Attack.


title: Language-Conditioned Semantic Search-Based Policy for Robotic Manipulation Tasks

abstract: Reinforcement learning and Imitation Learning approaches utilize policy learning strategies that are difficult to generalize well with just a few examples of a task. In this work, we propose a language-conditioned semantic search-based method to produce an online search-based policy from the available demonstration dataset of state-action trajectories. Here we directly acquire actions from the most similar manipulation trajectories found in the dataset. Our approach surpasses the performance of the baselines on the CALVIN benchmark and exhibits strong zero-shot adaptation capabilities. This holds great potential for expanding the use of our online search-based policy approach to tasks typically addressed by Imitation Learning or Reinforcement Learning-based policies.


title: Simulation of sediment incipience around the vibrating monopile

abstract: Based on the fluid volume fraction large eddy simulation discrete phase coupling model, the water and sediment flow around the vibrating monopile was simulated. The discrete phase momentum model was enhanced using the force distribution of the particle phase on the bed surface. Additionally, the flow dynamics and sediment incipience around a vibrating monopile was replicated through the use of a sediment incipience Shields number. The results suggest that monopile vibrations amplify the negative incipience of sediment in both the front deceleration region and the wake reflux region. Furthermore, within the periodic flow field surrounding the monopile, the temporal changes in the sediment incipience Shields number does not consistently match the temporal changes in the spatial average velocity.


title: The survival of scientific stylization

abstract: This study elaborates a text-based metric to quantify the unique position of stylized scientific research, characterized by its innovative integration of diverse knowledge components and potential to pivot established scientific paradigms. Our analysis reveals a concerning decline in stylized research, highlighted by its comparative undervaluation in terms of citation counts and protracted peer-review duration. Despite facing these challenges, the disruptive potential of stylized research remains robust, consistently introducing groundbreaking questions and theories. This paper posits that substantive reforms are necessary to incentivize and recognize the value of stylized research, including optimizations to the peer-review process and the criteria for evaluating scientific impact. Embracing these changes may be imperative to halt the downturn in stylized research and ensure enduring scholarly exploration in endless frontiers.


title: AesFA: An Aesthetic Feature-Aware Arbitrary Neural Style Transfer

abstract: Neural style transfer (NST) has evolved significantly in recent years. Yet, despite its rapid progress and advancement, existing NST methods either struggle to transfer aesthetic information from a style effectively or suffer from high computational costs and inefficiencies in feature disentanglement due to using pre-trained models. This work proposes a lightweight but effective model, AesFA -- Aesthetic Feature-Aware NST. The primary idea is to decompose the image via its frequencies to better disentangle aesthetic styles from the reference image while training the entire model in an end-to-end manner to exclude pre-trained models at inference completely. To improve the network's ability to extract more distinct representations and further enhance the stylization quality, this work introduces a new aesthetic feature: contrastive loss. Extensive experiments and ablations show the approach not only outperforms recent NST methods in terms of stylization quality, but it also achieves faster inference. Codes are available at https://github.com/Sooyyoungg/AesFA.


title: A non-uniform view of Craig interpolation in modal logics with linear frames

abstract: Normal modal logics extending the logic K4.3 of linear transitive frames are known to lack the Craig interpolation property, except some logics of bounded depth such as S5. We turn this `negative' fact into a research question and pursue a non-uniform approach to Craig interpolation by investigating the following interpolant existence problem: decide whether there exists a Craig interpolant between two given formulas in any fixed logic above K4.3. Using a bisimulation-based characterisation of interpolant existence for descriptive frames, we show that this problem is decidable and coNP-complete for all finitely axiomatisable normal modal logics containing K4.3. It is thus not harder than entailment in these logics, which is in sharp contrast to other recent non-uniform interpolation results. We also extend our approach to Priorean temporal logics (with both past and future modalities) over the standard time flows-the integers, rationals, reals, and finite strict linear orders-none of which is blessed with the Craig interpolation property.


title: A Comprehensive Dataset and Automated Pipeline for Nailfold Capillary Analysis

abstract: Nailfold capillaroscopy is widely used in assessing health conditions, highlighting the pressing need for an automated nailfold capillary analysis system. In this study, we present a pioneering effort in constructing a comprehensive nailfold capillary dataset-321 images, 219 videos from 68 subjects, with clinic reports and expert annotations-that serves as a crucial resource for training deep-learning models. Leveraging this dataset, we finetuned three deep learning models with expert annotations as supervised labels and integrated them into a novel end-to-end nailfold capillary analysis pipeline. This pipeline excels in automatically detecting and measuring a wide range of size factors, morphological features, and dynamic aspects of nailfold capillaries. We compared our outcomes with clinical reports. Experiment results showed that our automated pipeline achieves an average of sub-pixel level precision in measurements and 89.9% accuracy in identifying morphological abnormalities. These results underscore its potential for advancing quantitative medical research and enabling pervasive computing in healthcare. Our data and code are available at https://github.com/THU-CS-PI-LAB/ANFC-Automated-Nailfold-Capillary.


title: Normal form of D4-plus singularities of fronts and its applications

abstract: We construct a form of the $D_4^+$-singularity of fronts in $R^3$ which uses coordinate transformation on the source and isometry on the target. As an application, we calculate differential geometric invariants near the $D_4^+$-singularity, and give a Gauss-Bonnet type theorem for fronts allowing to have this singularity.


title: Approximating the distribution of the $L_q$-norm of a random point in a $d$-dimensional cube

abstract: In this note, we assess the accuracy of CLT-based approximations for the volume of intersection of the $d$-dimensional cube $[-1,1]^d$ and an $L_q$-ball centred at the origin; this is clearly equivalent to approximating the distribution of the $L_q$-norm of a random point in a $d$-dimensional cube centered at 0. The approximations are CLT-based where to improve the normal approximation we use the first term in the Edgeworth expansion. We have included a section analysing the information obtained from ChatGPT in response to prompts regarding this theory; in our case, ChatGPT answers were not very helpful. Illustrations of the approximation formulae, as the radius of the ball increases, for different values of $d$ and $q$ are also given, alongside lines showing a Monte Carlo simulation of the intersection volume.


title: Temporal Supervised Contrastive Learning for Modeling Patient Risk Progression

abstract: We consider the problem of predicting how the likelihood of an outcome of interest for a patient changes over time as we observe more of the patient data. To solve this problem, we propose a supervised contrastive learning framework that learns an embedding representation for each time step of a patient time series. Our framework learns the embedding space to have the following properties: (1) nearby points in the embedding space have similar predicted class probabilities, (2) adjacent time steps of the same time series map to nearby points in the embedding space, and (3) time steps with very different raw feature vectors map to far apart regions of the embedding space. To achieve property (3), we employ a nearest neighbor pairing mechanism in the raw feature space. This mechanism also serves as an alternative to data augmentation, a key ingredient of contrastive learning, which lacks a standard procedure that is adequately realistic for clinical tabular data, to our knowledge. We demonstrate that our approach outperforms state-of-the-art baselines in predicting mortality of septic patients (MIMIC-III dataset) and tracking progression of cognitive impairment (ADNI dataset). Our method also consistently recovers the correct synthetic dataset embedding structure across experiments, a feat not achieved by baselines. Our ablation experiments show the pivotal role of our nearest neighbor pairing.


title: Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs

abstract: Large language models (LLMs) encapsulate a vast amount of factual information within their pre-trained weights, as evidenced by their ability to answer diverse questions across different domains. However, this knowledge is inherently limited, relying heavily on the characteristics of the training data. Consequently, using external datasets to incorporate new information or refine the capabilities of LLMs on previously seen information poses a significant challenge. In this study, we compare two common approaches: unsupervised fine-tuning and retrieval-augmented generation (RAG). We evaluate both approaches on a variety of knowledge-intensive tasks across different topics. Our findings reveal that while unsupervised fine-tuning offers some improvement, RAG consistently outperforms it, both for existing knowledge encountered during training and entirely new knowledge. Moreover, we find that LLMs struggle to learn new factual information through unsupervised fine-tuning, and that exposing them to numerous variations of the same fact during training could alleviate this problem.


title: Boundary control problem for stochastic 2d-Navier-Stokes equations

abstract: We study a stochastic velocity tracking problem for the 2D-Navier-Stokes equations perturbed by a multiplicative Gaussian noise. From a physical point of view, the control acts through a boundary injection/suction device with uncertainty, modeled by stochastic non-homogeneous Navier-slip boundary conditions. We show the existence and uniqueness of the solution to the state equation, and prove the existence of an optimal solution to the control problem.


title: On an identity of Delange and its application to Cohen-Ramanujan expansions

abstract: Srinivasa Ramanujan provided Fourier series expansions of certain arithmetical functions in terms of the exponential sum defined by $c_q(n)=\sum\limits_{\substack{{m=1}\\(m,q)=1}}^{q}e^{\frac{2 \pi imn}{q}}$. Later, H. Delange derived the bound $\sum\limits_{q|k}|c_q(n)|\leq n\, 2^{\omega(k)}$ and gave a sufficient condition for such expansions to exist. A. Grytczuk gave an exact value for this bound, and derived a converse implication of the absolute convergence stated by H. Delange. We here show that these results have natural generalizations in terms of the Cohen-Ramanujan sum $c_q^{(s)}(n)$ defined by E. Cohen in [\emph{Duke Mathematical Journal, 16(85-90):2, 1949}]. We derive a bound as well as exact value for $\sum\limits_{q|k}|c_q^{(s)}(n)|$ and provide a sufficient condition for the Cohen-Ramanujan expansions to exist.


title: Lagrangian Properties and Control of Soft Robots Modeled with Discrete Cosserat Rods

abstract: The characteristic ``in-plane" bending associated with soft robots' deformation make them preferred over rigid robots in sophisticated manipulation and movement tasks. Executing such motion strategies to precision in soft deformable robots and structures is however fraught with modeling and control challenges given their infinite degrees-of-freedom. Imposing \textit{piecewise constant strains} (PCS) across (discretized) Cosserat microsolids on the continuum material however, their dynamics become amenable to tractable mathematical analysis. While this PCS model handles the characteristic difficult-to-model ``in-plane" bending well, its Lagrangian properties are not exploited for control in literature neither is there a rigorous study on the dynamic performance of multisection deformable materials for ``in-plane" bending that guarantees steady-state convergence. In this sentiment, we first establish the PCS model's structural Lagrangian properties. Second, we exploit these for control on various strain goal states. Third, we benchmark our hypotheses against an Octopus-inspired robot arm under different constant tip loads. These induce non-constant ``in-plane" deformation and we regulate strain states throughout the continuum in these configurations. Our numerical results establish convergence to desired equilibrium throughout the continuum in all of our tests. Within the bounds here set, we conjecture that our methods can find wide adoption in the control of cable- and fluid-driven multisection soft robotic arms; and may be extensible to the (learning-based) control of deformable agents employed in simulated, mixed, or augmented reality.


title: A reciprocity theorem for the Cohen-Ramanujan sums and its application to Cohen-Ramanujan expansions in the second variable

abstract: For an arithmetical function $f$, its Ramanujan expansion is a series expansion in the form $f(n)=\sum\limits_{k=1}^{\infty}a(k) c_k(n)$ where $a(k)$ are complex numbers and $c_k(n):= \sum\limits_{\substack{m=1\\(m, k)=1}}^{k}e^{\frac{2\pi imn}{k}}$ is the Ramanujan sum. Here we prove a reciprocity result on Cohen-Ramanujan sums $c_k^s(n) :=\sum\limits_{\substack{{h=1}\\(h,k^s)_s=1}}^{k^s}e^{\frac{2\pi i n h}{k^s}}$ to change the position of $k$ and $n$ in a twisted function and use it to prove that for certain arithmetical functions $f$, Cohen-Ramanujan series expansions in the form $\sum\limits_{k=1}^{\infty}a(k) c_k^{(s)}(n)$ exist if and only if expansions in the form $\sum\limits_{k=1}^{\infty}b(k/n) c_n^{(s)}(k)$ exist.


title: The upgrade of the CMS muon system for the High Luminosity LHC

abstract: The muon system of the CMS experiment is expected to upgrade all of its subdetectors for the Phase-2 of the Large Hadron Collider (LHC) that will begin in 2029. The upgrade plans for drift tubes (DTs), cathode strip chambers (CSCs) and resistive place chambers (RPCs) include a new electronics for better performance in high background rate conditions and to sustain the large radiation dose delivered by the high-luminosity LHC (HL-LHC). Two new RPC stations will also be installed to complement CSCs in the forward region $1.8 < |\eta| < 2.4$, while three stations of triple-GEM (gas electron multiplier) detectors will complement CSCs in the region $1.5 < |\eta| < 2.4$ and extend the CMS muon system coverage in the very forward pseudorapidity region up to $|\eta| = 2.8$. We present the goals and status of the CMS muon system upgrade including the performance of the early Phase-2 upgrades demonstrated in Run 3 with proton-proton collisions, the performance validation of the new detectors in test beams and the mass production status of the new stations.


title: Introduction to Morrey spaces

abstract: The present informal set of notes covers the material that has been presented by the author in a series of lectures for the Doctoral School in Mathematics of the Southern Federal State University of Rostov-on-Don in the Fall of 2020 and that develops from the first part of the notes that collect the material of the lectures of the author at the Eurasian National University, Astana, Kazakhstan in the Spring of 2012. The aim is to present some elementary classical properties of Morrey spaces and some corresponding approximation results by smooth functions.


title: ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering

abstract: Real-time rendering of photorealistic and controllable human avatars stands as a cornerstone in Computer Vision and Graphics. While recent advances in neural implicit rendering have unlocked unprecedented photorealism for digital avatars, real-time performance has mostly been demonstrated for static scenes only. To address this, we propose ASH, an animatable Gaussian splatting approach for photorealistic rendering of dynamic humans in real-time. We parameterize the clothed human as animatable 3D Gaussians, which can be efficiently splatted into image space to generate the final rendering. However, naively learning the Gaussian parameters in 3D space poses a severe challenge in terms of compute. Instead, we attach the Gaussians onto a deformable character model, and learn their parameters in 2D texture space, which allows leveraging efficient 2D convolutional architectures that easily scale with the required number of Gaussians. We benchmark ASH with competing methods on pose-controllable avatars, demonstrating that our method outperforms existing real-time methods by a large margin and shows comparable or even better results than offline methods.


title: Modeling the BAO feature in Bispectrum

abstract: We investigate how well a simple leading order perturbation theory model of the bispectrum can fit the BAO feature in the measured bispectrum monopole of galaxies. Previous works showed that perturbative models of galaxy bispectrum start failing at the wavenumbers of k ~ 0.1 Mpc/h. We show that when the BAO feature in the bispectrum is separated it can be successfully modeled up to much higher wavenumbers. We validate our modeling on GLAM simulations that were run with and without the BAO feature in the initial conditions. We also quantify the amount of systematic error due to BAO template being offset from the true cosmology. We find that the systematic errors do not exceed 0.3 per cent for reasonable deviations from the true cosmology.


title: Dealer Strategies in Agent-Based Models

abstract: This paper explores the utility of agent-based simulations in realistically modelling market structures and sheds light on the nuances of optimal dealer strategies. It underscores the contrast between conclusions drawn from probabilistic modelling and agent-based simulations, but also highlights the importance of employing a realistic test bed to analyse intricate dynamics. This is achieved by extending the agent-based model for auction markets by \cite{Chiarella.2008} to include liquidity providers. By constantly and passively quoting, the dealers influence their own wealth but also have ramifications on the market as a whole and the other participating agents. Through synthetic market simulations, the optimal behaviour of different dealer strategies and their consequences on market dynamics are examined. The analysis reveals that dealers exhibiting greater risk aversion tend to yield better performance outcomes. The choice of quote sizes by dealers is strategy-dependent: one strategy demonstrates enhanced performance with larger quote sizes, whereas the other strategy show a better results with smaller ones. Increasing quote size shows positive influence on the market in terms of volatility and kurtosis with both dealer strategies. However, the impact stemming from larger risk aversion is mixed. While one of the dealer strategies shows no discernible effect, the other strategy results in mixed outcomes, encompassing both positive and negative effects.


title: Study of a complete model of the cosmological evolution of a classical scalar field with a Higgs potential. IV. Large-scale model transformations

abstract: A study and numerical modeling of the cosmological evolution of a classical scalar field with the Higgs potential was carried out. Based on the formulated similarity properties of cosmological models, their main characteristics are studied for models with different interaction scales: the Planck scale, the Grand Unified scale and the Standard Model scale. Based on numerical integration, the similarity properties of these models are proven with high accuracy.


title: 4-Chromatic Graphs Have At Least 4 Cycles of Length $0 \bmod 3$

abstract: A 2018 conjecture of Brewster, McGuinness, Moore, and Noel asserts that for $k \ge 3$, if a graph has chromatic number greater than $k$, then it contains at least as many cycles of length $0 \bmod k$ as the complete graph on $k+1$ vertices. Our main result confirms this in the $k=3$ case by showing every $4$-critical graph contains at least $4$ cycles of length $0 \bmod 3$, and that $K_4$ is the unique such graph achieving the minimum. We make progress on the general conjecture as well, showing that $(k+1)$-critical graphs with minimum degree $k$ have at least as many cycles of length $0\bmod r$ as $K_{k+1}$, provided $k+1 \ne 0 \bmod r$. We also show that $K_{k+1}$ uniquely minimizes the number of cycles of length $1\bmod k$ among all $(k+1)$-critical graphs, strengthening a recent result of Moore and West and extending it to the $k=3$ case.


title: Uncertainty Propagation through Trained Deep Neural Networks Using Factor Graphs

abstract: Predictive uncertainty estimation remains a challenging problem precluding the use of deep neural networks as subsystems within safety-critical applications. Aleatoric uncertainty is a component of predictive uncertainty that cannot be reduced through model improvements. Uncertainty propagation seeks to estimate aleatoric uncertainty by propagating input uncertainties to network predictions. Existing uncertainty propagation techniques use one-way information flows, propagating uncertainties layer-by-layer or across the entire neural network while relying either on sampling or analytical techniques for propagation. Motivated by the complex information flows within deep neural networks (e.g. skip connections), we developed and evaluated a novel approach by posing uncertainty propagation as a non-linear optimization problem using factor graphs. We observed statistically significant improvements in performance over prior work when using factor graphs across most of our experiments that included three datasets and two neural network architectures. Our implementation balances the benefits of sampling and analytical propagation techniques, which we believe, is a key factor in achieving performance improvements.


title: Towards non-stochastic targeted exploration

abstract: We present a novel targeted exploration strategy for linear time-invariant systems without stochastic assumptions on the noise, i.e., without requiring independence or zero mean, allowing for deterministic model misspecifications. This work utilizes classical data-dependent uncertainty bounds on the least-squares parameter estimates in the presence of energy-bounded noise. We provide a sufficient condition on the exploration data that ensures a desired error bound on the estimated parameter. Using common approximations, we derive a semidefinite program to compute the optimal sinusoidal input excitation. Finally, we highlight the differences and commonalities between the developed non-stochastic targeted exploration strategy and conventional exploration strategies based on classical identification bounds through a numerical example.


title: Exploring Non-perturbative Corrections in Thermodynamics of Static Dirty Black Holes

abstract: This study presents an investigation into the thermodynamic properties of a dirty black hole immersed in a uniform electric field within the framework of the Einstein-Nonlinear Electrodynamics (ENE)-dilaton theory. The analysis delves into various thermodynamic aspects, including heat capacity, Helmholtz free energy, and internal energy, providing insights into the behavior of the black hole under the influence of the electric field. Furthermore, the article explores the intricate interplay between quantum effects and thermodynamic behavior through the examination of quantum-corrected entropy. The study aims to shed light on the non-perturbative corrections that arise in this complex system, offering a comprehensive understanding of the modified thermodynamics of dirty black holes within the specified theoretical framework.


title: Large quantum nonreciprocity in plasmons dragged by drifting electrons

abstract: Collective plasmon modes, riding on top of drifting electrons, acquire a fascinating nonreciprocal dispersion characterized by $\omega_p(\bm{q}) \neq \omega_p(-\bm{q})$. The {\it classical} plasmonic Doppler shift arises from the polarization of the Fermi surface due to the applied DC bias voltage. Going beyond this paradigm, we predict a {\it quantum} plasmonic Doppler shift originating from the quantum metric of the Bloch wavefunction. We systematically compare the classical and quantum Doppler shifts by investigating the drift-induced nonreciprocal plasmon dispersion in generic quantum systems. We demonstrate quantum nonreciprocal plasmons in graphene and twisted bilayer graphene. We show that the quantum plasmonic Doppler shift dominates in \moire systems at large wavevectors, yielding plasmonic nonreciprocity up to 20\% in twisted bilayer graphene. Our findings demonstrate the supremacy of plasmonic quantum Doppler shift in \moire systems, motivating the design of innovative nonreciprocal photonic devices with potential technological implications.


title: Constructing maximal extensions of the Vaidya metric in Israel coordinates: II. The completeness of Israel coordinates

abstract: We present the results of an analysis of three maximal extensions of the Vaidya metric in Israel coordinates, a spherically symmetric solution to the Einstein field equations for the energy momentum tensor of pure radiation in the high-frequency approximation. This metric is necessary for various applications, such as describing the exterior geometry of a radiating star in astrophysics and studying possible formation of naked singularities in the geometry of spacetime. Contrary to the common Eddington-Finkelstein-like (EFL) coordinates, these maximal extensions, in Israel coordinates, are complete and cover the entirety of the Vaidya manifold. We develop three mass functions, one for each extension, and consider the qualitative characteristics of the three mass models and the surfaces of constant (dynamical) radius. We demonstrate that each maximal extension is null geodesically complete, which we assess by solving the radial null geodesics equation and forming the Penrose conformal diagram for each extension.


title: Notes on the moment measure conjecture

abstract: The moment measure conjecture of Bialynicki-Birula and Sommese gives a combinatorial characterization of all open substacks of a global quotient stack for a torus action on a normal projective variety that admit a proper good moduli space, in other words it characterizes the invariant open subvarieties that admit a proper quotient. In this article we prove the conjecture for actions on smooth varieties. This gives an instance of stability conditions defined by cohomological invariants that are not given by Chern classes of line bundles.


title: Approximate Dynamic Programming based Model Predictive Control of Nonlinear systems

abstract: This paper studies the optimal control problem for discrete-time nonlinear systems and an approximate dynamic programming-based Model Predictive Control (MPC) scheme is proposed for minimizing a quadratic performance measure. In the proposed approach, the value function is approximated as a quadratic function for which the parametric matrix is computed using a switched system approximate of the nonlinear system. The approach is modified further using a multi-stage scheme to improve the control accuracy and an extension to incorporate state constraints. The MPC scheme is validated experimentally on a multi-tank system which is modeled as a third-order nonlinear system. The experimental results show the proposed MPC scheme results in significantly lesser online computation compared to the Nonlinear MPC scheme.


title: RadImageGAN -- A Multi-modal Dataset-Scale Generative AI for Medical Imaging

abstract: Deep learning in medical imaging often requires large-scale, high-quality data or initiation with suitably pre-trained weights. However, medical datasets are limited by data availability, domain-specific knowledge, and privacy concerns, and the creation of large and diverse radiologic databases like RadImageNet is highly resource-intensive. To address these limitations, we introduce RadImageGAN, the first multi-modal radiologic data generator, which was developed by training StyleGAN-XL on the real RadImageNet dataset of 102,774 patients. RadImageGAN can generate high-resolution synthetic medical imaging datasets across 12 anatomical regions and 130 pathological classes in 3 modalities. Furthermore, we demonstrate that RadImageGAN generators can be utilized with BigDatasetGAN to generate multi-class pixel-wise annotated paired synthetic images and masks for diverse downstream segmentation tasks with minimal manual annotation. We showed that using synthetic auto-labeled data from RadImageGAN can significantly improve performance on four diverse downstream segmentation datasets by augmenting real training data and/or developing pre-trained weights for fine-tuning. This shows that RadImageGAN combined with BigDatasetGAN can improve model performance and address data scarcity while reducing the resources needed for annotations for segmentation tasks.


title: l-modular blocks of Rep_k(SL_n(F))

abstract: Let F be a non-archimedean local field with residual characteristic p, and k an algebraically closed field with characteristic l, where l different from p. Let Rep_k(SL_n(F)) be the category of smooth k-representations of SL_n(F). In this work, we establish the block decomposition of Rep_k(SL_n(F)) under the condition that p does not divide the order of the Weyl group of SL_n(F).


title: Learning Differentiable Particle Filter on the Fly

abstract: Differentiable particle filters are an emerging class of sequential Bayesian inference techniques that use neural networks to construct components in state space models. Existing approaches are mostly based on offline supervised training strategies. This leads to the delay of the model deployment and the obtained filters are susceptible to distribution shift of test-time data. In this paper, we propose an online learning framework for differentiable particle filters so that model parameters can be updated as data arrive. The technical constraint is that there is no known ground truth state information in the online inference setting. We address this by adopting an unsupervised loss to construct the online model updating procedure, which involves a sequence of filtering operations for online maximum likelihood-based parameter estimation. We empirically evaluate the effectiveness of the proposed method, and compare it with supervised learning methods in simulation settings including a multivariate linear Gaussian state-space model and a simulated object tracking experiment.


title: The Quest for an Integrated Set of Neural Mechanisms Underlying Object Recognition in Primates

abstract: Visual object recognition -- the behavioral ability to rapidly and accurately categorize many visually encountered objects -- is core to primate cognition. This behavioral capability is algorithmically impressive because of the myriad identity-preserving viewpoints and scenes that dramatically change the visual image produced by the same object. Until recently, the brain mechanisms that support that capability were deeply mysterious. However, over the last decade, this scientific mystery has been illuminated by the discovery and development of brain-inspired, image-computable, artificial neural network (ANN) systems that rival primates in this behavioral feat. Apart from fundamentally changing the landscape of artificial intelligence (AI), modified versions of these ANN systems are the current leading scientific hypotheses of an integrated set of mechanisms in the primate ventral visual stream that support object recognition. What separates brain-mapped versions of these systems from prior conceptual models is that they are Sensory-computable, Mechanistic, Anatomically Referenced, and Testable (SMART). Here, we review and provide perspective on the brain mechanisms that the currently leading SMART models address. We review the empirical brain and behavioral alignment successes and failures of those current models. Given ongoing advances in neurobehavioral measurements and AI, we discuss the next frontiers for even more accurate mechanistic understanding. And we outline the likely applications of that SMART-model-based understanding.


title: Causality constraints on TMD soft factors: the exponential regulator without cuts

abstract: We show that as a result of causality-constrained coordinate space analyticity, the Drell-Yan-shape transverse-momentum dependent soft factor in the exponential regulator allows below-threshold (Euclidean) parametric representations without cuts, to all orders in perturbation theory. Moreover, it is identical to another soft factor with natural interpretation as a space-like form factor and this relation continues to hold for a larger class of TMD soft factors that interpolate between three different rapidity regulators: the off-light-cone regulator, the finite light-front length regulator and the exponential regulator.


title: ExoMol line lists -- LIV: Empirical line lists for AlH and AlD and experimental emission spectroscopy of AlD in $A$ $^1\Pi$ ($v=0, 1, 2$)

abstract: New ExoMol line lists AloHa for AlH and AlD are presented improving the previous line lists WYLLoT (Yurchenko et al., MNRAS 479, 1401 (2018)). The revision is motivated by the recent experimental measurements and astrophysical findings involving the highly excited rotational states of AlH in its $A\,^{1}\Pi-{X}\,^{1}\Sigma^{+}$ system. A new high-resolution emission spectrum of ten bands from the ${A}\,^{1}\Pi-{X}\,^{1}\Sigma^{+}$ system of AlD, in the region $17300 - 32000$ cm$^{-1}$ was recorded with a Fourier transform spectrometer, which probes the predissociative $A\,^1\Pi$ $v=2$ state. The AlD new line positions are combined with all available experimental data on AlH and AlD to construct a comprehensive set of empirical rovibronic energies of AlH and AlD covering the $X\,^1\Sigma^+$ and $A\,^1\Pi$ electronic states using the MARVEL approach. We then refine the spectroscopic model WYLLoT to our experimentally derived energies using the nuclear-motion code Duo and use this fit to produce improved line lists for $^{27}$AlH, $^{27}$AlD and $^{26}$AlH with a better coverage of the rotationally excited states of $A\,^1\Pi$ in the predissociative energy region. The lifetimes of the predissociative states are estimated and are included in the line list using the new ExoMol data structure, alongside the temperature-dependent continuum contribution to the photo-absorption spectra of AlH. The new line lists are shown to reproduce the experimental spectra of both AlH and AlD well, and to describe the AlH absorption in the recently reported Proxima Cen spectrum, including the strong predissociative line broadening. The line lists are included into the ExoMol database www.exomol.com.


title: VAE-IF: Deep feature extraction with averaging for unsupervised artifact detection in routine acquired ICU time-series

abstract: Artifacts are a common problem in physiological time-series data collected from intensive care units (ICU) and other settings. They affect the quality and reliability of clinical research and patient care. Manual annotation of artifacts is costly and time-consuming, rendering it impractical. Automated methods are desired. Here, we propose a novel unsupervised approach to detect artifacts in clinical-standard minute-by-minute resolution ICU data without any prior labeling or signal-specific knowledge. Our approach combines a variational autoencoder (VAE) and an isolation forest (iForest) model to learn features and identify anomalies in different types of vital signs, such as blood pressure, heart rate, and intracranial pressure. We evaluate our approach on a real-world ICU dataset and compare it with supervised models based on long short-term memory (LSTM) and XGBoost. We show that our approach achieves comparable sensitivity and generalizes well to an external dataset. We also visualize the latent space learned by the VAE and demonstrate its ability to disentangle clean and noisy samples. Our approach offers a promising solution for cleaning ICU data in clinical research and practice without the need for any labels whatsoever.


title: Moduli spaces of framed sheaves on compactified Kleinian singularities

abstract: Consider a Kleinian singularity $ \mathbb{C}^2/\Gamma $, where $ \Gamma $ is a finite subgroup of $ SL_2(\mathbb{C}) $. In this paper, we construct moduli spaces of framed sheaves on a projective Deligne-Mumford stack compactifying the singularity, and we show that these moduli spaces are quasiprojective schemes.