title: Startup success prediction and VC portfolio simulation using CrunchBase data

abstract: Predicting startup success presents a formidable challenge due to the inherently volatile landscape of the entrepreneurial ecosystem. The advent of extensive databases like Crunchbase jointly with available open data enables the application of machine learning and artificial intelligence for more accurate predictive analytics. This paper focuses on startups at their Series B and Series C investment stages, aiming to predict key success milestones such as achieving an Initial Public Offering (IPO), attaining unicorn status, or executing a successful Merger and Acquisition (M\&A). We introduce novel deep learning model for predicting startup success, integrating a variety of factors such as funding metrics, founder features, industry category. A distinctive feature of our research is the use of a comprehensive backtesting algorithm designed to simulate the venture capital investment process. This simulation allows for a robust evaluation of our model's performance against historical data, providing actionable insights into its practical utility in real-world investment contexts. Evaluating our model on Crunchbase's, we achieved a 14 times capital growth and successfully identified on B round high-potential startups including Revolut, DigitalOcean, Klarna, Github and others. Our empirical findings illuminate the importance of incorporating diverse feature sets in enhancing the model's predictive accuracy. In summary, our work demonstrates the considerable promise of deep learning models and alternative unstructured data in predicting startup success and sets the stage for future advancements in this research area.


title: Compact Relative $\mathrm{SO}_0(2,q)$-Character Varieties of Punctured Spheres

abstract: We prove that there are some relative $\mathrm{SO}_0(2,q)$-character varieties of the punctured sphere which are compact, totally elliptic and contain a dense representation. This work fills a remaining case of the results of N. Tholozan and J. Toulisse. Our approach relies on the utilization of the non-Abelian Hodge correspondence and we study the moduli space of parabolic $\mathrm{SO}_0(2,q)$-Higgs bundles with some fixed weight. Additionally, we provide a construction based on Geometric Invariant Theory (GIT) to demonstrate that such moduli space we find can be viewed as a projective variety over $\mathbb{C}$.


title: Direct Models for Simultaneous Translation and Automatic Subtitling: FBK@IWSLT2023

abstract: This paper describes the FBK's participation in the Simultaneous Translation and Automatic Subtitling tracks of the IWSLT 2023 Evaluation Campaign. Our submission focused on the use of direct architectures to perform both tasks: for the simultaneous one, we leveraged the knowledge already acquired by offline-trained models and directly applied a policy to obtain the real-time inference; for the subtitling one, we adapted the direct ST model to produce well-formed subtitles and exploited the same architecture to produce timestamps needed for the subtitle synchronization with audiovisual content. Our English-German SimulST system shows a reduced computational-aware latency compared to the one achieved by the top-ranked systems in the 2021 and 2022 rounds of the task, with gains of up to 3.5 BLEU. Our automatic subtitling system outperforms the only existing solution based on a direct system by 3.7 and 1.7 SubER in English-German and English-Spanish respectively.


title: Low Latency of object detection for spikng neural network

abstract: Spiking Neural Networks, as a third-generation neural network, are well-suited for edge AI applications due to their binary spike nature. However, when it comes to complex tasks like object detection, SNNs often require a substantial number of time steps to achieve high performance. This limitation significantly hampers the widespread adoption of SNNs in latency-sensitive edge devices. In this paper, our focus is on generating highly accurate and low-latency SNNs specifically for object detection. Firstly, we systematically derive the conversion between SNNs and ANNs and analyze how to improve the consistency between them: improving the spike firing rate and reducing the quantization error. Then we propose a structural replacement, quantization of ANN activation and residual fix to allevicate the disparity. We evaluate our method on challenging dataset MS COCO, PASCAL VOC and our spike dataset. The experimental results show that the proposed method achieves higher accuracy and lower latency compared to previous work Spiking-YOLO. The advantages of SNNs processing of spike signals are also demonstrated.


title: Learning Dense Flow Field for Highly-accurate Cross-view Camera Localization

abstract: This paper addresses the problem of estimating the 3-DoF camera pose for a ground-level image with respect to a satellite image that encompasses the local surroundings. We propose a novel end-to-end approach that leverages the learning of dense pixel-wise flow fields in pairs of ground and satellite images to calculate the camera pose. Our approach differs from existing methods by constructing the feature metric at the pixel level, enabling full-image supervision for learning distinctive geometric configurations and visual appearances across views. Specifically, our method employs two distinct convolution networks for ground and satellite feature extraction. Then, we project the ground feature map to the bird's eye view (BEV) using a fixed camera height assumption to achieve preliminary geometric alignment. To further establish content association between the BEV and satellite features, we introduce a residual convolution block to refine the projected BEV feature. Optical flow estimation is performed on the refined BEV feature map and the satellite feature map using flow decoder networks based on RAFT. After obtaining dense flow correspondences, we apply the least square method to filter matching inliers and regress the ground camera pose. Extensive experiments demonstrate significant improvements compared to state-of-the-art methods. Notably, our approach reduces the median localization error by 89%, 19%, 80% and 35% on the KITTI, Ford multi-AV, VIGOR and Oxford RobotCar datasets, respectively.


title: Some results and conjectures about Hankel determinants of sequences which are related to Catalan-like numbers

abstract: Martin Aigner introduced Catalan-like numbers as elements of the first column of admissible matrices and studied Hankel determinants of their forward shifts. In this paper we collect some properties of the Hankel determinants of the other columns which are suggested by computer experiments. By prepending zero rows to admissible matrices we also consider Hankel determinants of backward shifts.


title: Reverse Faber-Krahn and Szego-Weinberger type inequalities for annular domains under Robin-Neumann boundary conditions

abstract: Let $\tau_k(\Omega)$ be the $k$-th eigenvalue of the Laplace operator in a bounded domain $\Omega$ of the form $\Omega_{\text{out}} \setminus \overline{B_{\alpha}}$ under the Neumann boundary condition on $\partial \Omega_{\text{out}}$ and the Robin boundary condition with parameter $h \in (-\infty,+\infty]$ on the sphere $\partial B_\alpha$ of radius $\alpha>0$ centered at the origin, the limiting case $h=+\infty$ being understood as the Dirichlet boundary condition on $\partial B_\alpha$. In the case $h>0$, it is known that the first eigenvalue $\tau_1(\Omega)$ does not exceed $\tau_1(B_\beta \setminus \overline{B_\alpha})$, where $\beta>0$ is chosen such that $|\Omega| = |B_\beta \setminus \overline{B_\alpha}|$, which can be regarded as a reverse Faber-Krahn type inequality. We establish this result for any $h \in (-\infty,+\infty]$. Moreover, we provide related estimates for higher eigenvalues under additional geometric assumptions on $\Omega$, which can be seen as Szeg\H{o}-Weinberger type inequalities. A few counterexamples to the obtained inequalities for domains violating imposed geometric assumptions are given. As auxiliary information, we investigate shapes of eigenfunctions associated with several eigenvalues $\tau_{i}(B_\beta \setminus \overline{B_\alpha})$ and show that they are nonradial at least for all positive and all sufficiently negative $h$ when $i \in \{2,\ldots,N+2\}$. At the same time, we give numerical evidence that, in the planar case $N=2$, already second eigenfunctions can be radial for some $h<0$. The latter fact provides a simple counterexample to the Payne nodal line conjecture in the case of the mixed boundary conditions.


title: Towards Faithful Neural Network Intrinsic Interpretation with Shapley Additive Self-Attribution

abstract: Self-interpreting neural networks have garnered significant interest in research. Existing works in this domain often (1) lack a solid theoretical foundation ensuring genuine interpretability or (2) compromise model expressiveness. In response, we formulate a generic Additive Self-Attribution (ASA) framework. Observing the absence of Shapley value in Additive Self-Attribution, we propose Shapley Additive Self-Attributing Neural Network (SASANet), with theoretical guarantees for the self-attribution value equal to the output's Shapley values. Specifically, SASANet uses a marginal contribution-based sequential schema and internal distillation-based training strategies to model meaningful outputs for any number of features, resulting in un-approximated meaningful value function. Our experimental results indicate SASANet surpasses existing self-attributing models in performance and rivals black-box models. Moreover, SASANet is shown more precise and efficient than post-hoc methods in interpreting its own predictions.


title: Identifiability Matters: Revealing the Hidden Recoverable Condition in Unbiased Learning to Rank

abstract: Unbiased Learning to Rank (ULTR) aims to train unbiased ranking models from biased click logs, by explicitly modeling a generation process for user behavior and fitting click data based on examination hypothesis. Previous research found empirically that the true latent relevance is mostly recoverable through click fitting. However, we demonstrate that this is not always achievable, resulting in a significant reduction in ranking performance. This research investigates the conditions under which relevance can be recovered from click data in the first principle. We initially characterize a ranking model as identifiable if it can recover the true relevance up to a scaling transformation, a criterion sufficient for the pairwise ranking objective. Subsequently, we investigate an equivalent condition for identifiability, articulated as a graph connectivity test problem: the recovery of relevance is feasible if and only if the identifiability graph (IG), derived from the underlying structure of the dataset, is connected. The presence of a disconnected IG may lead to degenerate cases and suboptimal ranking performance. To tackle this challenge, we introduce two methods, namely node intervention and node merging, designed to modify the dataset and restore the connectivity of the IG. Empirical results derived from a simulated dataset and two real-world LTR benchmark datasets not only validate our proposed theory but also demonstrate the effectiveness of our methods in alleviating data bias when the relevance model is unidentifiable.


title: Setups for eliminating static charge of the ATLAS18 strip sensors

abstract: Construction of the new all-silicon Inner Tracker (ITk), developed by the ATLAS collaboration for the High Luminosity LHC, started in 2020 and is expected to continue till 2028. The ITk detector will include 18,000 highly segmented and radiation hard n+-in-p silicon strip sensors (ATLAS18), which are being manufactured by Hamamatsu Photonics. Mechanical and electrical characteristics of produced sensors are measured upon their delivery at several institutes participating in a complex Quality Control (QC) program. The QC tests performed on each individual sensor check the overall integrity and quality of the sensor. During the QC testing of production ATLAS18 strip sensors, an increased number of sensors that failed the electrical tests was observed. In particular, IV measurements indicated an early breakdown, while large areas containing several tens or hundreds of neighbouring strips with low interstrip isolation were identified by the Full strip tests, and leakage current instabilities were measured in a long-term leakage current stability setup. Moreover, a high surface electrostatic charge reaching a level of several hundreds of volts per inch was measured on a large number of sensors and on the plastic sheets, which mechanically protect these sensors in their paper envelopes. Accumulated data indicates a clear correlation between observed electrical failures and the sensor charge-up. To mitigate the above-described issues, the QC testing sites significantly modified the sensor handling procedures and introduced sensor recovery techniques based on irradiation of the sensor surface with UV light or application of intensive flows of ionized gas. In this presentation, we will describe the setups implemented by the QC testing sites to treat silicon strip sensors affected by static charge and evaluate the effectiveness of these setups in terms of improvement of the sensor performance.


title: Learning from SAM: Harnessing a Foundation Model for Sim2Real Adaptation by Regularization

abstract: Domain adaptation is especially important for robotics applications, where target domain training data is usually scarce and annotations are costly to obtain. We present a method for self-supervised domain adaptation for the scenario where annotated source domain data (e.g. from synthetic generation) is available, but the target domain data is completely unannotated. Our method targets the semantic segmentation task and leverages a segmentation foundation model (Segment Anything Model) to obtain segment information on unannotated data. We take inspiration from recent advances in unsupervised local feature learning and propose an invariance-variance loss over the detected segments for regularizing feature representations in the target domain. Crucially, this loss structure and network architecture can handle overlapping segments and oversegmentation as produced by Segment Anything. We demonstrate the advantage of our method on the challenging YCB-Video and HomebrewedDB datasets and show that it outperforms prior work and, on YCB-Video, even a network trained with real annotations. Additionally, we provide insight through model ablations and show applicability to a custom robotic application.


title: Guided Frequency Loss for Image Restoration

abstract: Image Restoration has seen remarkable progress in recent years. Many generative models have been adapted to tackle the known restoration cases of images. However, the interest in benefiting from the frequency domain is not well explored despite its major factor in these particular cases of image synthesis. In this study, we propose the Guided Frequency Loss (GFL), which helps the model to learn in a balanced way the image's frequency content alongside the spatial content. It aggregates three major components that work in parallel to enhance learning efficiency; a Charbonnier component, a Laplacian Pyramid component, and a Gradual Frequency component. We tested GFL on the Super Resolution and the Denoising tasks. We used three different datasets and three different architectures for each of them. We found that the GFL loss improved the PSNR metric in most implemented experiments. Also, it improved the training of the Super Resolution models in both SwinIR and SRGAN. In addition, the utility of the GFL loss increased better on constrained data due to the less stochasticity in the high frequencies' components among samples.


title: Jointly Training Large Autoregressive Multimodal Models

abstract: In recent years, advances in the large-scale pretraining of language and text-to-image models have revolutionized the field of machine learning. Yet, integrating these two modalities into a single, robust model capable of generating seamless multimodal outputs remains a significant challenge. To address this gap, we present the Joint Autoregressive Mixture (JAM) framework, a modular approach that systematically fuses existing text and image generation models. We also introduce a specialized, data-efficient instruction-tuning strategy, tailored for mixed-modal generation tasks. Our final instruct-tuned model demonstrates unparalleled performance in generating high-quality multimodal outputs and represents the first model explicitly designed for this purpose.


title: Helical and nonhelical large-scale dynamos in thin accretion discs

abstract: The dynamics of accreting and outgoing flows around compact objects depends crucially on the strengths and configurations of the magnetic fields therein, especially of the large-scale fields that remain coherent beyond turbulence scales. Possible origins of these large-scale magnetic fields include flux advection and disc dynamo actions. However, most numerical simulations have to adopt an initially strong large-scale field rather than allow them to be self-consistently advected or amplified, due to limited computational resources. The situation can be partially cured by using sub-grid models where dynamo actions only reachable at high resolutions are mimicked by artificial terms in low-resolution simulations. In this work, we couple thin-disc models with local shearing-box simulation results to facilitate more realistic sub-grid dynamo implementations. For helical dynamos, detailed spatial profiles of dynamo drivers inferred from local simulations are used, and the nonlinear quenching and saturation is constrained by magnetic helicity evolution. In the inner disc region, saturated fields have dipole configurations and the plasma $\beta$ reaches $\simeq 0.1$ to $100$, with correlation lengths $\simeq h$ in the vertical direction and $\simeq 10h$ in the radial direction, where $h$ is the disc scale height. The dynamo cycle period is $\simeq 40$ orbital time scale, compatible with previous global simulations. Additionally, we explore two dynamo mechanisms which do not require a net kinetic helicity and have only been studied in shearing-box setups. We show that such dynamos are possible in thin accretion discs, but produce field configurations that are incompatible with previous results. We discuss implications for future general-relativistic magnetohydrodynamics simulations.


title: Simultaneity of consciousness with physical reality: the key that unlocks the mind-matter problem

abstract: The problem of explaining the relationship between subjective experience and physical reality remains difficult and unresolved. In most explanations, consciousness is epiphenomenal, without causal power. The most notable exception is Integrated Information Theory (IIT), which provides a causal explanation for consciousness. However, IIT relies on an identity between subjectivity and a particular type of physical structure, namely with an information structure that has intrinsic causal power greater than the sum of its parts. Any theory that relies on a psycho-physical identity must eventually appeal to panpsychism, which undermines that theorys claim to be fundamental. IIT has recently pivoted towards a strong version of causal emergence, but macroscopic causal structures cannot be causally stronger than its microscopic parts without some new physical law or governing principle. The approach taken here is designed to uncover such a principle. The decisive argument is entirely deductive from initial premises that are phenomenologically certain. If correct, the arguments prove that conscious experience is sufficient to create additional degrees of causal freedom independently of the content of experience, and in a manner that is unpredictable and unobservable by any temporally sequential means. This provides a fundamental principle about consciousness, and a conceptual bridge between it and the physics describing what is experienced. The principle makes testable predictions about brain function, with notable differences from IIT, some of which are also empirically testable.


title: Enhancing the Josephson diode effect with Majorana bound states

abstract: We consider phase-biased Josephson junctions with spin-orbit coupling under external magnetic fields and study the emergence of the Josephson diode effect in the presence of Majorana bound states. We show that junctions having middle regions with Zeeman fields along the spin-orbit axis develop a low-energy Andreev spectrum that is asymmetric with respect to the superconducting phase difference $\phi=\pi$, which is strongly influenced by Majorana bound states in the topological phase. This asymmetric Andreev spectrum gives rise to anomalous current-phase curves and critical currents that are different for positive and negative supercurrents, thus signaling the emergence of the Josephson diode effect. While this effect exists even in the trivial phase, it gets enhanced in the topological phase due to the spatial nonlocality of Majorana bound states. Our work thus establishes the utilization of topological superconductivity for enhancing the functionalities of Josephson diodes.


title: Regulating spin dynamics in magnetic nanomaterials

abstract: Magnetic nanomaterials can be used in the construction of devices for information processing and memory storage. For this purpose, they have to enjoy two contradictory properties, from one side being able of keeping for long time magnetization frozen, hence information stored, and from the other side allowing for quick change of magnetization required for fast erasing of memory and rewriting new information. Methods of resolving this dilemma are suggested based on triggering resonance, dynamic resonance tuning, and on quadratic Zeeman effect. These methods make it possible to realize effective regulation of spin dynamics in such materials as magnetic nanomolecules and magnetic nanoclusters.


title: Grain-128PLE: Generic Physical-Layer Encryption for IoT Networks

abstract: Physical layer security (PLS) encompasses techniques proposed at the physical layer to achieve information security objectives while requiring a minimal resource footprint. The channel coding-based secrecy and signal modulation-based encryption approaches are reliant on certain channel conditions or a certain communications protocol stack to operate on, which prevents them from being a generic solution. This paper presents Grain-128PLE, a lightweight physical layer encryption (PLE) scheme that is derived from the Grain-128AEAD v2 stream cipher. The Grain-128PLE stream cipher performs encryption and decryption at the physical layer, in between the channel coding and signal modulation processes. This placement, like that of the A5 stream cipher that had been used in the GSM communications standard, makes it a generic solution for providing data confidentiality in IoT networks. The design of Grain-128PLE maintains the structure of the main building blocks of the original Grain-128AEAD v2 stream cipher, evaluated for its security strength during NIST's recent Lightweight Cryptography competition, and is therefore expected to achieve similar levels of security.


title: Weak*-Simplicity of Convolution Algebras on Discrete Groups

abstract: We prove that, given a discrete group $G$, and $1 \leq p < \infty$, the algebra of $p$-convolution operators $CV_p(G)$ is weak*-simple, in the sense of having no non-trivial weak*-closed ideals, if and only if $G$ is an ICC group. This generalises the basic fact that $vN(G)$ is a factor if and only if $G$ is ICC. When $p=1$, $CV_p(G) = \ell^1(G)$. In this case we give a more detailed analysis of the weak*-closed ideals, showing that they can be described in terms of the weak*-closed ideals of $\ell^1(FC(G))$; when $FC(G)$ is finite, this leads to a classification of the weak*-closed ideals of $\ell^1(G)$.


title: Evolution of a Water-rich Atmosphere Formed by a Giant Impact on an Earth-sized Planet

abstract: The atmosphere of a terrestrial planet that is replenished with secondary gases should have accumulated hydrogen-rich gas from its protoplanetary disk. Although a giant impact blows off a large fraction of the primordial atmosphere of a terrestrial planet in the late formation stage, the remaining atmosphere can become water-rich via chemical reactions between hydrogen and vaporized core material. We find that a water-rich post-impact atmosphere forms when a basaltic or CI chondrite core is assumed. In contrast, little post-impact water is generated for an enstatite chondrite core. We investigate the X-ray- and UV-driven mass loss from an Earth-mass planet with an impact-induced multi-component H$_2$$-$He$-$H$_2$O atmosphere for Gyrs. We show that water is left in the atmosphere of an Earth-mass planet when the low flux of escaping hydrogen cannot drag water upward via collisions. For a water-dominated atmosphere to form, the atmospheric mass fraction of an Earth-mass planet with an oxidizing core after a giant impact must be less than a few times 0.1%. We also find that Earth-mass planets with water-dominated atmospheres can exist at semimajor axes ranging from a few times 0.1 au to a few au around a Sun-like star depending on the mass loss efficiency. Such planets are important targets for atmospheric characterization in the era of JWST. Our results indicate that efficient mixing between hydrogen and rocky components during giant impacts can play a role in the production of water in an Earth-mass planet.


title: HPL-ViT: A Unified Perception Framework for Heterogeneous Parallel LiDARs in V2V

abstract: To develop the next generation of intelligent LiDARs, we propose a novel framework of parallel LiDARs and construct a hardware prototype in our experimental platform, DAWN (Digital Artificial World for Natural). It emphasizes the tight integration of physical and digital space in LiDAR systems, with networking being one of its supported core features. In the context of autonomous driving, V2V (Vehicle-to-Vehicle) technology enables efficient information sharing between different agents which significantly promotes the development of LiDAR networks. However, current research operates under an ideal situation where all vehicles are equipped with identical LiDAR, ignoring the diversity of LiDAR categories and operating frequencies. In this paper, we first utilize OpenCDA and RLS (Realistic LiDAR Simulation) to construct a novel heterogeneous LiDAR dataset named OPV2V-HPL. Additionally, we present HPL-ViT, a pioneering architecture designed for robust feature fusion in heterogeneous and dynamic scenarios. It uses a graph-attention Transformer to extract domain-specific features for each agent, coupled with a cross-attention mechanism for the final fusion. Extensive experiments on OPV2V-HPL demonstrate that HPL-ViT achieves SOTA (state-of-the-art) performance in all settings and exhibits outstanding generalization capabilities.


title: The Maximum Cover with Rotating Field of View

abstract: Imagine a polygon-shaped platform $P$ and only one static spotlight outside $P$; which direction should the spotlight face to light most of $P$? This problem occurs in maximising the visibility, as well as in limiting the uncertainty in localisation problems. More formally, we define the following maximum cover problem: "Given a convex polygon $P$ and a Field Of View (FOV) with a given centre and inner angle $\phi$; find the direction (an angle of rotation $\theta$) of the FOV such that the intersection between the FOV and $P$ has the maximum area". In this paper, we provide the theoretical foundation for the analysis of the maximum cover with a rotating field of view. The main challenge is that the function of the area $A_{\phi}(\theta)$, with the angle of rotation $\theta$ and the fixed inner angle $\phi$, cannot be approximated directly. We found an alternative way to express it by various compositions of a function $A_{\theta}(\phi)$ (with a restricted inner angle $\phi$ and a fixed direction $\theta$). We show that $A_{\theta}(\phi)$ has an analytical solution in the special case of a two-sector intersection and later provides a constrictive solution for the original problem. Since the optimal solution is a real number, we develop an algorithm that approximates the direction of the field of view, with precision $\varepsilon$, and complexity $\mathcal{O}(n(\log{n}+(\log{\varepsilon})/\phi))$.


title: To better understand realized ecosystem services: An integrated analysis framework of supply, demand, flow and use

abstract: Realized ecosystem services (ES) are the actual use of ES by societies, which is more directly linked to human well-being than potential ES. However, there is a lack of a general analysis framework to understand how much ES was realized. In this study, we first proposed a Supply-Demand-Flow-Use (SDFU) framework that integrates the supply, demand, flow, and use of ES and differentiates these concepts into different aspects (e.g., potential vs. actual ES demand, export and import flows of supply, etc.). Then, we applied the framework to three examples of ES that can be found in typical urban green parks (i.e., wild berry supply, pollination, and recreation). We showed how the framework could assess the actual use of ES and identify the supply-limited, demand-limited, and supply-demand-balanced types of realized ES. We also discussed the scaling features, temporal dynamics, and spatial characteristics of realized ES, as well as some critical questions for future studies. Although facing challenges, we believe that the applications of the SDFU framework can provide a systematic way to accurately assess the actual use of ES and better inform management and policy-making for sustainable use of nature's benefits. Therefore, we hope that our study will stimulate more research on realized ES and contribute to a deeper understanding of their roles in enhancing human well-being.


title: Confidence-based Visual Dispersal for Few-shot Unsupervised Domain Adaptation

abstract: Unsupervised domain adaptation aims to transfer knowledge from a fully-labeled source domain to an unlabeled target domain. However, in real-world scenarios, providing abundant labeled data even in the source domain can be infeasible due to the difficulty and high expense of annotation. To address this issue, recent works consider the Few-shot Unsupervised Domain Adaptation (FUDA) where only a few source samples are labeled, and conduct knowledge transfer via self-supervised learning methods. Yet existing methods generally overlook that the sparse label setting hinders learning reliable source knowledge for transfer. Additionally, the learning difficulty difference in target samples is different but ignored, leaving hard target samples poorly classified. To tackle both deficiencies, in this paper, we propose a novel Confidence-based Visual Dispersal Transfer learning method (C-VisDiT) for FUDA. Specifically, C-VisDiT consists of a cross-domain visual dispersal strategy that transfers only high-confidence source knowledge for model adaptation and an intra-domain visual dispersal strategy that guides the learning of hard target samples with easy ones. We conduct extensive experiments on Office-31, Office-Home, VisDA-C, and DomainNet benchmark datasets and the results demonstrate that the proposed C-VisDiT significantly outperforms state-of-the-art FUDA methods. Our code is available at https://github.com/Bostoncake/C-VisDiT.


title: Learning Spatial-Temporal Regularized Tensor Sparse RPCA for Background Subtraction

abstract: Video background subtraction is one of the fundamental problems in computer vision that aims to segment all moving objects. Robust principal component analysis has been identified as a promising unsupervised paradigm for background subtraction tasks in the last decade thanks to its competitive performance in a number of benchmark datasets. Tensor robust principal component analysis variations have improved background subtraction performance further. However, because moving object pixels in the sparse component are treated independently and do not have to adhere to spatial-temporal structured-sparsity constraints, performance is reduced for sequences with dynamic backgrounds, camouflaged, and camera jitter problems. In this work, we present a spatial-temporal regularized tensor sparse RPCA algorithm for precise background subtraction. Within the sparse component, we impose spatial-temporal regularizations in the form of normalized graph-Laplacian matrices. To do this, we build two graphs, one across the input tensor spatial locations and the other across its frontal slices in the time domain. While maximizing the objective function, we compel the tensor sparse component to serve as the spatiotemporal eigenvectors of the graph-Laplacian matrices. The disconnected moving object pixels in the sparse component are preserved by the proposed graph-based regularizations since they both comprise of spatiotemporal subspace-based structure. Additionally, we propose a unique objective function that employs batch and online-based optimization methods to jointly maximize the background-foreground and spatial-temporal regularization components. Experiments are performed on six publicly available background subtraction datasets that demonstrate the superior performance of the proposed algorithm compared to several existing methods. Our source code will be available very soon.


title: An Evaluation of ChatGPT-4's Qualitative Spatial Reasoning Capabilities in RCC-8

abstract: Qualitative Spatial Reasoning (QSR) is well explored area of Commonsense Reasoning and has multiple applications ranging from Geographical Information Systems to Robotics and Computer Vision. Recently many claims have been made for the capabilities of Large Language Models (LLMs). In this paper we investigate the extent to which one particular LLM can perform classical qualitative spatial reasoning tasks on the mereotopological calculus, RCC-8.


title: LivDet2023 -- Fingerprint Liveness Detection Competition: Advancing Generalization

abstract: The International Fingerprint Liveness Detection Competition (LivDet) is a biennial event that invites academic and industry participants to prove their advancements in Fingerprint Presentation Attack Detection (PAD). This edition, LivDet2023, proposed two challenges, Liveness Detection in Action and Fingerprint Representation, to evaluate the efficacy of PAD embedded in verification systems and the effectiveness and compactness of feature sets. A third, hidden challenge is the inclusion of two subsets in the training set whose sensor information is unknown, testing participants ability to generalize their models. Only bona fide fingerprint samples were provided to participants, and the competition reports and assesses the performance of their algorithms suffering from this limitation in data availability.


title: Nilpotent approximation (completion) of $\mathbb{E}_\infty$-algebra objects of stable symmetric monoidal model categories

abstract: This article mentions that Smith ideal theory generalizes the adic completion theory of commutative rings to monoid objects of locally presentable symmetric monoidal abelian categories. As an application, we provide an almost mathematics version of completion theory, and we prove that the project limit of the residue algebras by powers of almost finitely generated ideals of almost algebras are complete as well-known results of commutative algebra theory. Furthermore, we introduce a naive construction of the completion theory of $\mathbb{E}_\infty$-rings, which is a homotopy theory analogue of the adic completion theory of commutative algebra by Hovey's Smith ideal theory. We prove that the completion is homotopically complete for any weakly compact Smith ideal as the ordinal commutative algebra theory. Furthermore, by using the completion theory of Smith ideals of the symmetric monoidal category of motivic spectra due to Voevodsky, we formulate an approximation of algebraic cobordism by algebraic $K$-theory, and we prove that the approximation inherits properties of algebraic $K$-theory, like the Bott periodicity and the Gabber rigidity.


title: Phase-Stable Traveling Waves Stroboscopically Matched for Super-Resolved Observation of Trapped-Ion Dynamics

abstract: In quantum technologies, it is essential to understand and exploit the interplay of light and matter. We introduce an approach, creating and maintaining the coherence of four oscillators: a global microwave reference field, a polarization-gradient traveling-wave pattern of light, and the spin and motional states of a single trapped ion. The features of our method are showcased by probing the 140-nm periodic light pattern and stroboscopically tracing dynamical variations in position and momentum observables with noise floors of $1.8(2)\,$nm and $8(2)~$zN$\,\mu$s, respectively. The implications of our findings contribute to enhancing quantum control and metrological applications.


title: Positron Beams At Ce$^+$BAF

abstract: We present a scheme for the generation of a high polarization positron beam with continous wave (CW) bunch structure for the Continuous Electron Beam Accelerator Facility (CEBAF) at Jefferson Laboratory (JLab). The positrons are created in a high average power conversion target and collected by a CW capture linac and DC solenoid.


title: Quantum autoencoders using mixed reference states

abstract: One of the fundamental tasks in information theory is the compression of information. To achieve this in the quantum domain, quantum autoencoders that aim to compress quantum states to low-dimensional ones have been proposed. When taking a pure state as the reference state, there exists an upper bound for the encoding fidelity. This bound limits the compression rate for high-rank states that have high entropy. To overcome the entropy inconsistency between the initial states and the reconstructed states, we allow the reference state to be a mixed state. A new cost function that combines the encoding fidelity and the quantum mutual information is proposed for compressing general input states. In particular, we consider the reference states to be a mixture of maximally mixed states and pure states. To achieve efficient compression for different states, two strategies for setting the ratio of mixedness (in the mixture of maximally mixed states and pure states) are provided based on prior knowledge about quantum states or observations obtained from the training process. Numerical results on thermal states of the transverse-field Ising model, Werner states, and maximally mixed states blended with pure states illustrate the effectiveness of the proposed method. In addition, quantum autoencoders using mixed reference states are experimentally implemented on IBM Quantum devices to compress and reconstruct thermal states and Werner states.


title: Impact of surface anisotropy on the spin-wave dynamics in thin ferromagnetic film

abstract: The spin-wave dynamics in the thin CoFeB film in Damon-Eshbach geometry are studied in three cases of boundary conditions -- free boundary conditions, symmetrical surface anisotropy, and one-sided surface anisotropy. The analytical model created by Wolfram and De Wames was extended to include perpendicular surface anisotropy in boundary conditions. Its comparison with numerical simulations demonstrate perfect agreement between the approaches. The analysis of the dispersion relation indicates that the presence of surface anisotropy increases the avoided crossing size between Damon-Eshbach mode and perpendicular standing modes. Additionally, asymmetrical one-sided surface anisotropy induces nonreciprocity in the dispersion relation. In-depth analysis of the avoided crossing size is conducted for systems with different boundary conditions, different thicknesses, surface anisotropy constant values, and external magnetic fields. It shows the significant role of the strength of surface localization of Damon-Eshbach mode and the symmetry of perpendicular standing modes in the avoided crossing broadening. Interestingly, for specific set of parameters the interaction between the particular modes can be suppressed, resulting in a mode crossing. Such a crossing, which occurs only on one side of the dispersion relation in a one-sided surface anisotropy system, can be utilized in nonreciprocal devices.


title: Nonperturbative aspects of two-dimensional $T\bar{T}$-deformed scalar theory from functional renormalization group

abstract: We study $T\bar{T}$-deformed $O(N)$ scalar field theory in two-dimensional spacetime using the functional renormalization group. We derive the $\beta$ functions for the couplings in the system and explore the fixed points. In addition to the Gaussian (trivial) fixed point, we find a nontrivial fixed point at which a new universality class exists. The deformation parameter becomes relevant at the nontrivial fixed point. Therefore, the $T\bar T$-deformed scalar field theory in two-dimensional spacetime could be defined as a nonperturbatively renormalizable theory.


title: Identification of Influencing Factors on Self-reported Count Data with Multiple Potential Inflated Values

abstract: The Online Chauffeured Service Demand (OCSD) research is an exploratory market study of designated driver services in China. Researchers are interested in the influencing factors of chauffeured service adoption and usage and have collected relevant data using a self-reported questionnaire. As self-reported count measure data is typically inflated, there exist challenges to its validity, which may bias estimation and increase error in empirical research. Motivated by the analysis of self-reported data with multiple inflated values, we propose a novel approach to simultaneously achieve data-driven inflated value selection and identification of important influencing factors. In particular, the regularization technique is applied to the mixing proportions of inflated values and the regression parameters to obtain shrinkage estimates. We analyze the OCSD data with the proposed approach, deriving insights into the determinants impacting service demand. The proper interpretations and implications contribute to service promotion and related policy optimization. Extensive simulation studies and consistent asymptotic properties further establish the effectiveness of the proposed approach.


title: Orthogonal irreducible representations of finite solvable groups in odd dimension

abstract: We prove that if $G$ is a finite irreducible solvable subgroup of an orthogonal group $O(V,Q)$ with $\dim V$ odd, then $G$ preserves an orthogonal decomposition of $V$ into $1$-spaces. In particular $G$ is monomial. This generalizes a theorem of Rod Gow.


title: Correcting for cutoff dependence in backward evolution of QCD parton showers

abstract: Monte Carlo event generators for hard hadronic collisions depend on the evolution of parton showers backwards from a high-scale subprocess to the hadronization scale. The evolution is treated as a branching process with a sequence of resolvable parton emissions. The criterion of resolvability involves cutoffs that determine the no-emission probability (NEP) for a given range of the evolution scale. Existing event generators neglect cutoff-dependent terms in the NEP that, although formally power-suppressed, can have significant phenomenological effects. We compute such terms and study their consequences. One important result is that it is not possible for the backward shower to faithfully reproduce the cutoff-independent parton distribution functions (PDFs) used to generate it. We show that the computed NEP corrections mitigate but do not eliminate this problem. An alternative approach is to use cutoff-dependent PDFs that are consistent with the uncorrected NEP. Then one must apply cutoff-dependent corrections to hard subprocess matrix elements. We compute those corrections to the first nontrivial order for the Drell-Yan process and for Higgs production by gluon fusion.


title: Few-Shot Multi-Label Aspect Category Detection Utilizing Prototypical Network with Sentence-Level Weighting and Label Augmentation

abstract: Multi-label aspect category detection is intended to detect multiple aspect categories occurring in a given sentence. Since aspect category detection often suffers from limited datasets and data sparsity, the prototypical network with attention mechanisms has been applied for few-shot aspect category detection. Nevertheless, most of the prototypical networks used so far calculate the prototypes by taking the mean value of all the instances in the support set. This seems to ignore the variations between instances in multi-label aspect category detection. Also, several related works utilize label text information to enhance the attention mechanism. However, the label text information is often short and limited, and not specific enough to discern categories. In this paper, we first introduce support set attention along with the augmented label information to mitigate the noise at word-level for each support set instance. Moreover, we use a sentence-level attention mechanism that gives different weights to each instance in the support set in order to compute prototypes by weighted averaging. Finally, the calculated prototypes are further used in conjunction with query instances to compute query attention and thereby eliminate noises from the query set. Experimental results on the Yelp dataset show that our proposed method is useful and outperforms all baselines in four different scenarios.


title: Domain generalization across tumor types, laboratories, and species -- insights from the 2022 edition of the Mitosis Domain Generalization Challenge

abstract: Recognition of mitotic figures in histologic tumor specimens is highly relevant to patient outcome assessment. This task is challenging for algorithms and human experts alike, with deterioration of algorithmic performance under shifts in image representations. Considerable covariate shifts occur when assessment is performed on different tumor types, images are acquired using different digitization devices, or specimens are produced in different laboratories. This observation motivated the inception of the 2022 challenge on MItosis Domain Generalization (MIDOG 2022). The challenge provided annotated histologic tumor images from six different domains and evaluated the algorithmic approaches for mitotic figure detection provided by nine challenge participants on ten independent domains. Ground truth for mitotic figure detection was established in two ways: a three-expert consensus and an independent, immunohistochemistry-assisted set of labels. This work represents an overview of the challenge tasks, the algorithmic strategies employed by the participants, and potential factors contributing to their success. With an $F_1$ score of 0.764 for the top-performing team, we summarize that domain generalization across various tumor domains is possible with today's deep learning-based recognition pipelines. However, we also found that domain characteristics not present in the training set (feline as new species, spindle cell shape as new morphology and a new scanner) led to small but significant decreases in performance. When assessed against the immunohistochemistry-assisted reference standard, all methods resulted in reduced recall scores, but with only minor changes in the order of participants in the ranking.


title: Self-energy correction to energy levels of highly charged ions in a path integral formalism

abstract: Self-energy corrections to the energy levels of bound electrons are calculated in the framework of path integrals. We arrive at the full fermion propagator, using methods of functional integrals, in the form of Schwinger-Dyson equation (SDE). From the full fermion SDE, the self-energy corrected propagator is identified and the energy shift is obtained from the poles of the spectral function. The numerical calculations are performed using complex contour integrals and the B-spline representation of basis functions. We identify ions with Lamb shifts observable via modern mass spectrometric methods.


title: Microscopic mechanism of structural and volume relaxation below glass transition temperature in a soda-lime silicate glass revealed by Raman spectroscopy and its first principle calculations

abstract: To elucidate the atomistic origin of volume relaxation in soda-lime silicate glass annealed below the glass transition temperature (Tg), the experimental and calculated Raman spectra were compared. By decomposing the calculated Raman spectra into a specific group of atoms, we found that the Raman peak at 1050 cm-1 corresponds to bridging oxygen with a small Si-O-Si bond angle. The experimental Raman spectra indicated that, during annealing below Tg, a homogenization reaction Q2+Q4->2Q3 proceeds in the early stage of structural relaxation. Then, the Si-O-Si units with relatively small angles decrease even in the later stages, which is first evidence of ring deformation causing volume relaxation of soda-lime silicate glass because decreasing small Si-O-Si angles corresponds to the reduce of acute O-O-O angle in a ring and can expand the space inside the rings, and Na can be inserted into the ring center. In conclusion the ring deformation and Na displacement is the origin of the volume relaxation of soda-lime silicate glass below Tg.


title: Pulsar Classification: Comparing Quantum Convolutional Neural Networks and Quantum Support Vector Machines

abstract: Well-known quantum machine learning techniques, namely quantum kernel assisted support vector machines (QSVMs) and quantum convolutional neural networks (QCNNs), are applied to the binary classification of pulsars. In this comparitive study it is illustrated with simulations that both quantum methods successfully achieve effective classification of the HTRU-2 data set that connects pulsar class labels to eight separate features. QCNNs outperform the QSVMs with respect to time taken to train and predict, however, if the current NISQ era devices are considered and noise included in the comparison, then QSVMs are preferred. QSVMs also perform better overall compared to QCNNs when performance metrics are used to evaluate both methods. Classical methods are also implemented to serve as benchmark for comparison with the quantum approaches.


title: Exciton-Polariton Condensates: A Fourier Neural Operator Approach

abstract: Advancements in semiconductor fabrication over the past decade have catalyzed extensive research into all-optical devices driven by exciton-polariton condensates. Preliminary validations of such devices, including transistors, have shown encouraging results even under ambient conditions. A significant challenge still remains for large scale application however: the lack of a robust solver that can be used to simulate complex nonlinear systems which require an extended period of time to stabilize. Addressing this need, we propose the application of a machine-learning-based Fourier Neural Operator approach to find the solution to the Gross-Pitaevskii equations coupled with extra exciton rate equations. This work marks the first direct application of Neural Operators to an exciton-polariton condensate system. Our findings show that the proposed method can predict final-state solutions to a high degree of accuracy almost 1000 times faster than CUDA-based GPU solvers. Moreover, this paves the way for potential all-optical chip design workflows by integrating experimental data.


title: Rich Magnetic Phase Diagram of Putative Helimagnet Sr$_3$Fe$_2$O$_7$

abstract: The cubic perovskite SrFeO$_3$ was recently reported to host hedgehog- and skyrmion-lattice phases in a highly symmetric crystal structure which does not support the Dzyaloshinskii-Moriya interactions commonly invoked to explain such magnetic order. Hints of a complex magnetic phase diagram have also recently been found in powder samples of the single-layer Ruddlesden-Popper analog Sr$_2$FeO$_4$, so a reinvestigation of the bilayer material Sr$_3$Fe$_2$O$_7$, believed to be a simple helimagnet, is called for. Our magnetization and dilatometry studies reveal a rich magnetic phase diagram with at least 6 distinct magnetically ordered phases and strong similarities to that of SrFeO$_3$. In particular, at least one phase is apparently multiple-$\mathbf{q}$, and the $\mathbf{q}$s are not observed to vary among the phases. Since Sr$_3$Fe$_2$O$_7$ has only two possible orientations for its propagation vector, some of the phases are likely exotic multiple-$\mathbf{q}$ order, and it is possible to fully detwin all phases and more readily access their exotic physics.


title: Advancing the distributed Multi-GPU ChASE library through algorithm optimization and NCCL library

abstract: As supercomputers become larger with powerful Graphics Processing Unit (GPU), traditional direct eigensolvers struggle to keep up with the hardware evolution and scale efficiently due to communication and synchronization demands. Conversely, subspace eigensolvers, like the Chebyshev Accelerated Subspace Eigensolver (ChASE), have a simpler structure and can overcome communication and synchronization bottlenecks. ChASE is a modern subspace eigensolver that uses Chebyshev polynomials to accelerate the computation of extremal eigenpairs of dense Hermitian eigenproblems. In this work we show how we have modified ChASE by rethinking its memory layout, introducing a novel parallelization scheme, switching to a more performing communication-avoiding algorithm for one of its inner modules, and substituting the MPI library by the vendor-optimized NCCL library. The resulting library can tackle dense problems with size up to $N=\mathcal{O}(10^6)$, and scales effortlessly up to the full 900 nodes -- each one powered by 4$\times$A100 NVIDIA GPUs -- of the JUWELS Booster hosted at the J\"ulich Supercomputing Centre.


title: PolarNet: 3D Point Clouds for Language-Guided Robotic Manipulation

abstract: The ability for robots to comprehend and execute manipulation tasks based on natural language instructions is a long-term goal in robotics. The dominant approaches for language-guided manipulation use 2D image representations, which face difficulties in combining multi-view cameras and inferring precise 3D positions and relationships. To address these limitations, we propose a 3D point cloud based policy called PolarNet for language-guided manipulation. It leverages carefully designed point cloud inputs, efficient point cloud encoders, and multimodal transformers to learn 3D point cloud representations and integrate them with language instructions for action prediction. PolarNet is shown to be effective and data efficient in a variety of experiments conducted on the RLBench benchmark. It outperforms state-of-the-art 2D and 3D approaches in both single-task and multi-task learning. It also achieves promising results on a real robot.


title: Connected graphs with a given dissociation number attaining the minimum spectral radius

abstract: A dissociation set of a graph is a set of vertices which induces a subgraph with maximum degree less than or equal to one. The dissociation number of a graph is the maximum cardinality of its dissociation sets. In this paper, we study the connected graphs of order $n$ with a given dissociation number that attains the minimum spectral radius. We characterize these graphs when the dissociation number is in $\{n-1,~n-2,~\lceil2n/3\rceil,~\lfloor2n/3\rfloor,~2\}$. We also prove that these graphs are trees when the dissociation number is larger than $\lceil {2n}/{3}\rceil$.


title: On the uniqueness of solutions to the isotropic $L_{p}$ dual Minkowski problem

abstract: We prove that the unit sphere is the only smooth, strictly convex solution to the isotropic $L_p$ dual Minkowski problem \begin{align*} h^{p-1} |D h|^{n+1-q}\mathcal{K}=1, \end{align*} provided $(p,q)\in (-n-1,-1]\times [n,n+1)$.


title: OceanBench: The Sea Surface Height Edition

abstract: The ocean profoundly influences human activities and plays a critical role in climate regulation. Our understanding has improved over the last decades with the advent of satellite remote sensing data, allowing us to capture essential quantities over the globe, e.g., sea surface height (SSH). However, ocean satellite data presents challenges for information extraction due to their sparsity and irregular sampling, signal complexity, and noise. Machine learning (ML) techniques have demonstrated their capabilities in dealing with large-scale, complex signals. Therefore we see an opportunity for ML models to harness the information contained in ocean satellite data. However, data representation and relevant evaluation metrics can be the defining factors when determining the success of applied ML. The processing steps from the raw observation data to a ML-ready state and from model outputs to interpretable quantities require domain expertise, which can be a significant barrier to entry for ML researchers. OceanBench is a unifying framework that provides standardized processing steps that comply with domain-expert standards. It provides plug-and-play data and pre-configured pipelines for ML researchers to benchmark their models and a transparent configurable framework for researchers to customize and extend the pipeline for their tasks. In this work, we demonstrate the OceanBench framework through a first edition dedicated to SSH interpolation challenges. We provide datasets and ML-ready benchmarking pipelines for the long-standing problem of interpolating observations from simulated ocean satellite data, multi-modal and multi-sensor fusion issues, and transfer-learning to real ocean satellite observations. The OceanBench framework is available at github.com/jejjohnson/oceanbench and the dataset registry is available at github.com/quentinf00/oceanbench-data-registry.


title: pencal: an R Package for the Dynamic Prediction of Survival with Many Longitudinal Predictors

abstract: In survival analysis, longitudinal information on the health status of a patient can be used to dynamically update the predicted probability that a patient will experience an event of interest. Traditional approaches to dynamic prediction such as joint models become computationally unfeasible with more than a handful of longitudinal covariates, warranting the development of methods that can handle a larger number of longitudinal covariates. We introduce the R package pencal, which implements a Penalized Regression Calibration approach that makes it possible to handle many longitudinal covariates as predictors of survival. pencal uses mixed-effects models to summarize the trajectories of the longitudinal covariates up to a prespecified landmark time, and a penalized Cox model to predict survival based on both baseline covariates and summary measures of the longitudinal covariates. This article illustrates the structure of the R package, provides a step by step example showing how to estimate PRC, compute dynamic predictions of survival and validate performance, and shows how parallelization can be used to significantly reduce computing time.


title: A Study on Tiny YOLO for Resource Constrained Xray Threat Detection

abstract: This paper implements and analyzes multiple networks with the goal of understanding their suitability for edge device applications such as X-ray threat detection. In this study, we use the state-of-the-art YOLO object detection model to solve this task of detecting threats in security baggage screening images. We designed and studied three models - Tiny YOLO, QCFS Tiny YOLO, and SNN Tiny YOLO. We utilize an alternative activation function calculated to have zero expected conversion error with the activation of a spiking activation function in our Tiny YOLOv7 model. This \textit{QCFS} version of the Tiny YOLO replicates the activation function from ultra-low latency and high-efficiency SNN architecture. It achieves state-of-the-art performance on CLCXray, an open-source X-ray threat Detection dataset. In addition, we also study the behavior of a Spiking Tiny YOLO on the same X-ray threat Detection dataset.


title: Dispersive determination of fourth generation quark masses

abstract: We determine the masses of the sequential fourth generation quarks $b'$ and $t'$ in the extension of the Standard Model by solving the dispersion relations associated with the mixing between the neutral states $Q\bar q$ and $\bar Qq$, $Q$ ($q$) being a heavy (light) quark. The box diagrams responsible for the mixing, which provide the perturbative inputs to the dispersion relations, involve multiple intermediate channels, i.e., the $ut$ and $ct$ channels, $u$ ($c$, $t$) being an up (charm, top) quark, in the $b'$ case, and the $db'$, $sb'$ and $bb'$ ones, $d$ ($s$, $b$) being a down (strange, bottom) quark, in the $t'$ case. The common solutions for the above channels lead to the masses $m_{b'}=(2.7\pm 0.1)$ TeV and $m_{t'}\approx 200$ TeV unambiguously. We show that these superheavy quarks, forming bound states in a Yukawa potential, barely contribute to Higgs boson production via gluon fusion and decay to photon pairs, and bypass current experimental constraints. The mass of the $\bar b'b'$ ground state is estimated to be about 3.2 TeV. It is thus worthwhile to continue the search for $b'$ quarks or $\bar b'b'$ resonances at the (high-luminosity) large hadron collider.


title: Distill Knowledge in Multi-task Reinforcement Learning with Optimal-Transport Regularization

abstract: In multi-task reinforcement learning, it is possible to improve the data efficiency of training agents by transferring knowledge from other different but related tasks. Because the experiences from different tasks are usually biased toward the specific task goals. Traditional methods rely on Kullback-Leibler regularization to stabilize the transfer of knowledge from one task to the others. In this work, we explore the direction of replacing the Kullback-Leibler divergence with a novel Optimal transport-based regularization. By using the Sinkhorn mapping, we can approximate the Optimal transport distance between the state distribution of tasks. The distance is then used as an amortized reward to regularize the amount of sharing information. We experiment our frameworks on several grid-based navigation multi-goal to validate the effectiveness of the approach. The results show that our added Optimal transport-based rewards are able to speed up the learning process of agents and outperforms several baselines on multi-task learning.


title: Entropic Matching for Expectation Propagation of Markov Jump Processes

abstract: This paper addresses the problem of statistical inference for latent continuous-time stochastic processes, which is often intractable, particularly for discrete state space processes described by Markov jump processes. To overcome this issue, we propose a new tractable inference scheme based on an entropic matching framework that can be embedded into the well-known expectation propagation algorithm. We demonstrate the effectiveness of our method by providing closed-form results for a simple family of approximate distributions and apply it to the general class of chemical reaction networks, which are a crucial tool for modeling in systems biology. Moreover, we derive closed form expressions for point estimation of the underlying parameters using an approximate expectation maximization procedure. We evaluate the performance of our method on various chemical reaction network instantiations, including a stochastic Lotka-Voltera example, and discuss its limitations and potential for future improvements. Our proposed approach provides a promising direction for addressing complex continuous-time Bayesian inference problems.


title: Insights into bubble droplet interactions in evaporating polymeric droplets

abstract: Polymer droplets subjected to a heated environment have significance in several fields ranging from spray drying and powder formation to surface coating. In the present work, we investigate the evaporation of a high viscoelastic modulus aqueous polymeric droplet in an acoustically levitated environment. Depending on the laser irradiation intensity, we observe nucleation of a bubble in the dilute regime of polymer concentration, contrary to the previously observed bubble nucleation in a semi-dilute entangled regime for low viscoelastic modulus polymer droplets. After the bubble nucleation, a quasi steady bubble growth occurs depending on the laser irradiation intensity and concentrations. Our scaling analysis reveals that bubble growth follows Plesset-Zwick criteria independent of the viscoelastic properties of the polymer solution. Further, we establish that the onset of bubble growth has an inverse nonlinear dependence on the laser irradiation intensity. At high concentrations and laser irradiation intensities, we report the expansion and collapse of polymer membrane without rupture, indicating the formation of an interfacial skin with significant strength. The droplet oscillations are primarily driven by the presence of multiple bubbles and, to some extent, by the rotational motion of the droplet. Finally, depending on the nature of bubble growth, different types of precipitate form contrary to the different modes of atomization observed in low viscoelastic modulus polymer droplets.


title: From Misuse to Mastery: Enhancing Code Generation with Knowledge-Driven AI Chaining

abstract: Large Language Models (LLMs) have shown promising results in automatic code generation by improving coding efficiency to a certain extent. However, generating high-quality and reliable code remains a formidable task because of LLMs' lack of good programming practice, especially in exception handling. In this paper, we first conduct an empirical study and summarise three crucial challenges of LLMs in exception handling, i.e., incomplete exception handling, incorrect exception handling and abuse of try-catch. We then try prompts with different granularities to address such challenges, finding fine-grained knowledge-driven prompts works best. Based on our empirical study, we propose a novel Knowledge-driven Prompt Chaining-based code generation approach, name KPC, which decomposes code generation into an AI chain with iterative check-rewrite steps and chains fine-grained knowledge-driven prompts to assist LLMs in considering exception-handling specifications. We evaluate our KPC-based approach with 3,079 code generation tasks extracted from the Java official API documentation. Extensive experimental results demonstrate that the KPC-based approach has considerable potential to ameliorate the quality of code generated by LLMs. It achieves this through proficiently managing exceptions and obtaining remarkable enhancements of 109.86% and 578.57% with static evaluation methods, as well as a reduction of 18 runtime bugs in the sampled dataset with dynamic validation.


title: Shape optimization in $W^{1,\infty}$ with geometric constraints: a study in distributed-memory systems

abstract: In this paper we present a shape optimization scheme which utilizes the alternating direction method of multipliers (ADMM) to approximate a direction of steepest descent in $W^{1,\infty}$. The followed strategy is a combination of the approaches presented in Deckelnick, Herbert, and Hinze, ESAIM: COCV 28 (2022) and M\"uller et al. SIAM SISC 45 (2023). This has appeared previously for relatively simple elliptic PDEs with geometric constraints which were handled using an ad-hoc projection. Here, however, the optimization problem is expanded to include geometric constraints, which are systematically fulfilled. Moreover, this results in a nonlinear system of equations, which is challenging from a computational perspective. Simulations of a fluid dynamics case study are carried out to benchmark the novel method. Results are given to show that, compared to other methods, the proposed methodology allows for larger deformations without affecting the convergence of the used numerical methods. The mesh quality is studied across the surface of the optimized obstacle, and is further compared to previous approaches which used descents in $W^{p,\infty}$. The parallel scalability is tested on a distributed-memory system to illustrate the potential of the proposed techniques in a more complex, industrial setting.


title: NoSENSE: Learned unrolled cardiac MRI reconstruction without explicit sensitivity maps

abstract: We present a novel learned image reconstruction method for accelerated cardiac MRI with multiple receiver coils based on deep convolutional neural networks (CNNs) and algorithm unrolling. In contrast to many existing learned MR image reconstruction techniques that necessitate coil-sensitivity map (CSM) estimation as a distinct network component, our proposed approach avoids explicit CSM estimation. Instead, it implicitly captures and learns to exploit the inter-coil relationships of the images. Our method consists of a series of novel learned image and k-space blocks with shared latent information and adaptation to the acquisition parameters by feature-wise modulation (FiLM), as well as coil-wise data-consistency (DC) blocks. Our method achieved PSNR values of 34.89 and 35.56 and SSIM values of 0.920 and 0.942 in the cine track and mapping track validation leaderboard of the MICCAI STACOM CMRxRecon Challenge, respectively, ranking 4th among different teams at the time of writing. Code will be made available at https://github.com/fzimmermann89/CMRxRecon


title: Developing automatic verbatim transcripts for international multilingual meetings: an end-to-end solution

abstract: This paper presents an end-to-end solution for the creation of fully automated conference meeting transcripts and their machine translations into various languages. This tool has been developed at the World Intellectual Property Organization (WIPO) using in-house developed speech-to-text (S2T) and machine translation (MT) components. Beyond describing data collection and fine-tuning, resulting in a highly customized and robust system, this paper describes the architecture and evolution of the technical components as well as highlights the business impact and benefits from the user side. We also point out particular challenges in the evolution and adoption of the system and how the new approach created a new product and replaced existing established workflows in conference management documentation.


title: Genius Cliques: Mapping out the Nobel Network

abstract: In this short piece, I delved into the connections of Nobel laureates by applying Network Science methods to and public data collected from Wikipedia. I uncovered the existence of a central "giant component" in the Nobel laureate network, highlighting the core-periphery structure and the disparity in visibility among laureates. I explored the dominance of laureates in the fields of science and humanities, revealing a polarization that contradicts the trend of interdisciplinary research. Furthermore, it the finding sheds light on the underrepresentation of female laureates in certain Nobel Prize categories.


title: A common approach to singular perturbation and homogenization I: Quasilinear ODE systems

abstract: We consider periodic homogenization of boundary value problems for quasilinear second-order ODE systems in divergence form of the type $a(x,x/\varepsilon,u(x),u'(x))'= f(x,x/\varepsilon,u(x),u'(x))$ for $x \in [0,1]$. For small $\varepsilon>0$ we show existence of weak solutions $u=u_\varepsilon$ as well as their local uniqueness for $\|u-u_0\|_\infty \approx 0$, where $u_0$ is a given non-degenerate solution to the homogenized boundary value problem, and we describe the rate of convergence to zero for $\varepsilon \to 0$ of the homogenization error $\|u_\varepsilon-u_0\|_\infty$. In particular, we show that this rate depends on the smoothness of the maps $a(\cdot,y,u,u')$ and $f(\cdot,y,u,u')$. Our assumptions are, roughly speaking, as follows: The maps $a,f:[0,1]\times\mathbb{R}\times\mathbb{R}^n\times\mathbb{R}^n\to\mathbb{R}^n$ are continuous, the maps $a(x,y,\cdot,\cdot)$ and $f(x,y,\cdot,\cdot)$ are $C^1$-smooth, the maps $a(x,\cdot,u,u')$ and $f(x,\cdot,u,u')$ are 1-periodic, and the maps $a(x,y,u,\cdot)$ are strongly monotone and Lipschitz continuous uniformly with respect to $x$, $y$ and bounded $u$. No global solution uniqueness is supposed. Because $x$ is one-dimensional, no correctors and no cell problems are needed. But, because the problem is nonlinear, we have to care about commutability of homogenization and linearization. The main tool of the proofs is an abstract result of implicit function theorem type which in the past has been applied to singularly perturbed nonlinear ODEs and elliptic and parabolic PDEs and, hence, which permits a common approach to existence and local uniqueness results for singularly perturbed problems and and for homogenization problems.


title: Illuminating Router Vendor Diversity Within Providers and Along Network Paths

abstract: The Internet architecture has facilitated a multi-party, distributed, and heterogeneous physical infrastructure where routers from different vendors connect and inter-operate via IP. Such vendor heterogeneity can have important security and policy implications. For example, a security vulnerability may be specific to a particular vendor and implementation, and thus will have a disproportionate impact on particular networks and paths if exploited. From a policy perspective, governments are now explicitly banning particular vendors, or have threatened to do so. Despite these critical issues, the composition of router vendors across the Internet remains largely opaque. Remotely identifying router vendors is challenging due to their strict security posture, indistinguishability due to code sharing across vendors, and noise due to vendor mergers. We make progress in overcoming these challenges by developing LFP, a tool that improves the coverage, accuracy, and efficiency of router fingerprinting as compared to the current state-of-the-art. We leverage LFP to characterize the degree of router vendor homogeneity within networks and the regional distribution of vendors. We then take a path-centric view and apply LFP to better understand the potential for correlated failures and fate-sharing. Finally, we perform a case study on inter- and intra-United States data paths to explore the feasibility to make vendor-based routing policy decisions, i.e., whether it is possible to avoid a particular vendor given the current infrastructure.


title: Streaming instability in neutron star magnetospheres: No indication of soliton-like waves

abstract: Coherent radiation of pulsars, magnetars, and fast radio bursts could, in theory, be interpreted as radiation from solitons and soliton-like waves. The solitons are meant to contain a large number of electric charges confined on long time-scales and may radiate strongly by coherent curvature emission. However, solitons are also known to undergo a wave collapse, which may cast doubts on the correctness of the soliton radio emission models of neutron stars. We investigate the evolution of the caviton type of solitons self-consistently formed by the relativistic streaming instability and compare their apparent stability in 1D calculations with more generic 2D cases, in which the solitons are seen to collapse. Three representative cases of beam Lorentz factors and plasma temperatures are studied to obtain soliton dispersion properties. We utilized 1D electrostatic and 2D electromagnetic relativistic particle-in-cell simulations at kinetic microscales. We found that no solitons are generated by the streaming instability in the 2D simulations. Only superluminal L-mode (relativistic Langmuir) waves are produced during the saturation of the instability, but these waves have smaller amplitudes than the waves in the 1D simulations. The amplitudes tend to decrease after the instability has saturated, and only waves close to the light line, $\omega = c k$, remain. Solitons in the 1D approach are stable for $\gamma_\mathrm{b} \gtrsim 60$, but they disappear for low beam Lorentz factor $\gamma_\mathrm{b} < 6$. Our examples show that the superluminal soliton branch that is formed in 1D simulations will not be generated by the relativistic streaming instability when more dimensional degrees of freedom are present - unless one can show that there are alternative plasma mechanisms for the soliton generation.


title: Delta-alpha cross-frequency coupling for different brain regions

abstract: Neural interactions occur on different levels and scales. It is of particular importance to understand how they are distributed among different neuroanatomical and physiological relevant brain regions. We investigated neural cross-frequency couplings between different brain regions according to the Desikan-Killiany brain parcellation. The adaptive dynamic Bayesian inference method was applied to EEG measurements of healthy resting subjects in order to reconstruct the coupling functions. It was found that even after averaging over all subjects, the mean coupling function showed a characteristic waveform, confirming the direct influence of the delta-phase on the alpha-phase dynamics in certain brain regions and that the shape of the coupling function changes for different regions. While the averaged coupling function within a region was of similar form, the region-averaged coupling function was averaged out, which implies that there is a common dependence within separate regions across the subjects. It was also found that for certain regions the influence of delta on alpha oscillations is more pronounced and that oscillations that influence other are more evenly distributed across brain regions than the influenced oscillations. When presenting the information on brain lobes, it was shown that the influence of delta emanating from the brain as a whole is greatest on the alpha oscillations of the cingulate frontal lobe, and at the same time the influence of delta from the cingulate parietal brain lobe is greatest on the alpha oscillations of the whole brain.

categories: nlin.AO physics.bio-ph physics.data-an physics.med-ph q-bio.NC


title: Mappings of finite distortion on metric surfaces

abstract: We investigate basic properties of mappings of finite distortion $f:X \to \mathbb{R}^2$, where $X$ is any metric surface, i.e., metric space homeomorphic to a planar domain with locally finite $2$-dimensional Hausdorff measure. We introduce lower gradients, which complement the upper gradients of Heinonen and Koskela, to study the distortion of non-homeomorphic maps on metric spaces. We extend the Iwaniec-\v{S}ver\'ak theorem to metric surfaces: a non-constant $f:X \to \mathbb{R}^2$ with locally square integrable upper gradient and locally integrable distortion is continuous, open and discrete. We also extend the Hencl-Koskela theorem by showing that if $f$ is moreover injective then $f^{-1}$ is a Sobolev map.


title: Perception for Humanoid Robots

abstract: Purpose of Review: The field of humanoid robotics, perception plays a fundamental role in enabling robots to interact seamlessly with humans and their surroundings, leading to improved safety, efficiency, and user experience. This scientific study investigates various perception modalities and techniques employed in humanoid robots, including visual, auditory, and tactile sensing by exploring recent state-of-the-art approaches for perceiving and understanding the internal state, the environment, objects, and human activities. Recent Findings: Internal state estimation makes extensive use of Bayesian filtering methods and optimization techniques based on maximum a-posteriori formulation by utilizing proprioceptive sensing. In the area of external environment understanding, with an emphasis on robustness and adaptability to dynamic, unforeseen environmental changes, the new slew of research discussed in this study have focused largely on multi-sensor fusion and machine learning in contrast to the use of hand-crafted, rule-based systems. Human robot interaction methods have established the importance of contextual information representation and memory for understanding human intentions. Summary: This review summarizes the recent developments and trends in the field of perception in humanoid robots. Three main areas of application are identified, namely, internal state estimation, external environment estimation, and human robot interaction. The applications of diverse sensor modalities in each of these areas are considered and recent significant works are discussed.


title: RapidEarth: A Search-by-Classification Engine for Large-Scale Geospatial Imagery

abstract: Data exploration and analysis in various domains often necessitate the search for specific objects in massive databases. A common search strategy, often known as search-by-classification, resorts to training machine learning models on small sets of positive and negative samples and to performing inference on the entire database to discover additional objects of interest. While such an approach often yields very good results in terms of classification performance, the entire database usually needs to be scanned, a process that can easily take several hours even for medium-sized data catalogs. In this work, we present RapidEarth, a geospatial search-by-classification engine that allows analysts to rapidly search for interesting objects in very large data collections of satellite imagery in a matter of seconds, without the need to scan the entire data catalog. RapidEarth embodies a co-design of multidimensional indexing structures and decision branches, a recently proposed variant of classical decision trees. These decision branches allow RapidEarth to transform the inference phase into a set of range queries, which can be efficiently processed by leveraging the aforementioned multidimensional indexing structures. The main contribution of this work is a geospatial search engine that implements these technical findings.


title: Vectorial ground state solutions for a class of Hartree-Fock type systems with the double coupled feature

abstract: In this paper we study the Hartree-Fock type system as follows: \begin{equation*} \left\{ \begin{array}{ll} -\Delta u+u+\lambda \phi _{u,v}u=\left\vert u\right\vert ^{p-2}u+\beta \left\vert v\right\vert ^{\frac{p}{2}}\left\vert u\right\vert ^{\frac{p}{2}% -2}u & \text{ in }\mathbb{R}^{3}, \\ -\Delta v+v+\lambda \phi _{u,v}v=\left\vert v\right\vert ^{p-2}v+\beta \left\vert u\right\vert ^{\frac{p}{2}}\left\vert v\right\vert ^{\frac{p}{2}% -2}v & \text{ in }\mathbb{R}^{3},% \end{array}% \right. \end{equation*}% where $\phi _{u,v}(x)=\int_{\mathbb{R}^{3}}\frac{u^{2}(y)+v^{2}\left( y\right) }{|x-y|}dy,$ the parameters $\lambda,\beta >0$ and $2<p<4$. Such system is viewed as an approximation of the Coulomb system with two particles appeared in quantum mechanics, taking into account the Pauli principle. Its characteristic feature lies on the presence of the double coupled terms. When $2<p<3,$ we establish the existence and multiplicity of nontrivial radial solutions, including vectorial ones, in the radial space $% H_{r}$ by describing the internal relationship between the coupling constants $\lambda $ and $\beta.$ When $2<p<4,$ we study the existence of vectorial solutions in the non-radial space $H$ by developing a novel constraint method, together with some new analysis techniques. In particular, when $3\leq p<4,$ a vectorial ground state solution is found in $% H$, which is innovative as it was not discussed at all in any previous results. Our study can be regarded as an entire supplement in d'Avenia et al. [J. Differential Equations 335 (2022) 580--614].


title: Utilization of machine learning for the detection of self-admitted vulnerabilities

abstract: Motivation: Technical debt is a metaphor that describes not-quite-right code introduced for short-term needs. Developers are aware of it and admit it in source code comments, which is called Self- Admitted Technical Debt (SATD). Therefore, SATD indicates weak code that developers are aware of. Problem statement: Inspecting source code is time-consuming; automatically inspecting source code for its vulnerabilities is a crucial aspect of developing software. It helps practitioners reduce the time-consuming process and focus on vulnerable aspects of the source code. Proposal: Accurately identify and better understand the semantics of self-admitted technical debt (SATD) by leveraging NLP and NL-PL approaches to detect vulnerabilities and the related SATD. Finally, a CI/CD pipeline will be proposed to make the vulnerability discovery process easily accessible to practitioners.


title: Grading of homogeneous localization by the Grothendieck group

abstract: Let $G$ be the Grothendieck group of a commutative monoid $M$. We prove that for any multiplicative set $S$ of homogeneous elements of an $M$-graded ring $R=\bigoplus\limits_{m\in M}R_{m}$, then the localization ring ...


title: A City-centric Approach to Estimate and Evaluate Global Urban Air Mobility Demand

abstract: Urban Air Mobility (UAM) is expected to effectively complement the existing transportation system by providing fast and safe travel options, contributing to decarbonization, and providing benefits to citizens and communities. A preliminary estimate of the potential global demand for UAM, the associated aircraft movements, and the required vehicles is essential for the UAM industry for their long-term planning, but also of interest to other stakeholders such as governments and transportation planners to develop appropriate strategies and actions to implement UAM. This paper proposes a city-centric forecasting methodology that provides preliminary estimates of the potential global UAM demand for intra-city air taxi services for 990 cities worldwide. By summing all city-specific results, an estimate of the global UAM demand is obtained. By varying the parameters of the UAM system, sensitivity studies and different market scenarios are developed and analyzed. Sensitivity analyses show how strongly demand decreases when air taxi ticket prices increase. Considering low ticket prices and high vertiport densities, possible market development scenarios show that there is a market potential for UAM in over 200 cities worldwide by 2050. The study highlights the significant impact of low ticket prices and the need for high vertiport densities to drive UAM demand. This highlights the need for careful optimization of system components to minimize costs and increase the quality of UAM services.


title: Pushing Alias Resolution to the Limit

abstract: In this paper, we show that utilizing multiple protocols offers a unique opportunity to improve IP alias resolution and dual-stack inference substantially. Our key observation is that prevalent protocols, e.g., SSH and BGP, reply to unsolicited requests with a set of values that can be combined to form a unique device identifier. More importantly, this is possible by just completing the TCP hand-shake. Our empirical study shows that utilizing readily available scans and our active measurements can double the discovered IPv4 alias sets and more than 30x the dual-stack sets compared to the state-of-the-art techniques. We provide insights into our method's accuracy and performance compared to popular techniques.


title: Finite Element Models for Magnetic Shields Made of Stacked Superconducting Tape Annuli

abstract: Stacks of high-temperature superconducting tape annuli can be used as magnetic shields operating efficiently for both axial and transverse fields. However, due to their layered geometry and hybrid electrical and magnetic properties, implementing models of such structures is not straightforward. In this work, we propose two different modelling approaches with the finite element method: layered and homogenized. We compare their accuracy and numerical efficiency for three different formulations (h-phi, h-phi-b, and a-j), in both axial (2D-axisymmetric) and transverse (3D) configurations. We show that both approaches lead to comparable performance in the axial case, but that the homogenized model is considerably harder to use in the transverse case.


title: Orientation Control with Variable Stiffness Dynamical Systems

abstract: Recently, several approaches have attempted to combine motion generation and control in one loop to equip robots with reactive behaviors, that cannot be achieved with traditional time-indexed tracking controllers. These approaches however mainly focused on positions, neglecting the orientation part which can be crucial to many tasks e.g. screwing. In this work, we propose a control algorithm that adapts the robot's rotational motion and impedance in a closed-loop manner. Given a first-order Dynamical System representing an orientation motion plan and a desired rotational stiffness profile, our approach enables the robot to follow the reference motion with an interactive behavior specified by the desired stiffness, while always being aware of the current orientation, represented as a Unit Quaternion (UQ). We rely on the Lie algebra to formulate our algorithm, since unlike positions, UQ feature constraints that should be respected in the devised controller. We validate our proposed approach in multiple robot experiments, showcasing the ability of our controller to follow complex orientation profiles, react safely to perturbations, and fulfill physical interaction tasks.


title: Leveraging Topology for Domain Adaptive Road Segmentation in Satellite and Aerial Imagery

abstract: Getting precise aspects of road through segmentation from remote sensing imagery is useful for many real-world applications such as autonomous vehicles, urban development and planning, and achieving sustainable development goals. Roads are only a small part of the image, and their appearance, type, width, elevation, directions, etc. exhibit large variations across geographical areas. Furthermore, due to differences in urbanization styles, planning, and the natural environments; regions along the roads vary significantly. Due to these variations among the train and test domains, the road segmentation algorithms fail to generalize to new geographical locations. Unlike the generic domain alignment scenarios, road segmentation has no scene structure, and generic domain adaptation methods are unable to enforce topological properties like continuity, connectivity, smoothness, etc., thus resulting in degraded domain alignment. In this work, we propose a topology-aware unsupervised domain adaptation approach for road segmentation in remote sensing imagery. Specifically, we predict road skeleton, an auxiliary task to impose the topological constraints. To enforce consistent predictions of road and skeleton, especially in the unlabeled target domain, the conformity loss is defined across the skeleton prediction head and the road-segmentation head. Furthermore, for self-training, we filter out the noisy pseudo-labels by using a connectivity-based pseudo-labels refinement strategy, on both road and skeleton segmentation heads, thus avoiding holes and discontinuities. Extensive experiments on the benchmark datasets show the effectiveness of the proposed approach compared to existing state-of-the-art methods. Specifically, for SpaceNet to DeepGlobe adaptation, the proposed approach outperforms the competing methods by a minimum margin of 6.6%, 6.7%, and 9.8% in IoU, F1-score, and APLS, respectively.


title: Models for irreducible representations of the symplectic algebra using Dirac-type operators

abstract: In this paper we will study both the finite and infinite-dimensional representations of the symplectic Lie algebra $\mathfrak{sp}(2n)$ and develop a polynomial model for these representations. This means that we will associate a certain space of homogeneous polynomials in a matrix variable, intersected with the kernel of $\mathfrak{sp}(2n)$-invariant differential operators related to the symplectic Dirac operator with every irreducible representation of $\mathfrak{sp}(2n)$. We will show that the systems of symplectic Dirac operators can be seen as generators of parafermion algebras. As an application of these new models, we construct a symplectic analogue of the Rarita-Schwinger operator using the theory of transvector algebras.


title: Neuromorphic Imaging and Classification with Graph Learning

abstract: Bio-inspired neuromorphic cameras asynchronously record pixel brightness changes and generate sparse event streams. They can capture dynamic scenes with little motion blur and more details in extreme illumination conditions. Due to the multidimensional address-event structure, most existing vision algorithms cannot properly handle asynchronous event streams. While several event representations and processing methods have been developed to address such an issue, they are typically driven by a large number of events, leading to substantial overheads in runtime and memory. In this paper, we propose a new graph representation of the event data and couple it with a Graph Transformer to perform accurate neuromorphic classification. Extensive experiments show that our approach leads to better results and excels at the challenging realistic situations where only a small number of events and limited computational resources are available, paving the way for neuromorphic applications embedded into mobile facilities.


title: On equitably 2-colourable odd cycle decompositions

abstract: An $\ell$-cycle decomposition of $K_v$ is said to be \emph{equitably $2$-colourable} if there is a $2$-vertex-colouring of $K_v$ such that each colour is represented (approximately) an equal number of times on each cycle: more precisely, we ask that in each cycle $C$ of the decomposition, each colour appears on $\lfloor \ell/2 \rfloor$ or $\lceil \ell/2 \rceil$ of the vertices of $C$. In this paper we study the existence of equitably 2-colourable $\ell$-cycle decompositions of $K_v$, where $\ell$ is odd, and prove the existence of such a decomposition for $v \equiv 1, \ell$ (mod $2\ell$).


abstract: The 2pf in single-trace $T\bar T$ holography was computed and analyzed for operators in the $w=0$ sector in~\cite{Asrat:2017tzd}. Here we present its immediate generalization to non-zero winding $w$. For long strings, the result is identical to the one obtained within the TsT/$T\bar T$ approach in~\cite{Cui:2023jrb} (up to a factor of the reflection coefficient).


title: NLPBench: Evaluating Large Language Models on Solving NLP Problems

abstract: Recent developments in large language models (LLMs) have shown promise in enhancing the capabilities of natural language processing (NLP). Despite these successes, there remains a dearth of research dedicated to the NLP problem-solving abilities of LLMs. To fill the gap in this area, we present a unique benchmarking dataset, NLPBench, comprising 378 college-level NLP questions spanning various NLP topics sourced from Yale University's prior final exams. NLPBench includes questions with context, in which multiple sub-questions share the same public information, and diverse question types, including multiple choice, short answer, and math. Our evaluation, centered on LLMs such as GPT-3.5/4, PaLM-2, and LLAMA-2, incorporates advanced prompting strategies like the chain-of-thought (CoT) and tree-of-thought (ToT). Our study reveals that the effectiveness of the advanced prompting strategies can be inconsistent, occasionally damaging LLM performance, especially in smaller models like the LLAMA-2 (13b). Furthermore, our manual assessment illuminated specific shortcomings in LLMs' scientific problem-solving skills, with weaknesses in logical decomposition and reasoning notably affecting results.


title: Design and Optimization of Residual Neural Network Accelerators for Low-Power FPGAs Using High-Level Synthesis

abstract: Residual neural networks are widely used in computer vision tasks. They enable the construction of deeper and more accurate models by mitigating the vanishing gradient problem. Their main innovation is the residual block which allows the output of one layer to bypass one or more intermediate layers and be added to the output of a later layer. Their complex structure and the buffering required by the residual block make them difficult to implement on resource-constrained platforms. We present a novel design flow for implementing deep learning models for field programmable gate arrays optimized for ResNets, using a strategy to reduce their buffering overhead to obtain a resource-efficient implementation of the residual layer. Our high-level synthesis (HLS)-based flow encompasses a thorough set of design principles and optimization strategies, exploiting in novel ways standard techniques such as temporal reuse and loop merging to efficiently map ResNet models, and potentially other skip connection-based NN architectures, into FPGA. The models are quantized to 8-bit integers for both weights and activations, 16-bit for biases, and 32-bit for accumulations. The experimental results are obtained on the CIFAR-10 dataset using ResNet8 and ResNet20 implemented with Xilinx FPGAs using HLS on the Ultra96-V2 and Kria KV260 boards. Compared to the state-of-the-art on the Kria KV260 board, our ResNet20 implementation achieves 2.88X speedup with 0.5% higher accuracy of 91.3%, while ResNet8 accuracy improves by 2.8% to 88.7%. The throughputs of ResNet8 and ResNet20 are 12971 FPS and 3254 FPS on the Ultra96 board, and 30153 FPS and 7601 FPS on the Kria KV26, respectively. They Pareto-dominate state-of-the-art solutions concerning accuracy, throughput, and energy.


title: A Refined Algorithm for the Adaptive Optimal Output Regulation Problem

abstract: Given a linear unknown system with $m$ inputs, $p$ outputs, $n$ dimensional state vector, and $q$ dimensional ecosystem, the problem of the adaptive optimal output regulation of this system boils down to iteratively solving a set of linear equations and each of these equations contains $\frac{n (n+1)}{2} + (m+q)n$ unknown variables. In this paper, we refine the existing algorithm by decoupling each of these linear equations into two lower-dimensional linear equations. The first one contains $nq$ unknown variables, and the second one contains $\frac{n (n+1)}{2} + mn$ unknown variables. As a result, the solvability conditions for these equations are also significantly weakened.