title: Deep Supervision by Gaussian Pseudo-label-based Morphological Attention for Abdominal Aorta Segmentation in Non-Contrast CTs

abstract: The segmentation of the abdominal aorta in non-contrast CT images is a non-trivial task for computer-assisted endovascular navigation, particularly in scenarios where contrast agents are unsuitable. While state-of-the-art deep learning segmentation models have been proposed recently for this task, they are trained on manually annotated strong labels. However, the inherent ambiguity in the boundary of the aorta in non-contrast CT may undermine the reliability of strong labels, leading to potential overfitting risks. This paper introduces a Gaussian-based pseudo label, integrated into conventional deep learning models through deep supervision, to achieve Morphological Attention (MA) enhancement. As the Gaussian pseudo label retains the morphological features of the aorta without explicitly representing its boundary distribution, we suggest that it preserves aortic morphology during training while mitigating the negative impact of ambiguous boundaries, reducing the risk of overfitting. It is introduced in various 2D/3D deep learning models and validated on our local data set of 30 non-contrast CT volumes comprising 5749 CT slices. The results underscore the effectiveness of MA in preserving the morphological characteristics of the aorta and addressing overfitting concerns, thereby enhancing the performance of the models.


title: Modeling of learning curves with applications to pos tagging

abstract: An algorithm to estimate the evolution of learning curves on the whole of a training data base, based on the results obtained from a portion and using a functional strategy, is introduced. We approximate iteratively the sought value at the desired time, independently of the learning technique used and once a point in the process, called prediction level, has been passed. The proposal proves to be formally correct with respect to our working hypotheses and includes a reliable proximity condition. This allows the user to fix a convergence threshold with respect to the accuracy finally achievable, which extends the concept of stopping criterion and seems to be effective even in the presence of distorting observations. Our aim is to evaluate the training effort, supporting decision making in order to reduce the need for both human and computational resources during the learning process. The proposal is of interest in at least three operational procedures. The first is the anticipation of accuracy gain, with the purpose of measuring how much work is needed to achieve a certain degree of performance. The second relates the comparison of efficiency between systems at training time, with the objective of completing this task only for the one that best suits our requirements. The prediction of accuracy is also a valuable item of information for customizing systems, since we can estimate in advance the impact of settings on both the performance and the development costs. Using the generation of part-of-speech taggers as an example application, the experimental results are consistent with our expectations.


title: Adaptive scheduling for adaptive sampling in POS taggers construction

abstract: We introduce an adaptive scheduling for adaptive sampling as a novel way of machine learning in the construction of part-of-speech taggers. The goal is to speed up the training on large data sets, without significant loss of performance with regard to an optimal configuration. In contrast to previous methods using a random, fixed or regularly rising spacing between the instances, ours analyzes the shape of the learning curve geometrically in conjunction with a functional model to increase or decrease it at any time. The algorithm proves to be formally correct regarding our working hypotheses. Namely, given a case, the following one is the nearest ensuring a net gain of learning ability from the former, it being possible to modulate the level of requirement for this condition. We also improve the robustness of sampling by paying greater attention to those regions of the training data base subject to a temporary inflation in performance, thus preventing the learning from stopping prematurely. The proposal has been evaluated on the basis of its reliability to identify the convergence of models, corroborating our expectations. While a concrete halting condition is used for testing, users can choose any condition whatsoever to suit their own specific needs.


title: Bridging Relations between SVD in Tensor Networks and Common Matrix Operations in Quantum Information Theory

abstract: This document explores the connections between singular value decomposition (SVD) and various tensor operations in the context of quantum state calculations and tensor networks. The relationships between SVD and quantities such as trace, trace distance, Frobenius norm, and fidelity are examined, highlighting their similarities and differences. The intuition behind these mathematical connections is explained, providing insights into the underlying principles and applications of SVD and tensor operations in quantum physics and computational mathematics


title: Latent Graph Diffusion: A Unified Framework for Generation and Prediction on Graphs

abstract: In this paper, we propose the first framework that enables solving graph learning tasks of all levels (node, edge and graph) and all types (generation, regression and classification) with one model. We first propose Latent Graph Diffusion (LGD), a generative model that can generate node, edge, and graph-level features of all categories simultaneously. We achieve this goal by embedding the graph structures and features into a latent space leveraging a powerful encoder which can also be decoded, then training a diffusion model in the latent space. LGD is also capable of conditional generation through a specifically designed cross-attention mechanism. Then we formulate prediction tasks including regression and classification as (conditional) generation, which enables our LGD to solve tasks of all levels and all types with provable guarantees. We verify the effectiveness of our framework with extensive experiments, where our models achieve state-of-the-art or highly competitive results across generation and regression tasks.


title: SIMPL: A Simple and Efficient Multi-agent Motion Prediction Baseline for Autonomous Driving

abstract: This paper presents a Simple and effIcient Motion Prediction baseLine (SIMPL) for autonomous vehicles. Unlike conventional agent-centric methods with high accuracy but repetitive computations and scene-centric methods with compromised accuracy and generalizability, SIMPL delivers real-time, accurate motion predictions for all relevant traffic participants. To achieve improvements in both accuracy and inference speed, we propose a compact and efficient global feature fusion module that performs directed message passing in a symmetric manner, enabling the network to forecast future motion for all road users in a single feed-forward pass and mitigating accuracy loss caused by viewpoint shifting. Additionally, we investigate the continuous trajectory parameterization using Bernstein basis polynomials in trajectory decoding, allowing evaluations of states and their higher-order derivatives at any desired time point, which is valuable for downstream planning tasks. As a strong baseline, SIMPL exhibits highly competitive performance on Argoverse 1 & 2 motion forecasting benchmarks compared with other state-of-the-art methods. Furthermore, its lightweight design and low inference latency make SIMPL highly extensible and promising for real-world onboard deployment. We open-source the code at https://github.com/HKUST-Aerial-Robotics/SIMPL.


title: A minimal model of cognition based on oscillatory and reinforcement processes

abstract: Building mathematical models of brains is difficult because of the sheer complexity of the problem. One potential starting point is through basal cognition, which give abstract representation of a range of organisms without central nervous systems, including fungi, slime moulds and bacteria. We propose one such model, demonstrating how a combination of oscillatory and current-based reinforcement processes can be used to couple resources in an efficient manner, mimicking the way these organisms function. A key ingredient in our model, not found in previous basal cognition models, is that we explicitly model oscillations in the number of particles (i.e. the nutrients, chemical signals or similar, which make up the biological system) and the flow of these particles within the modelled organisms. Using this approach, we find that our model builds efficient solutions, provided the environmental oscillations are sufficiently out of phase. We further demonstrate that amplitude differences can promote efficient solutions and that the system is robust to frequency differences. In the context of these findings, we discuss connections between our model and basal cognition in biological systems and slime moulds, in particular, how oscillations might contribute to self-organised problem-solving by these organisms.

categories: q-bio.NC cs.SI math.DS nlin.AO physics.bio-ph


title: Neuromorphic hardware for sustainable AI data centers

abstract: As humans advance toward a higher level of artificial intelligence, it is always at the cost of escalating computational resource consumption, which requires developing novel solutions to meet the exponential growth of AI computing demand. Neuromorphic hardware takes inspiration from how the brain processes information and promises energy-efficient computing of AI workloads. Despite its potential, neuromorphic hardware has not found its way into commercial AI data centers. In this article, we try to analyze the underlying reasons for this and derive requirements and guidelines to promote neuromorphic systems for efficient and sustainable cloud computing: We first review currently available neuromorphic hardware systems and collect examples where neuromorphic solutions excel conventional AI processing on CPUs and GPUs. Next, we identify applications, models and algorithms which are commonly deployed in AI data centers as further directions for neuromorphic algorithms research. Last, we derive requirements and best practices for the hardware and software integration of neuromorphic systems into data centers. With this article, we hope to increase awareness of the challenges of integrating neuromorphic hardware into data centers and to guide the community to enable sustainable and energy-efficient AI at scale.


title: Absolute convergence and error thresholds in non-active adaptive sampling

abstract: Non-active adaptive sampling is a way of building machine learning models from a training data base which are supposed to dynamically and automatically derive guaranteed sample size. In this context and regardless of the strategy used in both scheduling and generating of weak predictors, a proposal for calculating absolute convergence and error thresholds is described. We not only make it possible to establish when the quality of the model no longer increases, but also supplies a proximity condition to estimate in absolute terms how close it is to achieving such a goal, thus supporting decision making for fine-tuning learning parameters in model selection. The technique proves its correctness and completeness with respect to our working hypotheses, in addition to strengthening the robustness of the sampling scheme. Tests meet our expectations and illustrate the proposal in the domain of natural language processing, taking the generation of part-of-speech taggers as case study.


abstract: FEniCSx Preconditioning Tools (FEniCSx-pctools) is a software package for easing the specification of PETSc-based block preconditioning strategies in the DOLFINx finite element solver of the FEniCS Project. It attaches all of the necessary metadata to the block-structured linear systems in order that block-structured preconditioners can be applied straightforwardly via PETSc's options-based configuration system. Fast prototyping is facilitated thanks to the implementation in Python, and all intensive operations are executed in C/C++. FEniCSx-pctools is available under the LGPLv3 or later license.


title: A theta operator for the group $\mathrm{GSp}_4$

abstract: We construct a differential operator on sheaves of $p$-adic modular forms defined over the locus of $p$-rank $\ge 1$ of the Siegel threefold, by applying a revisited version of the approach that Sean Howe recently introduced in his paper "A unipotent circle action on $p$-adic modular forms" (2020, Trans. Am. Math. Soc.) to construct the theta operator in the elliptic case.


title: A note on vertex Tur\'an problems in the Kneser cube

abstract: The Kneser cube $Kn_n$ has vertex set $2^{[n]}$ and two vertices $F,F'$ are joined by an edge if and only if $F\cap F'=\emptyset$. For a fixed graph $G$, we are interested in the most number $vex(n,G)$ of vertices of $Kn_n$ that span a $G$-free subgraph in $Kn_n$. We show that the asymptotics of $vex(n,G)$ is $(1+o(1))2^{n-1}$ for bipartite $G$ and $(1-o(1))2^n$ for graphs with chromatic number at least 3. We also obtain results on the order of magnitude of $2^{n-1}-vex(n,G)$ and $2^n-vex(n,G)$ in these two cases. In the case of bipartite $G$, we relate this problem to instances of the forbidden subposet problem.


title: CompeteSMoE -- Effective Training of Sparse Mixture of Experts via Competition

abstract: Sparse mixture of experts (SMoE) offers an appealing solution to scale up the model complexity beyond the mean of increasing the network's depth or width. However, effective training of SMoE has proven to be challenging due to the representation collapse issue, which causes parameter redundancy and limited representation potentials. In this work, we propose a competition mechanism to address this fundamental challenge of representation collapse. By routing inputs only to experts with the highest neural response, we show that, under mild assumptions, competition enjoys the same convergence rate as the optimal estimator. We further propose CompeteSMoE, an effective and efficient algorithm to train large language models by deploying a simple router that predicts the competition outcomes. Consequently, CompeteSMoE enjoys strong performance gains from the competition routing policy while having low computation overheads. Our extensive empirical evaluations on two transformer architectures and a wide range of tasks demonstrate the efficacy, robustness, and scalability of CompeteSMoE compared to state-of-the-art SMoE strategies.


title: Redefining Computing: Rise of ARM from consumer to Cloud for energy efficiency

abstract: Today, our lifestyle revolves around digital devices powered by microprocessors of different instruction set architectures (ISA). Among them, the most common are x86 and ARM, the brainpower of our computers and smartphones. Reduced instruction set computing (RISC) is the basis of ARM architecture, designed to offer greater energy efficiency. On the other hand, principles of complex instruction set computing (CISC) are utilized by x86 processors, which handle heavier computing tasks while being more power-hungry. The rise of smartphones over a decade has changed the laptop market. It also influenced customers towards ARM-based energy-efficient laptops. This transition in the computing segment is seen not only in consumers but also in commercial settings, especially data centers. Usually, data centers are designed to operate 24/7, where energy is a big concern. So, ARM chips have started making their way to cloud servers. This paper comprehensively analyzes and compares the ARM and x86 architectures to unravel the factors contributing to ARM's increasing dominance in the market. It also explores the impact of smartphones on the laptop market and assesses the significance of system-on-a-chip (SoC). Focusing on the proper utilization of energy and sustainability, our paper offers valuable insights into the growing trend of adopting ARM processors in the computing industry.


title: Description of $Z$ Boson Mass and $p_T$ Spectrum at LHC Using Leading-Order Event Generators at $\sqrt{s} = 13.6$ TeV

abstract: In this paper, we report a study of $Z$ boson kinematic distributions in the $Z$+ 1-jet events from proton-proton ($pp$) collisions at $\sqrt{s}$ = 13.6 TeV at the Large Hadron Collider (LHC) using Leading-Order (LO) event generators. Three LO event generators, namely Pythia8, Herwig7 and Sherpa2, are explored with the implementation of appropriate Parton Shower (PS) and Matrix Element (ME) corrections. The $Z$ boson is reconstructed from oppositely charged di-lepton pairs ($\mu^+\mu^-$ and $e^+e^-$), and the associate leading jet is reconstructed with the anti-$k_T$ algorithm with radius $r$=0.4. The di-lepton invariant mass, $M_{\ell^+\ell^-}$, and the transverse momentum of the reconstructed $Z$ boson, $p_{T}^Z$, distributions are extensively studied by comparing three of the Monte Carlo (MC) predictions. In addition to this, we also explore several other kinematic distributions associated with the candidate lepton and the jet to distinguish the modelling of the LO event generators in depth. Furthermore, various showering modules within these event generators are explored for $Z$ + 1-jet production. While the three of these MC frameworks reproduce the $Z$ + 1-jet kinematics similarly, certain discrepancies in their predictions are identified in some variables. We analyzed them using different statistical tests. The best match of the $p_{T}^Z$ spectra was found between the Pythia8 and Sherpa2 results.


title: A Unified Model for Bipolar Outflows from Young Stars: Kinematic and Mixing Structures in HH 30

abstract: The young stellar source HH 30 is a textbook example of an ionic optical jet originating from a disk in an edge-on system shown by the HST. It has a remnant envelope in $^{12}$CO observed by ALMA. The optical jet is characterized by its narrow appearance, large line width at the base, and high temperature inferred from line diagnostics. Three featured structures can be identified, most evident in the transverse position--velocity diagrams: an extremely--high-velocity (EHV) wide-angle wind component with large spectral widths in the optical, a very--low-velocity (VLV) ambient surrounding medium seen in $^{12}$CO, and a low-velocity (LV) region traced by $^{12}$CO nested both in velocity and location between the primary wind and ambient environment. A layered cavity with multiple shells forms nested morphological and kinematic structures around the optical jet. The atomic gas originating from the innermost region of the disk attains a sufficient temperature and ionization to emit brightly in forbidden lines as an optical jet. The wide-angle portion expands, forming a low-density cavity. The filamentary $^{12}$CO encompassing the wind cavity is mixed and advected inward through the action of the magnetic interplay of the wide-angle wind with the molecular ambient medium. The magnetic interplay results in the layered shells penetrating deeply into the vast cavity of tenuous atomic wind material. The HH 30 system is an ideal manifestation of the unified wind model of \citet{Shang_2020,Shang_2023}, with clearly distinguishable atomic and molecular species mixed through the atomic lightly ionized magnetized wind and the surrounding cold molecular ambient material.


title: Polyhedral bounds on the joint spectrum and temperedness of locally symmetric spaces

abstract: Given a real semisimple connected Lie group $G$ and a discrete torsion-free subgroup $\Gamma < G$ we prove a precise connection between growth rates of the group $\Gamma$, polyhedral bounds on the joint spectrum of the ring of invariant differential operators, and the decay of matrix coefficients. In particular, this allows us to completely characterize temperedness of $L^2(\Gamma\backslash G)$ in this general setting.


title: Non-existence of classical solutions to a two-phase flow model with vacuum

abstract: In this paper, we study the well-posedness of classical solutions to a two-phase flow model consisting of the pressureless Euler equations coupled with the isentropic compressible Navier-Stokes equations via a drag forcing term. We consider the case that the fluid densities may contain a vacuum, and the viscosities are density-dependent functions. Under suitable assumptions on the initial data, we show that the finite-energy (i.e., in the inhomogeneous Sobolev space) classical solutions to the Cauchy problem of this coupled system do not exist for any small time.


title: Common behavior of the scaled condensation energy for both high-$T_c$ and conventional superconductors

abstract: We analyze the scaling of the condensation energy $E_{\Delta}$ divided by $\gamma$, $E_{\Delta}/\gamma\simeq N(0)\Delta_1^2/\gamma$, of both conventional superconductors and unconventional high-$T_c$ one, where $N(0)$ is the density of states, $\Delta_1$ is the maximum value of the superconducting gap and $\gamma$ is the Sommerfeld coefficient. For the first time, we show that the universal scaling of $E_{\Delta}/\gamma\propto T_c^2$ applies equally to conventional superconductors and unconventional high-$T_c$ ones. Our consideration is based on both facts: Bogoliubov quasiparticles act in conventional and unconventional superconductors, and the corresponding flat band is deformed by the unconventional superconducting state. As a result, our theoretical observations based on the fermion condensation theory are in good agreement with experimental facts.


title: Identifying and Extracting Pedestrian Behavior in Critical Traffic Situations

abstract: A better understanding of interactive pedestrian behavior in critical traffic situations is essential for the development of enhanced pedestrian safety systems. Real-world traffic observations play a decisive role in this, since they represent behavior in an unbiased way. In this work, we present an approach of how a subset of very considerable pedestrian-vehicle interactions can be derived from a camera-based observation system. For this purpose, we have examined road user trajectories automatically for establishing temporal and spatial relationships, using 110h hours of video recordings. In order to identify critical interactions, our approach combines the metric post-encroachment time with a newly introduced motion adaption metric. From more than 11,000 reconstructed pedestrian trajectories, 259 potential scenarios remained, using a post-encroachment time threshold of 2s. However, in 95% of cases, no adaptation of the pedestrian behavior was observed due to avoiding criticality. Applying the proposed motion adaption metric, only 21 critical scenarios remained. Manual investigations revealed that critical pedestrian vehicle interactions were present in 7 of those. They were further analyzed and made publicly available for developing pedestrian behavior models3. The results indicate that critical interactions in which the pedestrian perceives and reacts to the vehicle at a relatively late stage can be extracted using the proposed method.


title: Black holes and regular black holes in coincident $f(\mathbb{Q},\mathbb{B}_Q)$ gravity coupled to nonlinear electrodynamics

abstract: In this work, we consider an extension of the symmetric teleparallel equivalent of General Relativity (STEGR), namely, $f(\mathbb{Q})$ gravity, by including a boundary term $\mathbb{B}_Q$, where $\mathbb{Q}$ is the non-metricity scalar. More specifically, we explore static and spherically symmetric black hole and regular black hole solutions in $f(\mathbb{Q},\mathbb{B}_Q)$ gravity coupled to nonlinear electrodynamics (NLED). In particular, to obtain black hole solutions, and in order to ensure that our solutions preserve Lorentz symmetry, we assume the following relation $f_Q = -f_B$, where $f_{Q}=\partial f/\partial\mathbb{Q}$ and $f_{B}= \partial f/\partial\mathbb{B}_Q$. We develop three models of black holes, and as the starting point for each case we consider the non-metricity scalar or the boundary term in such a way to obtain the metric functions $A(r)$. Additionally, we are able to express matter through analytical solutions for specific NLED Lagrangians ${\cal L}_{\rm NLED}(F)$. Furthermore, we also obtain generalized solutions of the Bardeen and Culetu types of regular black holes, by imposing specific metric functions.


title: Data-driven Policy Learning for a Continuous Treatment

abstract: This paper studies policy learning under the condition of unconfoundedness with a continuous treatment variable. Our research begins by employing kernel-based inverse propensity-weighted (IPW) methods to estimate policy welfare. We aim to approximate the optimal policy within a global policy class characterized by infinite Vapnik-Chervonenkis (VC) dimension. This is achieved through the utilization of a sequence of sieve policy classes, each with finite VC dimension. Preliminary analysis reveals that welfare regret comprises of three components: global welfare deficiency, variance, and bias. This leads to the necessity of simultaneously selecting the optimal bandwidth for estimation and the optimal policy class for welfare approximation. To tackle this challenge, we introduce a semi-data-driven strategy that employs penalization techniques. This approach yields oracle inequalities that adeptly balance the three components of welfare regret without prior knowledge of the welfare deficiency. By utilizing precise maximal and concentration inequalities, we derive sharper regret bounds than those currently available in the literature. In instances where the propensity score is unknown, we adopt the doubly robust (DR) moment condition tailored to the continuous treatment setting. In alignment with the binary-treatment case, the DR welfare regret closely parallels the IPW welfare regret, given the fast convergence of nuisance estimators.


title: Periodic points of mappings contracting total pairwise distance

abstract: We consider a new type of mappings in metric spaces so-called mappings contracting total pairwise distance on $n$ points. It is shown that such mappings are continuous. A theorem on the existence of periodic points for such mappings is proved and the classical Banach fixed-point theorem is obtained like a simple corollary as well as the fixed-point theorem for mappings contracting perimeters of triangles. Examples of mappings contracting total pairwise distance on $n$ points and having different properties are constructed.


title: Bott-Chern formality and Massey products on strong K\"ahler with torsion and K\"ahler solvmanifolds

abstract: We study the interplay between geometrically-Bott-Chern-formal metrics and SKT metrics. We prove that a $6$-dimensional nilmanifold endowed with a invariant complex structure admits an SKT metric if and only if it is geometrically-Bott-Chern-formal. We also provide some partial results in higher dimensions for nilmanifolds endowed with a class of suitable complex structures. Furthermore, we prove that any K\"ahler solvmanifold is geometrically formal. Finally, we explicitly construct lattices for a complex solvable Lie group in the list of Nakamura [23] on which we provide a non vanishing quadruple $ABC$-Massey product.


title: Vacillating parking functions

abstract: For any integers $1\leq k\leq n$, we introduce a new family of parking functions called $k$-vacillating parking functions of length $n$. The parking rule for $k$-vacillating parking functions allows a car with preference $p$ to park in the first available spot in encounters among the parking spots numbered $p$, $p-k$, and $p+k$ (in that order and if those spots exists). In this way, $k$-vacillating parking functions are a modification of Naples parking functions, which allow for backwards movement of a car, and of $\ell$-interval parking functions, which allow a car to park in its preference or up to $\ell$ spots in front of its preference. Among our results, we establish a combinatorial interpretation for the numerator of the $n$th convergent of the continued fraction of $\sqrt{2}$, as the number of non-decreasing $1$-vacillating parking functions of length~$n$. Our main result gives a product formula for the enumeration of $k$-vacillating parking functions of length $n$ based on the number of $1$-vacillating parking functions of smaller length. We also give closed formulas for the number of $k$-vacillating parking functions of length $n$ which are monotonically increasing or decreasing. We conclude with some directions for further research.


title: $a_0(1710)$-$f_0(1710)$ mixing effect in the $D_{s}^{+} \rightarrow K_S^{0} K_S^{0} \pi^{+}$ decay

abstract: With the measurements of the decay $D^+_s \rightarrow K^0_S K^0_S \pi^+$ by the BESIII Collaboration, we investigate this three-body weak decay via the chiral unitary approach for the final state interaction, where the resonances $S(980)$ and $S(1710)$ are dynamically reproduced with the interaction of eleven coupled channels, and the $W$-external and -internal emission mechanisms are considered at the quark level. Besides, we also take into account the contribution from the $P$-wave resonance $K^*(892)^+$ and make a combined fit of the $K^0_S K^0_S$ and $K^0_S \pi^+$ invariant mass spectra measured by the BESIII Collaboration. The fitted results show that the enhancement around 1.7 GeV in $K^0_S K^0_S$ mass spectrum is overlapped with two visible peaks, indicating the mixing signal originated from the resonances $a_0(1710)$ and $f_0(1710)$ due to their different poles (masses). Thus, the decay $D^+_s \rightarrow K^0_S K^0_S \pi^+$ is helpful to reveal their molecular nature with the mixing signal, which can be more precisely measured in the future.


title: Embedding Non-Distortive Cancelable Face Template Generation

abstract: Biometric authentication systems are crucial for security, but developing them involves various complexities, including privacy, security, and achieving high accuracy without directly storing pure biometric data in storage. We introduce an innovative image distortion technique that makes facial images unrecognizable to the eye but still identifiable by any custom embedding neural network model. Using the proposed approach, we test the reliability of biometric recognition networks by determining the maximum image distortion that does not change the predicted identity. Through experiments on MNIST and LFW datasets, we assess its effectiveness and compare it based on the traditional comparison metrics.


title: Knowledge Generation for Zero-shot Knowledge-based VQA

abstract: Previous solutions to knowledge-based visual question answering~(K-VQA) retrieve knowledge from external knowledge bases and use supervised learning to train the K-VQA model. Recently pre-trained LLMs have been used as both a knowledge source and a zero-shot QA model for K-VQA and demonstrated promising results. However, these recent methods do not explicitly show the knowledge needed to answer the questions and thus lack interpretability. Inspired by recent work on knowledge generation from LLMs for text-based QA, in this work we propose and test a similar knowledge-generation-based K-VQA method, which first generates knowledge from an LLM and then incorporates the generated knowledge for K-VQA in a zero-shot manner. We evaluate our method on two K-VQA benchmarks and found that our method performs better than previous zero-shot K-VQA methods and our generated knowledge is generally relevant and helpful.


title: Characterization of Visible Range Gain in Praseodymium Doped Fiber Amplifier

abstract: In the optical (380-700 nm) region, a simulation study was conducted to assess the low-signal gain, power conversion efficiency (PCE), and optical output power of a praseodymium-doped fiber optic amplifier (PDFA). The PDFA performance was assessed using the optimized Pr3+ fiber length, Pr3+ ion concentration, and pump power. Additionally, the effects of input signal voltage and amplifier gain on amplified spontaneous emission (ASE) were investigated. A lower peak signal of roughly 1 dB at 635 nm was obtained with a shorter 5 m Pr3 + doped fiber and a higher pump power of 300 mW. The impact of wavelength and pump power variations on the amplifier's optical output power's spontaneous enhanced emission (EEM) is examined. Finally, the ionic interaction (general-purpose conversion effect) in the low-power amplifier signal is analyzed by taking into account various values of the upconversion factor.


title: Safeguarding the Truth of High-Value Price Oracle Task: A Dynamically Adjusted Truth Discovery Method

abstract: In recent years, the Decentralized Finance (DeFi) market has witnessed numerous attacks on the price oracle, leading to substantial economic losses. Despite the advent of truth discovery methods opening up new avenues for oracle development, it falls short in addressing high-value attacks on price oracle tasks. Consequently, this paper introduces a dynamically adjusted truth discovery method safeguarding the truth of high-value price oracle tasks. In the truth aggregation stage, we enhance future considerations to improve the precision of aggregated truth. During the credibility update phase, credibility is dynamically assessed based on the task's value and the Cumulative Potential Economic Contribution (CPEC) of information sources. Experimental results demonstrate a significant reduction in data deviation by 65.8\% and potential economic loss by 66.5\%, compared to the baseline scheme, in the presence of high-value attacks.


title: LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model

abstract: The revolutionary capabilities of large language models (LLMs) have paved the way for multimodal large language models (MLLMs) and fostered diverse applications across various specialized domains. In the remote sensing (RS) field, however, the diverse geographical landscapes and varied objects in RS imagery are not adequately considered in recent MLLM endeavors. To bridge this gap, we construct a large-scale RS image-text dataset, LHRS-Align, and an informative RS-specific instruction dataset, LHRS-Instruct, leveraging the extensive volunteered geographic information (VGI) and globally available RS images. Building on this foundation, we introduce LHRS-Bot, an MLLM tailored for RS image understanding through a novel multi-level vision-language alignment strategy and a curriculum learning method. Additionally, we introduce LHRS-Bench, a benchmark for thoroughly evaluating MLLMs' abilities in RS image understanding. Comprehensive experiments demonstrate that LHRS-Bot exhibits a profound understanding of RS images and the ability to perform nuanced reasoning within the RS domain.


title: Classification of Tennis Actions Using Deep Learning

abstract: Recent advances of deep learning makes it possible to identify specific events in videos with greater precision. This has great relevance in sports like tennis in order to e.g., automatically collect game statistics, or replay actions of specific interest for game strategy or player improvements. In this paper, we investigate the potential and the challenges of using deep learning to classify tennis actions. Three models of different size, all based on the deep learning architecture SlowFast were trained and evaluated on the academic tennis dataset THETIS. The best models achieve a generalization accuracy of 74 %, demonstrating a good performance for tennis action classification. We provide an error analysis for the best model and pinpoint directions for improvement of tennis datasets in general. We discuss the limitations of the data set, general limitations of current publicly available tennis data-sets, and future steps needed to make progress.


title: Applications of the icosahedral equation for the Rogers-Ramanujan continued fraction

abstract: Let $R(q)$ denote the Rogers-Ramanujan continued fraction for $|q| < 1$. By applying the RootApproximant command in the Wolfram language to expressions involving the theta function $f(-q) := (q;q)_{\infty}$ given in modular relations due to Yi, this provides a systematic way of obtaining experimentally discovered evaluations for $R\big(e^{-\pi\sqrt{r}}\big)$, for $r \in \mathbb{Q}_{> 0}$. We succeed in applying this approach to obtain explicit closed forms, in terms of radicals over $\mathbb{Q}$, for the Rogers-Ramanujan continued fraction that have not previously been discovered or proved. We prove our closed forms using the icosahedral equation for $R$ together with closed forms for and modular relations associated with Ramanujan's $G$- and $g$-functions. An especially remarkable closed form that we introduce and prove is for $R\big( e^{-\pi \sqrt{48/5} } \big)$, in view of the computational difficulties surrounding the application of an order-25 modular relation in the evaluation of $G_{48/5}$.


title: Integration of cognitive tasks into artificial general intelligence test for large models

abstract: During the evolution of large models, performance evaluation is necessarily performed to assess their capabilities and ensure safety before practical application. However, current model evaluations mainly rely on specific tasks and datasets, lacking a united framework for assessing the multidimensional intelligence of large models. In this perspective, we advocate for a comprehensive framework of cognitive science-inspired artificial general intelligence (AGI) tests, aimed at fulfilling the testing needs of large models with enhanced capabilities. The cognitive science-inspired AGI tests encompass the full spectrum of intelligence facets, including crystallized intelligence, fluid intelligence, social intelligence, and embodied intelligence. To assess the multidimensional intelligence of large models, the AGI tests consist of a battery of well-designed cognitive tests adopted from human intelligence tests, and then naturally encapsulates into an immersive virtual community. We propose increasing the complexity of AGI testing tasks commensurate with advancements in large models and emphasizing the necessity for the interpretation of test results to avoid false negatives and false positives. We believe that cognitive science-inspired AGI tests will effectively guide the targeted improvement of large models in specific dimensions of intelligence and accelerate the integration of large models into human society.


title: "What's my model inside of?": Exploring the role of environments for grounded natural language understanding

abstract: In contrast to classical cognitive science which studied brains in isolation, ecological approaches focused on the role of the body and environment in shaping cognition. Similarly, in this thesis we adopt an ecological approach to grounded natural language understanding (NLU) research. Grounded language understanding studies language understanding systems situated in the context of events, actions and precepts in naturalistic/simulated virtual environments. Where classic research tends to focus on designing new models and optimization methods while treating environments as given, we explore the potential of environment design for improving data collection and model development. We developed novel training and annotation approaches for procedural text understanding based on text-based game environments. We also drew upon embodied cognitive linguistics literature to propose a roadmap for grounded NLP research, and to inform the development of a new benchmark for measuring the progress of large language models on challenging commonsense reasoning tasks. We leveraged the richer supervision provided by text-based game environments to develop Breakpoint Transformers, a novel approach to modeling intermediate semantic information in long narrative or procedural texts. Finally, we integrated theories on the role of environments in collective human intelligence to propose a design for AI-augmented "social thinking environments" for knowledge workers like scientists.


title: Are Large Language Models Table-based Fact-Checkers?

abstract: Table-based Fact Verification (TFV) aims to extract the entailment relation between statements and structured tables. Existing TFV methods based on small-scaled models suffer from insufficient labeled data and weak zero-shot ability. Recently, the appearance of Large Language Models (LLMs) has gained lots of attraction in research fields. They have shown powerful zero-shot and in-context learning abilities on several NLP tasks, but their potential on TFV is still unknown. In this work, we implement a preliminary study about whether LLMs are table-based fact-checkers. In detail, we design diverse prompts to explore how the in-context learning can help LLMs in TFV, i.e., zero-shot and few-shot TFV capability. Besides, we carefully design and construct TFV instructions to study the performance gain brought by the instruction tuning of LLMs. Experimental results demonstrate that LLMs can achieve acceptable results on zero-shot and few-shot TFV with prompt engineering, while instruction-tuning can stimulate the TFV capability significantly. We also make some valuable findings about the format of zero-shot prompts and the number of in-context examples. Finally, we analyze some possible directions to promote the accuracy of TFV via LLMs, which is beneficial to further research of table reasoning.


title: Compensation of the multipolar polarizability shift in optical lattice clocks

abstract: In neutral atom optical clocks, the higher-order atomic polarizability terms lead to the clock transition frequency shift which is motion-state dependent and nonlinear with the optical lattice depth. We propose to use an auxiliary optical lattice to compensate the influence of the E2-M1 differential polarizability or tune the associated coefficient to a favorable value. We show that by applying this method to Sr and Hg optical lattice clocks, the low or even sub-10-19 clock transition frequency uncertainty from the optical lattice becomes feasible. Finally, the proposed scheme is simple for experimental realization and can be implemented and tested in the existing setups.


title: Integrating DeepRL with Robust Low-Level Control in Robotic Manipulators for Non-Repetitive Reaching Tasks

abstract: In robotics, contemporary strategies are learning-based, characterized by a complex black-box nature and a lack of interpretability, which may pose challenges in ensuring stability and safety. To address these issues, we propose integrating a collision-free trajectory planner based on deep reinforcement learning (DRL) with a novel auto-tuning low-level control strategy, all while actively engaging in the learning phase through interactions with the environment. This approach circumvents the control performance and complexities associated with computations while addressing nonrepetitive reaching tasks in the presence of obstacles. First, a model-free DRL agent is employed to plan velocity-bounded motion for a manipulator with 'n' degrees of freedom (DoF), ensuring collision avoidance for the end-effector through joint-level reasoning. The generated reference motion is then input into a robust subsystem-based adaptive controller, which produces the necessary torques, while the cuckoo search optimization (CSO) algorithm enhances control gains to minimize the stabilization and tracking error in the steady state. This approach guarantees robustness and uniform exponential convergence in an unfamiliar environment, despite the presence of uncertainties and disturbances. Theoretical assertions are validated through the presentation of simulation outcomes.


title: Neur2BiLO: Neural Bilevel Optimization

abstract: Bilevel optimization deals with nested problems in which a leader takes the first decision to minimize their objective function while accounting for a follower's best-response reaction. Constrained bilevel problems with integer variables are particularly notorious for their hardness. While exact solvers have been proposed for mixed-integer linear bilevel optimization, they tend to scale poorly with problem size and are hard to generalize to the non-linear case. On the other hand, problem-specific algorithms (exact and heuristic) are limited in scope. Under a data-driven setting in which similar instances of a bilevel problem are solved routinely, our proposed framework, Neur2BiLO, embeds a neural network approximation of the leader's or follower's value function, trained via supervised regression, into an easy-to-solve mixed-integer program. Neur2BiLO serves as a heuristic that produces high-quality solutions extremely fast for the bilevel knapsack interdiction problem, the "critical node game" from network security, a donor-recipient healthcare problem, and discrete network design from transportation planning. These problems are diverse in that they have linear or non-linear objectives/constraints and integer or mixed-integer variables, making Neur2BiLO unique in its versatility.


title: Closed 4-braids and the Jones unknot conjecture

abstract: The Jones problem is a question whether there is a non-trivial knot with the trivial Jones polynomial in one variable $q$. The answer to this fundamental question is still unknown despite numerous attempts to explore it. In braid presentation the case of 4-strand braids is already open. S. Bigelow showed in 2000 that if the Burau representation for four-strand braids is unfaithful, then there is an infinite number of non-trivial knots with the trivial two-variable HOMFLY-PT polynomial and hence, with the trivial Jones polynomial, since it is obtained from the HOMFLY-PT polynomial by the specialisation of one of the variables $A=q^2$. In this paper, we study four-strand braids and ask whether there are non-trivial knots with the trivial Jones polynomial but a non-trivial HOMFLY-PT polynomial. We have discovered that there is a whole 1-parameter family, parameterised by the writhe number, of 2-variable polynomials that can be HOMFLY-PT polynomials of some knots. We explore various properties of the obtained hypothetical HOMFLY-PT polynomials and suggest several checks to test these formulas. A generalisation is also proposed for the case of a large number of strands.

categories: math.GT hep-th math-ph math.GR math.MP math.RT


title: DeSparsify: Adversarial Attack Against Token Sparsification Mechanisms in Vision Transformers

abstract: Vision transformers have contributed greatly to advancements in the computer vision domain, demonstrating state-of-the-art performance in diverse tasks (e.g., image classification, object detection). However, their high computational requirements grow quadratically with the number of tokens used. Token sparsification techniques have been proposed to address this issue. These techniques employ an input-dependent strategy, in which uninformative tokens are discarded from the computation pipeline, improving the model's efficiency. However, their dynamism and average-case assumption makes them vulnerable to a new threat vector - carefully crafted adversarial examples capable of fooling the sparsification mechanism, resulting in worst-case performance. In this paper, we present DeSparsify, an attack targeting the availability of vision transformers that use token sparsification mechanisms. The attack aims to exhaust the operating system's resources, while maintaining its stealthiness. Our evaluation demonstrates the attack's effectiveness on three token sparsification techniques and examines the attack's transferability between them and its effect on the GPU resources. To mitigate the impact of the attack, we propose various countermeasures.


title: Generalizable Entity Grounding via Assistance of Large Language Model

abstract: In this work, we propose a novel approach to densely ground visual entities from a long caption. We leverage a large multimodal model (LMM) to extract semantic nouns, a class-agnostic segmentation model to generate entity-level segmentation, and the proposed multi-modal feature fusion module to associate each semantic noun with its corresponding segmentation mask. Additionally, we introduce a strategy of encoding entity segmentation masks into a colormap, enabling the preservation of fine-grained predictions from features of high-resolution masks. This approach allows us to extract visual features from low-resolution images using the CLIP vision encoder in the LMM, which is more computationally efficient than existing approaches that use an additional encoder for high-resolution images. Our comprehensive experiments demonstrate the superiority of our method, outperforming state-of-the-art techniques on three tasks, including panoptic narrative grounding, referring expression segmentation, and panoptic segmentation.


title: A new approach for imprecise probabilities

abstract: This paper introduces a novel concept of interval probability measures that enables the representation of imprecise probabilities, or uncertainty, in a natural and coherent manner. Within an algebra of sets, we introduce a notion of weak complementation denoted as $\psi$. The interval probability measure of an event $H$ is defined with respect to the set of indecisive eventualities $(\psi(H))^c$, which is included in the standard complement $H^c$. We characterize a broad class of interval probability measures and define their properties. Additionally, we establish an updating rule with respect to $H$, incorporating concepts of statistical independence and dependence. The interval distribution of a random variable is formulated, and a corresponding definition of stochastic dominance between two random variables is introduced. As a byproduct, a formal solution to the century-old Keynes-Ramsey controversy is presented.


title: Analog model of Kerr black holes in scalar-tensor theories using binary Bose-Einstein condensates: Quasibound states and tachyonic instabilities

abstract: We propose an analog model of the Kerr black hole in scalar-tensor theories using 2-component Bose-Einstein Condensates. We focus on two types of gapped excitations induced by the modes of two-component condensates with a relative phase of $0$ and $\pi$, analogous to the massive scalar field with positive and negative mass squared, respectively. The inclusion of space-dependent Rabi coupling can induce an effective space-dependent mass term. We study superradiant instabilities resulting from the quasibound states corresponding to positive mass squared and the tachyonic instabilities arising from negative mass squared in both frequency and time domains. These instabilities resemble two possible mechanisms that make Kerr black holes unstable in scalar-tensor gravity with the presence of matter around the black hole. Our proposed analog gravity model could potentially be implemented in future experiments, drawing from the success of recent analog rotating black hole implementations.


title: Enhancing Robustness in Biomedical NLI Models: A Probing Approach for Clinical Trials

abstract: Large Language Models have revolutionized various fields and industries, such as Conversational AI, Content Generation, Information Retrieval, Business Intelligence, and Medical, to name a few. One major application in the field of medical is to analyze and investigate clinical trials for entailment tasks.However, It has been observed that Large Language Models are susceptible to shortcut learning, factual inconsistency, and performance degradation with little variation in context. Adversarial and robust testing is performed to ensure the integrity of models output. But, ambiguity still persists. In order to ensure the integrity of the reasoning performed and investigate the model has correct syntactic and semantic understanding probing is used. Here, I used mnestic probing to investigate the Sci-five model, trained on clinical trial. I investigated the model for feature learnt with respect to natural logic. To achieve the target, I trained task specific probes. Used these probes to investigate the final layers of trained model. Then, fine tuned the trained model using iterative null projection. The results shows that model accuracy improved. During experimentation, I observed that size of the probe has affect on the fine tuning process.


title: NavHint: Vision and Language Navigation Agent with a Hint Generator

abstract: Existing work on vision and language navigation mainly relies on navigation-related losses to establish the connection between vision and language modalities, neglecting aspects of helping the navigation agent build a deep understanding of the visual environment. In our work, we provide indirect supervision to the navigation agent through a hint generator that provides detailed visual descriptions. The hint generator assists the navigation agent in developing a global understanding of the visual environment. It directs the agent's attention toward related navigation details, including the relevant sub-instruction, potential challenges in recognition and ambiguities in grounding, and the targeted viewpoint description. To train the hint generator, we construct a synthetic dataset based on landmarks in the instructions and visible and distinctive objects in the visual environment. We evaluate our method on the R2R and R4R datasets and achieve state-of-the-art on several metrics. The experimental results demonstrate that generating hints not only enhances the navigation performance but also helps improve the interpretability of the agent's actions.


title: A Spectral Sequence for a Graded Linear Map

abstract: We apply the method of spectral sequences to study classical problems in analysis. We illustrate the method by finding polynomial vector fields that commute with a given polynomial vector field and finding integrals of polynomial Hamiltonian systems. For the later we describe the integrals for the Henon-Heiles Hamiltonian which arises in celestial mechanics. The unifying feature is that these problems seek elements in the kernel of a linear operator. The spectral sequence approach emphasizes the obstructions constructed from cokernel of the operator to finding elements in the kernel.


title: Foundation Model Makes Clustering A Better Initialization For Cold-Start Active Learning

abstract: Active learning selects the most informative samples from the unlabelled dataset to annotate in the context of a limited annotation budget. While numerous methods have been proposed for subsequent sample selection based on an initialized model, scant attention has been paid to the indispensable phase of active learning: selecting samples for model cold-start initialization. Most of the previous studies resort to random sampling or naive clustering. However, random sampling is prone to fluctuation, and naive clustering suffers from convergence speed, particularly when dealing with high-dimensional data such as imaging data. In this work, we propose to integrate foundation models with clustering methods to select samples for cold-start active learning initialization. Foundation models refer to those trained on massive datasets by the self-supervised paradigm and capable of generating informative and compacted embeddings for various downstream tasks. Leveraging these embeddings to replace raw features such as pixel values, clustering quickly converges and identifies better initial samples. For a comprehensive comparison, we included a classic ImageNet-supervised model to acquire embeddings. Experiments on two clinical tasks of image classification and segmentation demonstrated that foundation model-based clustering efficiently pinpointed informative initial samples, leading to models showcasing enhanced performance than the baseline methods. We envisage that this study provides an effective paradigm for future cold-start active learning.


title: Strong disorder and very strong disorder are equivalent for directed polymers

abstract: We show that if the normalized partition function $W^{\beta}_n$ of the directed polymer model on $\mathbb{Z}^d$ converges to zero, then it does so exponentially fast. This implies that there exists a critical temperature $\beta_c$ such that the renormalized partition function has a non-degenerate limit for all $\beta\in [0,\beta_c]$ -- weak disorder holds -- while for $\beta\in (\beta_c,\infty)$ it converges exponentially fast to zero -- very strong disorder holds. This solves a twenty-years-old conjecture formulated by Comets, Yoshida, Carmona and Hu. Our proof requires a technical assumption on the environment, namely, that it is bounded from above.


title: Synergy-of-Thoughts: Eliciting Efficient Reasoning in Hybrid Language Models

abstract: Large language models (LLMs) have shown impressive emergent abilities in a wide range of tasks, but still face challenges in handling complex reasoning problems. Previous works like chain-of-thought (CoT) and tree-of-thoughts (ToT) have predominately focused on enhancing accuracy, but overlook the rapidly increasing token cost, which could be particularly problematic for open-ended real-world tasks with huge solution spaces. Motivated by the dual process theory of human cognition, we propose "Synergy of Thoughts" (SoT) to unleash the synergistic potential of hybrid LLMs for efficient reasoning. By default, SoT uses smaller-scale language models to generate multiple low-cost reasoning thoughts, which resembles the parallel intuitions produced by System 1. If these intuitions exhibit conflicts, SoT will invoke the reflective reasoning of scaled-up language models to emulate the intervention of System 2, which will override the intuitive thoughts and rectify the reasoning process. This framework is model-agnostic and training-free, which can be flexibly implemented with various off-the-shelf LLMs. Experiments on six representative reasoning tasks show that SoT substantially reduces the token cost by 38.3%-75.1%, and simultaneously achieves state-of-the-art reasoning accuracy and solution diversity. Notably, the average token cost reduction on open-ended tasks reaches up to 69.1%. Code repo with all prompts will be released upon publication.


title: A Truly Joint Neural Architecture for Segmentation and Parsing

abstract: Contemporary multilingual dependency parsers can parse a diverse set of languages, but for Morphologically Rich Languages (MRLs), performance is attested to be lower than other languages. The key challenge is that, due to high morphological complexity and ambiguity of the space-delimited input tokens, the linguistic units that act as nodes in the tree are not known in advance. Pre-neural dependency parsers for MRLs subscribed to the joint morpho-syntactic hypothesis, stating that morphological segmentation and syntactic parsing should be solved jointly, rather than as a pipeline where segmentation precedes parsing. However, neural state-of-the-art parsers to date use a strict pipeline. In this paper we introduce a joint neural architecture where a lattice-based representation preserving all morphological ambiguity of the input is provided to an arc-factored model, which then solves the morphological segmentation and syntactic parsing tasks at once. Our experiments on Hebrew, a rich and highly ambiguous MRL, demonstrate state-of-the-art performance on parsing, tagging and segmentation of the Hebrew section of UD, using a single model. This proposed architecture is LLM-based and language agnostic, providing a solid foundation for MRLs to obtain further performance improvements and bridge the gap with other languages.


title: Spatially covariant gravity with nonmetricity

abstract: Scalar fields play an important role in constructing modified gravity theories. In the case of a single scalar field with timelike gradient, the corresponding Lagrangian in the unitary gauge takes the form of spatially covariant gravity (SCG), which is proved useful in analyzing and extending the generally covariant theories. In this work, we apply the SCG method to the scalar-nonmetricity theory, of which the Lagrangian is built of the nonmetricity tensor and a scalar field. We derive the 3+1 decomposition of the geometric quantities and especially covariant derivatives of the scalar field up to the third order in the presence of a nonvanishing nonmetricity tensor. By fixing the unitary gauge, the resulting Lagrangian takes the form of a SCG with nonmetricity, in which all the ingredients are spatial tensors. We then exhaust the scalar monomials of SCG with nonmetricity up to $d=3$ with $d$ the total number of derivatives. Since the disformation tensor plays as an auxiliary variable, we take the Lagrangian with $d=2$ as an example to show that after solving the disformation tensor, we can get an effective SCG theory for the metric variables but with modified coefficients. Our results provides a novel approach to extending the scalar-nonmetricity theory.


title: STAGE: Scalable and Traversability-Aware Graph based Exploration Planner for Dynamically Varying Environments

abstract: In this article, we propose a novel navigation framework that leverages a two layered graph representation of the environment for efficient large-scale exploration, while it integrates a novel uncertainty awareness scheme to handle dynamic scene changes in previously explored areas. The framework is structured around a novel goal oriented graph representation, that consists of, i) the local sub-graph and ii) the global graph layer respectively. The local sub-graphs encode local volumetric gain locations as frontiers, based on the direct pointcloud visibility, allowing fast graph building and path planning. Additionally, the global graph is build in an efficient way, using node-edge information exchange only on overlapping regions of sequential sub-graphs. Different from the state-of-the-art graph based exploration methods, the proposed approach efficiently re-uses sub-graphs built in previous iterations to construct the global navigation layer. Another merit of the proposed scheme is the ability to handle scene changes (e.g. blocked pathways), adaptively updating the obstructed part of the global graph from traversable to not-traversable. This operation involved oriented sample space of a path segment in the global graph layer, while removing the respective edges from connected nodes of the global graph in cases of obstructions. As such, the exploration behavior is directing the robot to follow another route in the global re-positioning phase through path-way updates in the global graph. Finally, we showcase the performance of the method both in simulation runs as well as deployed in real-world scene involving a legged robot carrying camera and lidar sensor.


title: First order complexity of finite random structures

abstract: For a sequence of random structures with $n$-element domains over a relational signature, we define its first order (FO) complexity as a certain subset in the Banach space $\ell^{\infty}/c_0$. The well-known FO zero-one law and FO convergence law correspond to FO complexities equal to $\{0,1\}$ and a subset of $\mathbb{R}$, respectively. We present a hierarchy of FO complexity classes, introduce a stochastic FO reduction that allows to transfer complexity results between different random structures, and deduce using this tool several new logical limit laws for binomial random structures. Finally, we introduce a conditional distribution on graphs, subject to a FO sentence $\varphi$, that generalises certain well-known random graph models, show instances of this distribution for every complexity class, and prove that the set of all $\varphi$ validating 0--1 law is not recursively enumerable.


title: The effect of ligands on the size distribution of copper nanoclusters: insights from molecular dynamics simulations

abstract: Controlling the size distribution in the nucleation of copper particles is crucial for achieving nanocrystals with desired physical and chemical properties. However, their synthesis involves a complex system of solvents, ligands, and copper precursors with intertwining effects on the size of the nanoclusters. We combine molecular dynamics simulations and DFT calculations to provide insight into the nucleation mechanism in the presence of a triphenylphosphite ligand. We identify the crucial role of the strength of the metal-phosphine bond in inhibiting the cluster's growth. We demonstrate computationally several practical routes to fine-tune the bond strength by modifying the side groups of the additive. Our work provides molecular insight into the complex nucleation process of protected copper nanocrystals, which can assist in controlling their size distribution and, eventually, their morphology.


title: On the Complexity of Finite-Sum Smooth Optimization under the Polyak-{\L}ojasiewicz Condition

abstract: This paper considers the optimization problem of the form $\min_{{\bf x}\in{\mathbb R}^d} f({\bf x})\triangleq \frac{1}{n}\sum_{i=1}^n f_i({\bf x})$, where $f(\cdot)$ satisfies the Polyak--{\L}ojasiewicz (PL) condition with parameter $\mu$ and $\{f_i(\cdot)\}_{i=1}^n$ is $L$-mean-squared smooth. We show that any gradient method requires at least $\Omega(n+\kappa\sqrt{n}\log(1/\epsilon))$ incremental first-order oracle (IFO) calls to find an $\epsilon$-suboptimal solution, where $\kappa\triangleq L/\mu$ is the condition number of the problem. This result nearly matches upper bounds of IFO complexity for best-known first-order methods. We also study the problem of minimizing the PL function in the distributed setting such that the individuals $f_1(\cdot),\dots,f_n(\cdot)$ are located on a connected network of $n$ agents. We provide lower bounds of $\Omega(\kappa/\sqrt{\gamma}\,\log(1/\epsilon))$, $\Omega((\kappa+\tau\kappa/\sqrt{\gamma}\,)\log(1/\epsilon))$ and $\Omega\big(n+\kappa\sqrt{n}\log(1/\epsilon)\big)$ for communication rounds, time cost and local first-order oracle calls respectively, where $\gamma\in(0,1]$ is the spectral gap of the mixing matrix associated with the network and~$\tau>0$ is the time cost of per communication round. Furthermore, we propose a decentralized first-order method that nearly matches above lower bounds in expectation.


title: Gazebo Plants: Simulating Plant-Robot Interaction with Cosserat Rods

abstract: Robotic harvesting has the potential to positively impact agricultural productivity, reduce costs, improve food quality, enhance sustainability, and to address labor shortage. In the rapidly advancing field of agricultural robotics, the necessity of training robots in a virtual environment has become essential. Generating training data to automatize the underlying computer vision tasks such as image segmentation, object detection and classification, also heavily relies on such virtual environments as synthetic data is often required to overcome the shortage and lack of variety of real data sets. However, physics engines commonly employed within the robotics community, such as ODE, Simbody, Bullet, and DART, primarily support motion and collision interaction of rigid bodies. This inherent limitation hinders experimentation and progress in handling non-rigid objects such as plants and crops. In this contribution, we present a plugin for the Gazebo simulation platform based on Cosserat rods to model plant motion. It enables the simulation of plants and their interaction with the environment. We demonstrate that, using our plugin, users can conduct harvesting simulations in Gazebo by simulating a robotic arm picking fruits and achieve results comparable to real-world experiments.


title: Simple Stochastic Stopping Games: A Generator and Benchmark Library

abstract: Simple Stochastic Games (SSGs) were introduced by Anne Condon in 1990, as the simplest version of Stochastic Games for which there is no known polynomial-time algorithm. Condon showed that Stochastic Games are polynomial-time reducible to SSGs, which in turn are polynomial-time reducible to Stopping Games. SSGs are games where all decisions are binary and every move has a random outcome with a known probability distribution. Stopping Games are SSGs that are guaranteed to terminate. There are many algorithms for SSGs, most of which are fast in practice, but they all lack theoretical guarantees for polynomial-time convergence. The pursuit of a polynomial-time algorithm for SSGs is an active area of research. This paper is intended to support such research by making it easier to study the graphical structure of SSGs. Our contributions are: (1) a generating algorithm for Stopping Games, (2) a proof that the algorithm can generate any game, (3) a list of additional polynomial-time reductions that can be made to Stopping Games, (4) an open source generator for generating fully reduced instances of Stopping Games that comes with instructions and is fully documented, (5) a benchmark set of such instances, (6) and an analysis of how two main algorithm types perform on our benchmark set.


title: A Quantitative Discourse Analysis of Asian Workers in the US Historical Newspapers

abstract: Warning: This paper contains examples of offensive language targetting marginalized population. The digitization of historical texts invites researchers to explore the large-scale corpus of historical texts with computational methods. In this study, we present computational text analysis on a relatively understudied topic of how Asian workers are represented in historical newspapers in the United States. We found that the word "coolie" was semantically different in some States (e.g., Massachusetts, Rhode Island, Wyoming, Oklahoma, and Arkansas) with the different discourses around coolie. We also found that then-Confederate newspapers and then-Union newspapers formed distinctive discourses by measuring over-represented words. Newspapers from then-Confederate States associated coolie with slavery-related words. In addition, we found Asians were perceived to be inferior to European immigrants and subjected to the target of racism. This study contributes to supplementing the qualitative analysis of racism in the United States with quantitative discourse analysis.


title: Multi-Dimensional Cohomological Phenomena in the Multiparametric Models of Random Simplicial Complexes

abstract: In the past two decades, extensive research has been conducted on the (co)homology of various models of random simplicial complexes. So far, it has always been examined merely as a list of groups. This paper expands upon this by describing both the ring structure and the Steenrod-algebra structure of the cohomology of the multiparametric models. For the lower model, we prove that the ring structure is always a.a.s trivial, while, for certain parameters, the Steenrod-algebra a.a.s acts non-trivially. This reveals that complex multi-dimensional topological structures appear as subcomplexes of this model. In contrast, we improve upon a result of Farber and Nowik, and assert that the cohomology of the upper multiparametric model is a.a.s concentrated in a single dimension.


title: Spatio-temporal Prompting Network for Robust Video Feature Extraction

abstract: Frame quality deterioration is one of the main challenges in the field of video understanding. To compensate for the information loss caused by deteriorated frames, recent approaches exploit transformer-based integration modules to obtain spatio-temporal information. However, these integration modules are heavy and complex. Furthermore, each integration module is specifically tailored for its target task, making it difficult to generalise to multiple tasks. In this paper, we present a neat and unified framework, called Spatio-Temporal Prompting Network (STPN). It can efficiently extract robust and accurate video features by dynamically adjusting the input features in the backbone network. Specifically, STPN predicts several video prompts containing spatio-temporal information of neighbour frames. Then, these video prompts are prepended to the patch embeddings of the current frame as the updated input for video feature extraction. Moreover, STPN is easy to generalise to various video tasks because it does not contain task-specific modules. Without bells and whistles, STPN achieves state-of-the-art performance on three widely-used datasets for different video understanding tasks, i.e., ImageNetVID for video object detection, YouTubeVIS for video instance segmentation, and GOT-10k for visual object tracking. Code is available at https://github.com/guanxiongsun/vfe.pytorch.


title: Factor of iid colorings of trees

abstract: We show that, for every $\epsilon>0$, the 4-regular tree has an fiid 4-coloring where a given vertex is assigned the 4th color with probability at most $\epsilon$. We also construct 5-colorings of $T_6$ improving known bounds on the measurable and approximate chromatic number of $F_3$.


title: Exploring the Design Space for Message-Driven Systems for Dynamic Graph Processing using CCA

abstract: Computer systems that have been successfully deployed for dense regular workloads fall short of achieving scalability and efficiency when applied to irregular and dynamic graph applications. Conventional computing systems rely heavily on static, regular, numeric intensive computations while High Performance Computing systems executing parallel graph applications exhibit little locality, spatial or temporal, and are fine-grained and memory intensive. With the strong interest in AI which depend on these very different use cases combined with the end of Moore's Law at nanoscale, dramatic alternatives in architecture and underlying execution models are required. This paper identifies an innovative non-von Neumann architecture, Continuum Computer Architecture (CCA), that redefines the nature of computing structures to yield powerful innovations in computational methods to deliver a new generation of highly parallel hardware architecture. CCA reflects a genus of highly parallel architectures that while varying in specific quantities (e.g., memory blocks), share a multiple of attributes not found in typical von Neumann machines. Among these are memory-centric components, message-driven asynchronous flow control, and lightweight out-of-order execution across a global name space. Together these innovative non-von Neumann architectural properties guided by a new original execution model will deliver the new future path for extending beyond the von Neumann model. This paper documents a series of interrelated experiments that together establish future directions for next generation non-von Neumann architectures, especially for graph processing.


title: Anomalous $U(1)$ extension of the Standard Model

abstract: We present a set of example models in which the Standard Model (SM) symmetry group is extended by a new abelian symmetry. This additional symmetry appears anomalous in the effective low-energy theory; however, the anomalies cancel out when massive chiral fermions not present in the effective low-energy theory are taken into account. These chiral fermions under the new abelian gauge group, are chosen to be vector-like under the SM symmetries, and reside in the same representations as quarks and leptons. This allows us to quantitatively determine the magnitude of tree-level interactions between three vector bosons induced in low-energy effective field theory by the integration of chiral heavy fermions. We also examine the perturbativity constraints of the theory and the ultraviolet cut-off. We conclude by highlighting possible extensions of our work.


title: Impact of PSF misestimation and galaxy population bias on precision shear measurement using a CNN

abstract: Weak gravitational lensing of distant galaxies provides a powerful probe of dark energy. The aim of this study is to investigate the application of convolutional neural networks (CNNs) to precision shear estimation. In particular, using a shallow CNN, we explore the impact of point spread function (PSF) misestimation and `galaxy population bias' (including `distribution bias' and `morphology bias'), focusing on the accuracy requirements of next generation surveys. We simulate a population of noisy disk and elliptical galaxies and adopt a PSF that is representative of a Euclid-like survey. We quantify the accuracy achieved by the CNN assuming a linear relationship between the estimated and true shears and measure the multiplicative ($m$) and additive ($c$) biases. We make use of an unconventional loss function to mitigate the effects of noise bias and measure $m$ and $c$ when we use either: (i) an incorrect galaxy ellipticity distribution or size-magnitude relation, or the wrong ratio of morphological types, to describe the population of galaxies (distribution bias); (ii) an incorrect galaxy light profile (morphology bias); or (iii) a PSF with size or ellipticity offset from its true value (PSF misestimation). We compare our results to the Euclid requirements on the knowledge of the PSF model shape and size. Finally, we outline further work to build on the promising potential of CNNs in precision shear estimation.


title: Limiting behavior of a kindness model

abstract: This paper is concerned with a stochastic model for the spread of kindness across a social network. Individuals are located on the vertices of a general finite connected graph, and are characterized by their kindness belief. Each individual, say $x$, interacts with each of its neighbors, say $y$, at rate one. The interactions can be kind or unkind, with kind interactions being more likely when the kindness belief of the sender $x$ is high. In addition, kind interactions increase the kindness belief of the recipient $y$, whereas unkind interactions decrease its kindness belief. The system also depends on two parameters modeling the impact of kind and unkind interactions, respectively. We prove that, when kind interactions have a larger impact than unkind interactions, the system converges to the purely kind configuration with probability tending to one exponentially fast in the large population limit.


title: Search for a heavy neutral lepton that mixes predominantly with the tau neutrino

abstract: We report a search for a heavy neutral lepton (HNL) that mixes predominantly with $\nu_\tau$. The search utilizes data collected with the Belle detector at the KEKB asymmetric energy $e^+ e^-$ collider. The data sample was collected at and just below the center-of-mass energies of the $\Upsilon(4S)$ and $\Upsilon(5S)$ resonances and has an integrated luminosity of $915~\textrm{fb}^{-1}$, corresponding to $(836\pm 12)\times 10^6$ $e^+e^\to\tau^+\tau^-$ events. We search for production of the HNL (denoted $N$) in the decay $\tau^-\to \pi^- N$ followed by its decay via $N \to \mu^+\mu^- \nu_\tau$. The search focuses on the parameter-space region in which the HNL is long lived, so that the $\mu^+\mu^-$ originate from a common vertex that is significantly displaced from the collision point of the KEKB beams. Consistent with the expected background yield, one event is observed in the data sample after application of all the event-selection criteria. We report limits on the mixing parameter of the HNL with the $\tau$ neutrino as a function of the HNL mass.


title: Non-Fermi Liquid and Hund Correlation in La$_4$Ni$_3$O$_{10}$ under High Pressure

abstract: High temperature superconductivity was recently found in the bilayer nickelate $\rm{La}_3 \rm{Ni}_2 \rm{O}_7$ (La327), followed by the discovery of superconductivity in the trilayer $\rm{La}_4 \rm{Ni}_3 \rm{O}_{10}$ (La4310), under high pressure. Through studying the electronic correlation of La4310 with DFT+DMFT, and further comparing it with that of La327, we find that the $e_g$ orbitals of the outer-layer Ni cations in La4310 have a similar (but slightly weaker) electronic correlation to those in La327, in which the electrons behave as a non-Fermi liquid with Hund correlation and linear-in-temperature scattering rate. Our results suggest that the experimentally observed ``strange metal'' behavior may be explained by the Hund spin correlation featuring high spin states and spin-orbital separation. In contrast, the electrons in the inner-layer Ni cations in La4310 behave as a Fermi liquid. The weaker electronic correlation in La4310 is attributed to more hole-doping, which may explain its lower superconducting transition temperature.


title: On the development of an application for the compilation of global sea level changes

abstract: There is a lot of data about mean sea level variation from studies conducted around the globe. This data is dispersed, lacks organization along with standardization, and in most cases, it is not available online. In some instances, when it is available, it is often in unpractical ways and different formats. Analyzing it would be inefficient and very time-consuming. In addition to all of that, to successfully process spatial-temporal data, the user has to be equipped with particular skills and tools used for geographic data like PostGIS, PostgreSQL and GeoAlchemy. The presented solution is to develop a web application that solves some of the issues faced by researchers. The web application allows the user to add data, be it through forms in a browser or automated with the help of an API. The application also assists with data querying, processing and visualization by making tables, showing maps and drawing graphs. Comparing data points from different areas and publications is also made possible. The implemented web application permits the query and storage of spatial-temporal data about mean sea level variation in a simplified, easily accessible and user-friendly manner. It will also allow the realization of more global studies.


title: DiffEditor: Boosting Accuracy and Flexibility on Diffusion-based Image Editing

abstract: Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing remains challenging. In this paper, we propose DiffEditor to rectify two weaknesses in existing diffusion-based image editing: (1) in complex scenarios, editing results often lack editing accuracy and exhibit unexpected artifacts; (2) lack of flexibility to harmonize editing operations, e.g., imagine new content. In our solution, we introduce image prompts in fine-grained image editing, cooperating with the text prompt to better describe the editing content. To increase the flexibility while maintaining content consistency, we locally combine stochastic differential equation (SDE) into the ordinary differential equation (ODE) sampling. In addition, we incorporate regional score-based gradient guidance and a time travel strategy into the diffusion sampling, further improving the editing quality. Extensive experiments demonstrate that our method can efficiently achieve state-of-the-art performance on various fine-grained image editing tasks, including editing within a single image (e.g., object moving, resizing, and content dragging) and across images (e.g., appearance replacing and object pasting). Our source code is released at https://github.com/MC-E/DragonDiffusion.


title: SYK Correlators from 2D Liouville-de Sitter Gravity

abstract: We introduce and study a candidate gravity dual to the double scaled SYK model in the form of an exactly soluble 2D de Sitter gravity model consisting of two spacelike Liouville CFTs with complex central charge adding up to $c_+ + c_- = 26$. In [1] it was shown that the two-point function of physical operators in a doubled SYK model matches in the semi-classical limit with the Green's function of a massive scalar field in 3D de Sitter space. As further evidence of the duality, we adapt a result from Zamolodchikov to compute the boundary two-point function of the 2D Liouville-de Sitter gravity model on a disk and find that it reproduces the exact DSSYK two-point function to all orders in $\lambda=p^2/N$. We describe how the 2D Liouville-de Sitter gravity model arises from quantizing 3D de Sitter gravity.


title: Grover-QAOA for 3-SAT: Quadratic Speedup, Fair-Sampling, and Parameter Clustering

abstract: The SAT problem is a prototypical NP-complete problem of fundamental importance in computational complexity theory with many applications in science and engineering; as such, it has long served as an essential benchmark for classical and quantum algorithms. This study shows numerical evidence for a quadratic speedup of the Grover Quantum Approximate Optimization Algorithm (G-QAOA) over random sampling for finding all solutions to 3-SAT problems (All-SAT). G-QAOA is less resource-intensive and more adaptable for 3-SAT and Max-SAT than Grover's algorithm, and it surpasses conventional QAOA in its ability to sample all solutions. We show these benefits by classical simulations of many-round G-QAOA on thousands of random 3-SAT instances. We also observe G-QAOA advantages on the IonQ Aria quantum computer for small instances, finding that current hardware suffices to determine and sample all solutions. Interestingly, a single-angle-pair constraint that uses the same pair of angles at each G-QAOA round greatly reduces the classical computational overhead of optimizing the G-QAOA angles while preserving its quadratic speedup. We also find parameter clustering of the angles. The single-angle-pair protocol and parameter clustering significantly reduce obstacles to classical optimization of the G-QAOA angles.


title: ClipFormer: Key-Value Clipping of Transformers on Memristive Crossbars for Write Noise Mitigation

abstract: Transformers have revolutionized various real-world applications from natural language processing to computer vision. However, traditional von-Neumann computing paradigm faces memory and bandwidth limitations in accelerating transformers owing to their massive model sizes. To this end, In-memory Computing (IMC) crossbars based on Non-volatile Memories (NVMs), due to their ability to perform highly parallelized Matrix-Vector-Multiplications (MVMs) with high energy-efficiencies, have emerged as a promising solution for accelerating transformers. However, analog MVM operations in crossbars introduce non-idealities, such as stochastic read & write noise, which affect the inference accuracy of the deployed transformers. Specifically, we find pre-trained Vision Transformers (ViTs) to be vulnerable on crossbars due to the impact of write noise on the dynamically-generated Key (K) and Value (V) matrices in the attention layers, an effect not accounted for in prior studies. We, thus, propose ClipFormer, a transformation on the K and V matrices during inference, to boost the non-ideal accuracies of pre-trained ViT models. ClipFormer requires no additional hardware and training overhead and is amenable to transformers deployed on any memristive crossbar platform. Our experiments on Imagenet-1k dataset using pre-trained DeiT-S transformers, subjected to standard training and variation-aware-training, show >10-40% higher non-ideal accuracies at the high write noise regime by applying ClipFormer.


title: Quantum scalar fields interacting with quantum black hole asymptotic regions

abstract: We continue our work on the study of spherically symmetric loop quantum gravity coupled to two spherically symmetric scalar fields, one that acts as a clock. As a consequence of the presence of the latter, we can define a true Hamiltonian for the theory. In previous papers we have studied the theory for large values of the radial coordinate, that is, far away from any black hole or star that may be present. This makes the calculations considerably more tractable. We have shown that in the asymptotic region the theory admits a large family of quantum vacua for quantum matter fields coupled to quantum gravity, as is expected from the well-known results of quantum field theory on classical curved space-time. Here, we study perturbative corrections involving terms that we neglected in our previous work. Using time-dependent perturbation theory, we show that the states that represent different possible vacua are essentially stable. This ensures that one recovers from a totally quantized gravitational theory coupled to matter the standard behavior of a matter quantum field theory plus low probability transitions due to gravity between particles that differ at most by a small amount of energy.


title: Controller Synthesis from Noisy-Input Noisy-Output Data

abstract: We consider the problem of synthesizing a dynamic output-feedback controller for a linear system, using solely input-output data corrupted by measurement noise. To handle input-output data, an auxiliary representation of the original system is introduced. By exploiting the structure of the auxiliary system, we design a controller that robustly stabilizes all possible systems consistent with data. Notably, we also provide a novel solution to extend the results to generic multi-input multi-output systems. The findings are illustrated by numerical examples.


title: Prospective Prediction of Body Mass Index Trajectories using Multi-task Gaussian Processes

abstract: Clinicians often investigate the body mass index (BMI) trajectories of children to assess their growth with respect to their peers, as well as to anticipate future growth and disease risk. While retrospective modelling of BMI trajectories has been an active area of research, prospective prediction of continuous BMI trajectories from historical growth data has not been well investigated. Using weight and height measurements from birth to age 10 years from a longitudinal mother-offspring cohort, we leveraged a multi-task Gaussian processes model, called MagmaClust, to derive probabilistic predictions for BMI trajectories over various forecasting periods. Experiments were conducted to evaluate the accuracy, sensitivity to missing values, and number of clusters. The results were compared with cubic B-spline regression and a parametric Jenss-Bayley mixed effects model. A downstream tool computing individual overweight probabilities was also proposed and evaluated. In all experiments, MagmaClust outperformed conventional models in prediction accuracy while correctly calibrating uncertainty regardless of the missing data amount (up to 90\% missing) or the forecasting period (from 2 to 8 years in the future). Moreover, the overweight probabilities computed from MagmaClust's uncertainty quantification exhibited high specificity ($0.94$ to $0.96$) and accuracy ($0.86$ to $0.94$) in predicting the 10-year overweight status even from age 2 years. MagmaClust provides a probabilistic non-parametric framework to prospectively predict BMI trajectories, which is robust to missing values and outperforms conventional BMI trajectory modelling approaches. It also clusters individuals to identify typical BMI patterns (early peak, adiposity rebounds) during childhood. Overall, we demonstrated its potential to anticipate BMI evolution throughout childhood, allowing clinicians to implement prevention strategies.


title: $R(K_6-e, K_4) = 30$

abstract: We settle the Ramsey problem $R(K_6 - e, K_4)$, also known as $R(J_6, K_4)$ and $R(K_6^-, K_4)$. Previously, the best bounds were $30 \leq R(K_6 - e, K4) \leq 32$. We prove that $R(K_6 - e, K_4) = 30$. Our technique is based on the recent approach of Angeltveit and McKay and on older algorithms of McKay and Radziszowski.


title: On the performance of phonetic algorithms in microtext normalization

abstract: User-generated content published on microblogging social networks constitutes a priceless source of information. However, microtexts usually deviate from the standard lexical and grammatical rules of the language, thus making its processing by traditional intelligent systems very difficult. As an answer, microtext normalization consists in transforming those non-standard microtexts into standard well-written texts as a preprocessing step, allowing traditional approaches to continue with their usual processing. Given the importance of phonetic phenomena in non-standard text formation, an essential element of the knowledge base of a normalizer would be the phonetic rules that encode these phenomena, which can be found in the so-called phonetic algorithms. In this work we experiment with a wide range of phonetic algorithms for the English language. The aim of this study is to determine the best phonetic algorithms within the context of candidate generation for microtext normalization. In other words, we intend to find those algorithms that taking as input non-standard terms to be normalized allow us to obtain as output the smallest possible sets of normalization candidates which still contain the corresponding target standard words. As it will be stated, the choice of the phonetic algorithm will depend heavily on the capabilities of the candidate selection mechanism which we usually find at the end of a microtext normalization pipeline. The faster it can make the right choices among big enough sets of candidates, the more we can sacrifice on the precision of the phonetic algorithms in favour of coverage in order to increase the overall performance of the normalization system. KEYWORDS: microtext normalization; phonetic algorithm; fuzzy matching; Twitter; texting


title: Unified Training of Universal Time Series Forecasting Transformers

abstract: Deep learning for time series forecasting has traditionally operated within a one-model-per-dataset framework, limiting its potential to leverage the game-changing impact of large pre-trained models. The concept of universal forecasting, emerging from pre-training on a vast collection of time series datasets, envisions a single Large Time Series Model capable of addressing diverse downstream forecasting tasks. However, constructing such a model poses unique challenges specific to time series data: i) cross-frequency learning, ii) accommodating an arbitrary number of variates for multivariate time series, and iii) addressing the varying distributional properties inherent in large-scale data. To address these challenges, we present novel enhancements to the conventional time series Transformer architecture, resulting in our proposed Masked Encoder-based Universal Time Series Forecasting Transformer (Moirai). Trained on our newly introduced Large-scale Open Time Series Archive (LOTSA) featuring over 27B observations across nine domains, Moirai achieves competitive or superior performance as a zero-shot forecaster when compared to full-shot models. Code, data, and model weights can be found at https://github.com/SalesforceAIResearch/uni2ts.


title: Leveraging Continuously Differentiable Activation Functions for Learning in Quantized Noisy Environments

abstract: Real-world analog systems intrinsically suffer from noise that can impede model convergence and accuracy on a variety of deep learning models. We demonstrate that differentiable activations like GELU and SiLU enable robust propagation of gradients which help to mitigate analog quantization error that is ubiquitous to all analog systems. We perform analysis and training of convolutional, linear, and transformer networks in the presence of quantized noise. Here, we are able to demonstrate that continuously differentiable activation functions are significantly more noise resilient over conventional rectified activations. As in the case of ReLU, the error in gradients are 100x higher than those in GELU near zero. Our findings provide guidance for selecting appropriate activations to realize performant and reliable hardware implementations across several machine learning domains such as computer vision, signal processing, and beyond.


title: Gravitational Wave Displacement and Velocity Memory Effects

abstract: In this article, we compare in detail the linear and nonlinear approach to the Gravitational Waves Displacement and Velocity Memory (GWDM and GWVM) effects. We consider astrophysical situations that give rise to gravitational waves with GWVM effect, i.e. with a residual velocity (the so-called "velocity-coded memory") and discuss the possibility of future detection of the GWVM effect.


title: Operator Projective Line and Its Transformations

abstract: We introduce a concept of the operator (non-commutative) projective line PH defined by a Hilbert space H and a symplectic structure on it. Points of PH are Lagrangian subspaces of H. If a particular Lagrangian subspace is fixed then we can define SL(2,R)-action on PH. This gives a consistent framework for linear fractional transformations of operators. Some connections with spectral theory are outline as well.


title: Dual Interior-Point Optimization Learning

abstract: This paper introduces Dual Interior Point Learning (DIPL) and Dual Supergradient Learning (DSL) to learn dual feasible solutions to parametric linear programs with bounded variables, which are pervasive across many industries. DIPL mimics a novel dual interior point algorithm while DSL mimics classical dual supergradient ascent. DIPL and DSL ensure dual feasibility by predicting dual variables associated with the constraints then exploiting the flexibility of the duals of the bound constraints. DIPL and DSL complement existing primal learning methods by providing a certificate of quality. They are shown to produce high-fidelity dual-feasible solutions to large-scale optimal power flow problems providing valid dual bounds under 0.5% optimality gap.


title: Efficient simulation strategy for PCM-based cold-energy storage systems

abstract: This paper proposes a computationally efficient simulation strategy for cold thermal energy storage (TES) systems based on phase change material (PCM). Taking as a starting point the recent design of a TES system based on PCM, designed to complement a vapour-compression refrigeration plant, the new highly efficient modelling strategy is described and its performance is compared against the pre-existing one. The need for a new computationally efficient approach comes from the fact that, in the near future, such a TES model is intended to be used in combination with the model of the own mother refrigeration plant, in order to address efficient, long-term energy management strategies, where computation time will become a major issue. Comparative simulations show that the proposed computationally efficient strategy reduces the simulation time to a small fraction of the original figure (from around 1/30th till around 1/120th, depending on the particular choice of the main sampling interval), at the expense of affordable inaccuracy in terms of the PCM charge ratio.