title: 3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting

abstract: In this paper, we present an implicit surface reconstruction method with 3D Gaussian Splatting (3DGS), namely 3DGSR, that allows for accurate 3D reconstruction with intricate details while inheriting the high efficiency and rendering quality of 3DGS. The key insight is incorporating an implicit signed distance field (SDF) within 3D Gaussians to enable them to be aligned and jointly optimized. First, we introduce a differentiable SDF-to-opacity transformation function that converts SDF values into corresponding Gaussians' opacities. This function connects the SDF and 3D Gaussians, allowing for unified optimization and enforcing surface constraints on the 3D Gaussians. During learning, optimizing the 3D Gaussians provides supervisory signals for SDF learning, enabling the reconstruction of intricate details. However, this only provides sparse supervisory signals to the SDF at locations occupied by Gaussians, which is insufficient for learning a continuous SDF. Then, to address this limitation, we incorporate volumetric rendering and align the rendered geometric attributes (depth, normal) with those derived from 3D Gaussians. This consistency regularization introduces supervisory signals to locations not covered by discrete 3D Gaussians, effectively eliminating redundant surfaces outside the Gaussian sampling range. Our extensive experimental results demonstrate that our 3DGSR method enables high-quality 3D surface reconstruction while preserving the efficiency and rendering quality of 3DGS. Besides, our method competes favorably with leading surface reconstruction techniques while offering a more efficient learning process and much better rendering qualities. The code will be available at https://github.com/CVMI-Lab/3DGSR.


title: Constructing segments of quadratic length in $Spec(T_n)$ through segments of linear length

abstract: A Transposition graph $T_n$ is defined as a Cayley graph over the symmetric group $Sym_n$ generated by all transpositions. It is known that the spectrum of $T_n$ consists of integers, but it is not known exactly how these numbers are distributed. In this paper we prove that integers from the segment $[-n, n]$ lie in the spectrum of $T_n$ for any $n\geqslant 31$. Using this fact we also prove the main result of this paper that a segment of quadratic length with respect to $n$ lies in the spectrum of $T_n$.


title: Aardvark Weather: end-to-end data-driven weather forecasting

abstract: Machine learning is revolutionising medium-range weather prediction. However it has only been applied to specific and individual components of the weather prediction pipeline. Consequently these data-driven approaches are unable to be deployed without input from conventional operational numerical weather prediction (NWP) systems, which is computationally costly and does not support end-to-end optimisation. In this work, we take a radically different approach and replace the entire NWP pipeline with a machine learning model. We present Aardvark Weather, the first end-to-end data-driven forecasting system which takes raw observations as input and provides both global and local forecasts. These global forecasts are produced for 24 variables at multiple pressure levels at one-degree spatial resolution and 24 hour temporal resolution, and are skillful with respect to hourly climatology at five to seven day lead times. Local forecasts are produced for temperature, mean sea level pressure, and wind speed at a geographically diverse set of weather stations, and are skillful with respect to an IFS-HRES interpolation baseline at multiple lead-times. Aardvark, by virtue of its simplicity and scalability, opens the door to a new paradigm for performing accurate and efficient data-driven medium-range weather forecasting.


title: SVGCraft: Beyond Single Object Text-to-SVG Synthesis with Comprehensive Canvas Layout

abstract: Generating VectorArt from text prompts is a challenging vision task, requiring diverse yet realistic depictions of the seen as well as unseen entities. However, existing research has been mostly limited to the generation of single objects, rather than comprehensive scenes comprising multiple elements. In response, this work introduces SVGCraft, a novel end-to-end framework for the creation of vector graphics depicting entire scenes from textual descriptions. Utilizing a pre-trained LLM for layout generation from text prompts, this framework introduces a technique for producing masked latents in specified bounding boxes for accurate object placement. It introduces a fusion mechanism for integrating attention maps and employs a diffusion U-Net for coherent composition, speeding up the drawing process. The resulting SVG is optimized using a pre-trained encoder and LPIPS loss with opacity modulation to maximize similarity. Additionally, this work explores the potential of primitive shapes in facilitating canvas completion in constrained environments. Through both qualitative and quantitative assessments, SVGCraft is demonstrated to surpass prior works in abstraction, recognizability, and detail, as evidenced by its performance metrics (CLIP-T: 0.4563, Cosine Similarity: 0.6342, Confusion: 0.66, Aesthetic: 6.7832). The code will be available at https://github.com/ayanban011/SVGCraft.


title: Language Models are Spacecraft Operators

abstract: Recent trends are emerging in the use of Large Language Models (LLMs) as autonomous agents that take actions based on the content of the user text prompts. We intend to apply these concepts to the field of Guidance, Navigation, and Control in space, enabling LLMs to have a significant role in the decision-making process for autonomous satellite operations. As a first step towards this goal, we have developed a pure LLM-based solution for the Kerbal Space Program Differential Games (KSPDG) challenge, a public software design competition where participants create autonomous agents for maneuvering satellites involved in non-cooperative space operations, running on the KSP game engine. Our approach leverages prompt engineering, few-shot prompting, and fine-tuning techniques to create an effective LLM-based agent that ranked 2nd in the competition. To the best of our knowledge, this work pioneers the integration of LLM agents into space research. Code is available at https://github.com/ARCLab-MIT/kspdg.


title: Chebyshev and The Fast Fourier Transform Methods for Signal Interpolation

abstract: Approximation theorem is one of the most important aspects of numerical analysis that has evolved over the years with many different approaches. Some of the most popular approximation methods include the Lebesgue approximation theorem, the Weierstrass approximation, and the Fourier approximation theorem. The limitations associated with various approximation methods are too crucial to ignore, and thus, the nature of a specific dataset may require using a specific approximation method for such estimates. In this report, we shall delve into Chebyshev's polynomials interpolation in detail as an alternative approach to reconstructing signals and compare the reconstruction to that of the Fourier polynomials. We will also explore the advantages and limitations of the Chebyshev polynomials and discuss in detail their mathematical formulation and equivalence to the cosine function over a given interval [a, b].


title: CoDa: Constrained Generation based Data Augmentation for Low-Resource NLP

abstract: We present CoDa (Constrained Generation based Data Augmentation), a controllable, effective, and training-free data augmentation technique for low-resource (data-scarce) NLP. Our approach is based on prompting off-the-shelf instruction-following Large Language Models (LLMs) for generating text that satisfies a set of constraints. Precisely, we extract a set of simple constraints from every instance in the low-resource dataset and verbalize them to prompt an LLM to generate novel and diverse training instances. Our findings reveal that synthetic data that follows simple constraints in the downstream dataset act as highly effective augmentations, and CoDa can achieve this without intricate decoding-time constrained generation techniques or fine-tuning with complex algorithms that eventually make the model biased toward the small number of training instances. Additionally, CoDa is the first framework that provides users explicit control over the augmentation generation process, thereby also allowing easy adaptation to several domains. We demonstrate the effectiveness of CoDa across 11 datasets spanning 3 tasks and 3 low-resource settings. CoDa outperforms all our baselines, qualitatively and quantitatively, with improvements of 0.12%-7.19%. Code is available here: https://github.com/Sreyan88/CoDa


title: Circular-arc graphs and the Helly property

abstract: In this paper we investigate some problems related to the Helly properties of circular-arc graphs, which are defined as intersection graphs of arcs of a fixed circle. As such, circular-arc graphs are among the simplest classes of intersection graphs whose models might not satisfy the Helly property. In particular, some cliques of a circular-arc graph might be Helly in some but not all arc intersection models of the graph. Our first result is an alternative proof of a theorem by Lin and Szwarcfiter which asserts that for every circular-arc graph $G$ either every normalized model of $G$ satisfies the Helly property or no normalized model of $G$ satisfies this property. Further, we study the Helly properties of a single clique of a circular-arc graph $G$. We divide the cliques of $G$ into three types: a clique $C$ of $G$ is always-Helly/always-non-Helly/ambiguous if $C$ is Helly in every/no/(some but not all) normalized model of $G$. We provide a combinatorial description for the cliques of each type, and based on it, we devise a polynomial time algorithm which determines the type of a given clique. Finally, we study the Helly Cliques problem, in which we are given an $n$-vertex circular-arc graph $G$ and some of its cliques $C_1, \ldots, C_k$ and we ask if there is an arc intersection model of $G$ in which all the cliques $C_1, \ldots, C_k$ satisfy the Helly property. We show that: (1) the Helly Cliques problem admits a $2^{O(k\log{k})}n^{O(1)}$-time algorithm (that is, it is FPT when parametrized by the number of cliques given in the input), (2) assuming Exponential Time Hypothesis (ETH), the Helly Cliques problem cannot be solved in time $2^{o(k)}n^{O(1)}$, (3) the Helly Cliques problem admits a polynomial kernel of size $O(k^6)$. All our results use a data structure, called a PQM-tree, which maintains all normalized models of a circular-arc graph $G$.


title: Orchestrate Latent Expertise: Advancing Online Continual Learning with Multi-Level Supervision and Reverse Self-Distillation

abstract: To accommodate real-world dynamics, artificial intelligence systems need to cope with sequentially arriving content in an online manner. Beyond regular Continual Learning (CL) attempting to address catastrophic forgetting with offline training of each task, Online Continual Learning (OCL) is a more challenging yet realistic setting that performs CL in a one-pass data stream. Current OCL methods primarily rely on memory replay of old training samples. However, a notable gap from CL to OCL stems from the additional overfitting-underfitting dilemma associated with the use of rehearsal buffers: the inadequate learning of new training samples (underfitting) and the repeated learning of a few old training samples (overfitting). To this end, we introduce a novel approach, Multi-level Online Sequential Experts (MOSE), which cultivates the model as stacked sub-experts, integrating multi-level supervision and reverse self-distillation. Supervision signals across multiple stages facilitate appropriate convergence of the new task while gathering various strengths from experts by knowledge distillation mitigates the performance decline of old tasks. MOSE demonstrates remarkable efficacy in learning new samples and preserving past knowledge through multi-level experts, thereby significantly advancing OCL performance over state-of-the-art baselines (e.g., up to 7.3% on Split CIFAR-100 and 6.1% on Split Tiny-ImageNet).


title: Continual Learning for Autonomous Robots: A Prototype-based Approach

abstract: Humans and animals learn throughout their lives from limited amounts of sensed data, both with and without supervision. Autonomous, intelligent robots of the future are often expected to do the same. The existing continual learning (CL) methods are usually not directly applicable to robotic settings: they typically require buffering and a balanced replay of training data. A few-shot online continual learning (FS-OCL) setting has been proposed to address more realistic scenarios where robots must learn from a non-repeated sparse data stream. To enable truly autonomous life-long learning, an additional challenge of detecting novelties and learning new items without supervision needs to be addressed. We address this challenge with our new prototype-based approach called Continually Learning Prototypes (CLP). In addition to being capable of FS-OCL learning, CLP also detects novel objects and learns them without supervision. To mitigate forgetting, CLP utilizes a novel metaplasticity mechanism that adapts the learning rate individually per prototype. CLP is rehearsal-free, hence does not require a memory buffer, and is compatible with neuromorphic hardware, characterized by ultra-low power consumption, real-time processing abilities, and on-chip learning. Indeed, we have open-sourced a simple version of CLP in the neuromorphic software framework Lava, targetting Intel's neuromorphic chip Loihi 2. We evaluate CLP on a robotic vision dataset, OpenLORIS. In a low-instance FS-OCL scenario, CLP shows state-of-the-art results. In the open world, CLP detects novelties with superior precision and recall and learns features of the detected novel classes without supervision, achieving a strong baseline of 99% base class and 65%/76% (5-shot/10-shot) novel class accuracy.


title: Do Vision-Language Models Understand Compound Nouns?

abstract: Open-vocabulary vision-language models (VLMs) like CLIP, trained using contrastive loss, have emerged as a promising new paradigm for text-to-image retrieval. However, do VLMs understand compound nouns (CNs) (e.g., lab coat) as well as they understand nouns (e.g., lab)? We curate Compun, a novel benchmark with 400 unique and commonly used CNs, to evaluate the effectiveness of VLMs in interpreting CNs. The Compun benchmark challenges a VLM for text-to-image retrieval where, given a text prompt with a CN, the task is to select the correct image that shows the CN among a pair of distractor images that show the constituent nouns that make up the CN. Next, we perform an in-depth analysis to highlight CLIPs' limited understanding of certain types of CNs. Finally, we present an alternative framework that moves beyond hand-written templates for text prompts widely used by CLIP-like models. We employ a Large Language Model to generate multiple diverse captions that include the CN as an object in the scene described by the caption. Our proposed method improves CN understanding of CLIP by 8.25% on Compun. Code and benchmark are available at: https://github.com/sonalkum/Compun


title: Learning Service Selection Decision Making Behaviors During Scientific Workflow Development

abstract: Increasingly, more software services have been published onto the Internet, making it a big challenge to recommend services in the process of a scientific workflow composition. In this paper, a novel context-aware approach is proposed to recommending next services in a workflow development process, through learning service representation and service selection decision making behaviors from workflow provenance. Inspired by natural language sentence generation, the composition process of a scientific workflow is formalized as a step-wise procedure within the context of the goal of workflow, and the problem of next service recommendation is mapped to next word prediction. Historical service dependencies are first extracted from scientific workflow provenance to build a knowledge graph. Service sequences are then generated based on diverse composition path generation strategies. Afterwards, the generated corpus of composition paths are leveraged to study previous decision making strategies. Such a trained goal-oriented next service prediction model will be used to recommend top K candidate services during workflow composition process. Extensive experiments on a real-word repository have demonstrated the effectiveness of this approach.


title: Jacobi Sigma Models and Twisted Jacobi Structures

abstract: Jacobi sigma models are two-dimensional topological non-linear field theories which are associated with Jacobi structures. The latter can be considered as a generalization of Poisson structures. After reviewing the main properties and peculiarities of these models, we focus on the twisted version in which a Wess-Zumino term is included. This modification allows for the target space to be a twisted Jacobi manifold. We discuss in particular the model on the sphere $S^5$.


title: Moments of Entropy Production in Dissipative Devices

abstract: We characterize the possible moments of entropy production for general overdamped Markovian systems. We find a general formulation of the problem, and derive a new necessary condition between the second and third moment. We determine all possible first, second and third moments of entropy production for a white noise process. As a consequence, we obtain a lower bound for the skewness of the current fluctuations in dissipative devices such as transistors, thereby demonstrating that the Gaussianity assumption widely used in electronic engineering is thermodynamically inconsistent.


title: Keep your memory dump shut: Unveiling data leaks in password managers

abstract: Password management has long been a persistently challenging task. This led to the introduction of password management software, which has been around for at least 25 years in various forms, including desktop and browser-based applications. This work assesses the ability of two dozen password managers, 12 desktop applications, and 12 browser-plugins, to effectively protect the confidentiality of secret credentials in six representative scenarios. Our analysis focuses on the period during which a Password Manager (PM) resides in the RAM. Despite the sensitive nature of these applications, our results show that across all scenarios, only three desktop PM applications and two browser plugins do not store plaintext passwords in the system memory. Oddly enough, at the time of writing, only two vendors recognized the exploit as a vulnerability, reserving CVE-2023-23349, while the rest chose to disregard or underrate the issue.


title: From attention to profit: quantitative trading strategy based on transformer

abstract: In traditional quantitative trading practice, navigating the complicated and dynamic financial market presents a persistent challenge. Former machine learning approaches have struggled to fully capture various market variables, often ignore long-term information and fail to catch up with essential signals that may lead the profit. This paper introduces an enhanced transformer architecture and designs a novel factor based on the model. By transfer learning from sentiment analysis, the proposed model not only exploits its original inherent advantages in capturing long-range dependencies and modelling complex data relationships but is also able to solve tasks with numerical inputs and accurately forecast future returns over a period. This work collects more than 5,000,000 rolling data of 4,601 stocks in the Chinese capital market from 2010 to 2019. The results of this study demonstrated the model's superior performance in predicting stock trends compared with other 100 factor-based quantitative strategies with lower turnover rates and a more robust half-life period. Notably, the model's innovative use transformer to establish factors, in conjunction with market sentiment information, has been shown to enhance the accuracy of trading signals significantly, thereby offering promising implications for the future of quantitative trading strategies.


title: Thermal production of charm quarks in relativistic heavy-ion collisions

abstract: We investigate the thermal production of charm quark in the strongly interacting quark-gluon plasma (sQGP) created in heavy-ion collisions at relativistic energies. Our study is based on the off-shell parton-hadron-string dynamics (PHSD) transport approach describing the full time evolution of heavy-ion collisions on a microscopic bases with hadronic and partonic degrees-of-freedom. The sQGP is realized within the effective dynamical quasi-particle model (DQPM) which is adjusted to reproduce the lattice QCD results for the thermodynamic observables of the sQGP. Relying that the DQPM successfully describes the spatial diffusion coefficients $D_s$ from the lQCD, which controls the interaction of charm quarks with thermal partons (expressed in terms of strongly interacting off-shell quasiparticles), we evaluate the production of pairs of anti-charm/charm quarks through the rotation of Feynman diagrams using cross symmetry for elastic scattering of charm quark with thermal partons ((anti-)quarks or gluons) in the sQGP by the exchange of the incoming charm quark and outgoing light parton in elastic scattering diagrams. The charm quark annihilation is realized by detailed balance. We find that the number of produced thermal charm quark pairs strongly depends on the charm quark mass in the QGP. While for the heavy charm quarks of mass $m_c=1.8$ GeV it is subdominant compared to the primary charm production by binary nucleon-nucleon collisions at RHIC and LHC energies, the numbers of primary and thermal charm quarks become comparable for a smaller (bare) $m_c=1.2$ GeV. Comparing with the experimental data on the $R_{\rm AA}$ of $D$-mesons in heavy-ion collisions at RHIC and LHC energies, it is more favorable for charm quarks in the QGP to gain additional mass due to thermal effects rather than to have a low bare mass.


title: Self-Corrective Sensor Fusion for Drone Positioning in Indoor Facilities

abstract: Drones may be more advantageous than fixed cameras for quality control applications in industrial facilities, since they can be redeployed dynamically and adjusted to production planning. The practical scenario that has motivated this paper, image acquisition with drones in a car manufacturing plant, requires drone positioning accuracy in the order of 5 cm. During repetitive manufacturing processes, it is assumed that quality control imaging drones will follow highly deterministic periodic paths, stop at predefined points to take images and send them to image recognition servers. Therefore, by relying on prior knowledge about production chain schedules, it is possible to optimize the positioning technologies for the drones to stay at all times within the boundaries of their flight plans, which will be composed of stopping points and the paths in between. This involves mitigating issues such as temporary blocking of line-of-sight between the drone and any existing radio beacons; sensor data noise; and the loss of visual references. We present a self-corrective solution for this purpose. It corrects visual odometer readings based on filtered and clustered Ultra-Wide Band (UWB) data, as an alternative to direct Kalman fusion. The approach combines the advantages of these technologies when at least one of them works properly at any measurement spot. It has three method components: independent Kalman filtering, data association by means of stream clustering and mutual correction of sensor readings based on the generation of cumulative correction vectors. The approach is inspired by the observation that UWB positioning works reasonably well at static spots whereas visual odometer measurements reflect straight displacements correctly but can underestimate their length. Our experimental results demonstrate the advantages of the approach in the application scenario over Kalman fusion.


title: Extracting Manifold Information from Point Clouds

abstract: A kernel based method is proposed for the construction of signature (defining) functions of subsets of $\mathbb{R}^d$. The subsets can range from full dimensional manifolds (open subsets) to point clouds (a finite number of points) and include bounded smooth manifolds of any codimension. The interpolation and analysis of point clouds are the main application. Two extreme cases in terms of regularity are considered, where the data set is interpolated by an analytic surface, at the one extreme, and by a H\"older continuous surface, at the other. The signature function can be computed as a linear combination of translated kernels, the coefficients of which are the solution of a finite dimensional linear problem. Once it is obtained, it can be used to estimate the dimension as well as the normal and the curvatures of the interpolated surface. The method is global and does not require explicit knowledge of local neighborhoods or any other structure present in the data set. It admits a variational formulation with a natural ``regularized'' counterpart, that proves to be useful in dealing with data sets corrupted by numerical error or noise. The underlying analytical structure of the approach is presented in general before it is applied to the case of point clouds.


title: Second $\alpha$-Order Fractal Differential Equations

abstract: In this research paper, we provide a concise overview of fractal calculus applied to fractal sets. We introduce and solve a second $\alpha$-order fractal differential equation with constant coefficients across different scenarios. We propose a uniqueness theorem for second $\alpha$-order fractal linear differential equations. We define the solution space as a vector space with non-integer orders. We establish precise conditions for second $\alpha$-order fractal linear differential equations and derive the corresponding fractal adjoint differential equation.


title: Multiway Point Cloud Mosaicking with Diffusion and Global Optimization

abstract: We introduce a novel framework for multiway point cloud mosaicking (named Wednesday), designed to co-align sets of partially overlapping point clouds -- typically obtained from 3D scanners or moving RGB-D cameras -- into a unified coordinate system. At the core of our approach is ODIN, a learned pairwise registration algorithm that iteratively identifies overlaps and refines attention scores, employing a diffusion-based process for denoising pairwise correlation matrices to enhance matching accuracy. Further steps include constructing a pose graph from all point clouds, performing rotation averaging, a novel robust algorithm for re-estimating translations optimally in terms of consensus maximization and translation optimization. Finally, the point cloud rotations and positions are optimized jointly by a diffusion-based approach. Tested on four diverse, large-scale datasets, our method achieves state-of-the-art pairwise and multiway registration results by a large margin on all benchmarks. Our code and models are available at https://github.com/jinsz/Multiway-Point-Cloud-Mosaicking-with-Diffusion-and-Global-Optimization.


title: Variational inequalities for generalized spherical means

abstract: In this paper, we establish the $L^{p}(\mathbb{R}^{d})$-boundedness of the variation operator and the $\delta$-jump operator for generalized spherical means, and we also show the necessary conditions for the $L^{p}(\mathbb{R}^{d})$-boundedness of these operators. These results are almost optimal when $d=2$.


title: Visualizing Routes with AI-Discovered Street-View Patterns

abstract: Street-level visual appearances play an important role in studying social systems, such as understanding the built environment, driving routes, and associated social and economic factors. It has not been integrated into a typical geographical visualization interface (e.g., map services) for planning driving routes. In this paper, we study this new visualization task with several new contributions. First, we experiment with a set of AI techniques and propose a solution of using semantic latent vectors for quantifying visual appearance features. Second, we calculate image similarities among a large set of street-view images and then discover spatial imagery patterns. Third, we integrate these discovered patterns into driving route planners with new visualization techniques. Finally, we present VivaRoutes, an interactive visualization prototype, to show how visualizations leveraged with these discovered patterns can help users effectively and interactively explore multiple routes. Furthermore, we conducted a user study to assess the usefulness and utility of VivaRoutes.


title: Flexible Variable-Rate Image Feature Compression for Edge-Cloud Systems

abstract: Feature compression is a promising direction for coding for machines. Existing methods have made substantial progress, but they require designing and training separate neural network models to meet different specifications of compression rate, performance accuracy and computational complexity. In this paper, a flexible variable-rate feature compression method is presented that can operate on a range of rates by introducing a rate control parameter as an input to the neural network model. By compressing different intermediate features of a pre-trained vision task model, the proposed method can scale the encoding complexity without changing the overall size of the model. The proposed method is more flexible than existing baselines, at the same time outperforming them in terms of the three-way trade-off between feature compression rate, vision task accuracy, and encoding complexity. We have made the source code available at https://github.com/adnan-hossain/var_feat_comp.git.


title: Property $\mathrm{(TTT)}$ and the Cowling--Haagerup constant

abstract: We show that Property $\mathrm{(TTT)}$ is an obstruction to weak amenability with Cowling--Haagerup constant $1$. More precisely, if $G$ is a countable group and $H$ is an infinite subgroup of $G$ such that the pair $(G,H)$ has relative Property $\mathrm{(TTT)}$, then the weak Haagerup constant $\boldsymbol\Lambda_{\mathrm{WH}}(G)$ is strictly greater than $1$. We apply this result to some semidirect products and lattices in higher rank algebraic groups.


title: On Accessibility Fairness in Intermodal Autonomous Mobility-on-Demand Systems

abstract: Research on the operation of mobility systems so far has mostly focused on minimizing cost-centered metrics such as average travel time, distance driven, and operational costs. Whilst capturing economic indicators, such metrics do not account for transportation justice aspects. In this paper, we present an optimization model to plan the operation of Intermodal Autonomous Mobility-on-Demand (I-AMoD) systems, where self-driving vehicles provide on-demand mobility jointly with public transit and active modes, with the goal to minimize the accessibility unfairness experienced by the population. Specifically, we first leverage a previously developed network flow model to compute the I-AMoD system operation in a minimum-time manner. Second, we formally define accessibility unfairness, and use it to frame the minimum-accessibility-unfairness problem and cast it as a linear program. We showcase our framework for a real-world case-study in the city of Eindhoven, NL. Our results show that it is possible to reach an operation that is on average fully fair at the cost of a slight travel time increase compared to a minimum-travel-time solution. Thereby we observe that the accessibility fairness of individual paths is, on average, worse than the average values obtained from flows, setting the stage for a discussion on the definition of accessibility fairness itself.


title: Total progeny in almost critical multi-type Galton-Watson processes

abstract: We consider multi-type Galton-Watson branching processes, where the Perron root ($\rho$) of the first moments matrix approaches unity. Specifically, we examine the random vector representing the number of individuals preceding generation $n$, often referred to as the total progeny. By conditioning on non-extinction or extinction at current time, and properly normalizing it, we derive the asymptotic distribution for this vector. Similar theorem is derived for process with immigration. The key determinant of this distributions is the limit of $n(\rho-1)$ as $n$ tends to infinity and $\rho$ approaches 1.


title: Non-triviality of welded knots and ribbon torus-knots

abstract: In this paper we study welded knots and their invariants. We focus on generating examples of non-trivial knotted ribbon tori as the tube of welded knots that are obtained from classical knot diagrams by welding some of the crossings. Non-triviality is shown by determining the fundamental group of the concerned welded knot. Sample examples under consideration are the standard diagrams of the family of $(2,q)$ torus knots and the twist knots. Standard diagrams of knots from Rolfsen's tables with $6$ crossings are also discussed which are not in the family of torus and twist knots.


title: Automatic explanation of the classification of Spanish legal judgments in jurisdiction-dependent law categories with tree estimators

abstract: Automatic legal text classification systems have been proposed in the literature to address knowledge extraction from judgments and detect their aspects. However, most of these systems are black boxes even when their models are interpretable. This may raise concerns about their trustworthiness. Accordingly, this work contributes with a system combining Natural Language Processing (NLP) with Machine Learning (ML) to classify legal texts in an explainable manner. We analyze the features involved in the decision and the threshold bifurcation values of the decision paths of tree structures and present this information to the users in natural language. This is the first work on automatic analysis of legal texts combining NLP and ML along with Explainable Artificial Intelligence techniques to automatically make the models' decisions understandable to end users. Furthermore, legal experts have validated our solution, and this knowledge has also been incorporated into the explanation process as "expert-in-the-loop" dictionaries. Experimental results on an annotated data set in law categories by jurisdiction demonstrate that our system yields competitive classification performance, with accuracy values well above 90%, and that its automatic explanations are easily understandable even to non-expert users.


title: Communication Efficient Distributed Training with Distributed Lion

abstract: The Lion optimizer has been a promising competitor with the AdamW for training large AI models, with advantages on memory, computation, and sample efficiency. In this paper, we introduce Distributed Lion, an innovative adaptation of Lion for distributed training environments. Leveraging the sign operator in Lion, our Distributed Lion only requires communicating binary or lower-precision vectors between workers to the center server, significantly reducing the communication cost. Our theoretical analysis confirms Distributed Lion's convergence properties. Empirical results demonstrate its robustness across a range of tasks, worker counts, and batch sizes, on both vision and language problems. Notably, Distributed Lion attains comparable performance to standard Lion or AdamW optimizers applied on aggregated gradients, but with significantly reduced communication bandwidth. This feature is particularly advantageous for training large models. In addition, we also demonstrate that Distributed Lion presents a more favorable performance-bandwidth balance compared to existing efficient distributed methods such as deep gradient compression and ternary gradients.


title: DOCMASTER: A Unified Platform for Annotation, Training, & Inference in Document Question-Answering

abstract: The application of natural language processing models to PDF documents is pivotal for various business applications yet the challenge of training models for this purpose persists in businesses due to specific hurdles. These include the complexity of working with PDF formats that necessitate parsing text and layout information for curating training data and the lack of privacy-preserving annotation tools. This paper introduces DOCMASTER, a unified platform designed for annotating PDF documents, model training, and inference, tailored to document question-answering. The annotation interface enables users to input questions and highlight text spans within the PDF file as answers, saving layout information and text spans accordingly. Furthermore, DOCMASTER supports both state-of-the-art layout-aware and text models for comprehensive training purposes. Importantly, as annotations, training, and inference occur on-device, it also safeguards privacy. The platform has been instrumental in driving several research prototypes concerning document analysis such as the AI assistant utilized by University of California San Diego's (UCSD) International Services and Engagement Office (ISEO) for processing a substantial volume of PDF documents.


title: Number of steady states of quantum evolutions

abstract: We prove sharp universal upper bounds on the number of steady and asymptotic states of discrete- and continuous-time Markovian evolutions of open quantum systems. We show that the bounds depend only on the dimension of the system and not on the details of the dynamics. A comparison with similar bounds deriving from a recent spectral conjecture for Markovian evolutions is also provided.


title: CCWSIM: An Efficient and Fast Wavelet-Based CCSIM for Categorical Characterization of Large-Scale

abstract: Over the last couple of decades, there has been a surge in various approaches to multiple-point statistics simulation, commonly referred to as MPS. These methods have aimed to improve several critical aspects of realism in the results, including spatial continuity, conditioning, stochasticity, and computational efficiency. Nevertheless, achieving a simultaneous enhancement of these crucial factors has presented challenges to researchers. In the approach that we propose, CCSIM is combined with the Discrete Wavelet Transform (DWT) to address some of these concerns. The primary step in the method involves the computation of the DWT for both the Training Image (TI) and a region shared with previously simulated grids at a specific level of wavelet decomposition. Then, the degree of similarity between the wavelet approximation coefficients is measured using a Cross-Correlation Function (CCF). These approximation coefficients offer a compressed representation of the pattern while capturing its primary variations and essential characteristics, thereby expediting the search for the best-matched pattern. Once the best-matched pattern in the wavelet approximation coefficients is identified, the original pattern can be perfectly reconstructed by integrating the DWT detail coefficients through an Inverse-DWT transformation. Experiments conducted across diverse categorical TIs demonstrate simulations comparable to multi-scale CCSIM (MS-CCSIM), accompanied by an enhancement in facies connectivity and pattern reproduction. The source code implementations are available at https://github.com/MBS1984/CCWSIM.


title: Interactive Multi-Robot Flocking with Gesture Responsiveness and Musical Accompaniment

abstract: For decades, robotics researchers have pursued various tasks for multi-robot systems, from cooperative manipulation to search and rescue. These tasks are multi-robot extensions of classical robotic tasks and often optimized on dimensions such as speed or efficiency. As robots transition from commercial and research settings into everyday environments, social task aims such as engagement or entertainment become increasingly relevant. This work presents a compelling multi-robot task, in which the main aim is to enthrall and interest. In this task, the goal is for a human to be drawn to move alongside and participate in a dynamic, expressive robot flock. Towards this aim, the research team created algorithms for robot movements and engaging interaction modes such as gestures and sound. The contributions are as follows: (1) a novel group navigation algorithm involving human and robot agents, (2) a gesture responsive algorithm for real-time, human-robot flocking interaction, (3) a weight mode characterization system for modifying flocking behavior, and (4) a method of encoding a choreographer's preferences inside a dynamic, adaptive, learned system. An experiment was performed to understand individual human behavior while interacting with the flock under three conditions: weight modes selected by a human choreographer, a learned model, or subset list. Results from the experiment showed that the perception of the experience was not influenced by the weight mode selection. This work elucidates how differing task aims such as engagement manifest in multi-robot system design and execution, and broadens the domain of multi-robot tasks.


title: UDE-based Dynamic Motion Force Control of Mobile Manipulators

abstract: Mobile manipulators are known for their superior mobility over manipulators on fixed bases, offering promising applications in smart industry and housekeeping scenarios. However, the dynamic coupling nature between the mobile base and the manipulator presents challenges for the physical interactive tasks of the mobile manipulator. Current methods suffer from complex modeling processes and poor transferability. To address this, this article presents a novel dynamic model of the manipulator on the mobile base that requires only the manipulator dynamics and the kinematic information of the mobile base. In addition, embedding the dynamic model, an uncertainty and disturbance estimator-based (UDE-based) dynamic motion/force control scheme is proposed for the mobile manipulator, which compensates for the dynamic coupling and other unmodeled uncertainties. Passivity and stability analyses justify the proposed control law. Simulation and experimental results on our mobile manipulator platform demonstrate the feasibility and effectiveness of our proposed methodology.


title: New method for the solution of the two-body Dirac equation for the positronium bound states

abstract: A new theoretical method is developed to solve the two-body bound-state Dirac equation for positronium. Only Coulomb potential was included in the Dirac Hamiltonian. It is shown that the two-body Dirac Hamiltonian can be written in the Hermitian matrix form of the 4$\times$4 size and diagonalized in the momentum-state representation. Numerical results for the energy spectrum of the para- and ortho-positronium ground states performed within the variational method using the harmonic oscillator basis functions are in good agreement with a high-precision finite-element method of T.C. Scott et al. After the Fourier transformation into the coordinate-state representation the bound state wave functions of the para-Ps and ortho-Ps do not contain any singularity at the origin in contrast to the method mentioned above. The weights of the large-small and small-large components of the ground state wave functions are estimated to be of order 10$^{-6}$, while the weight of the small-small component is of order 10$^{-12}$.


title: On Homogeneous System of Fractal Differential Equations

abstract: In this paper, a homogeneous system of n $\alpha$-order linear fractal differential equation is defined and the set of its fundamental solutions through the corresponding Wronskian matrix is described. Finally, the solutions of some assigned autonomous homogeneous system are plotted to show the details previously proved.


title: Towards a Semantic Characterisation of Global Type Well-formedness

abstract: We address the question of characterising the well-formedness properties of multiparty session types semantically, i.e., as properties of the semantic model used to interpret types. Choosing Prime Event Structures (PESs) as our semantic model, we present semantic counterparts for the two properties that underpin global type well-formedness, namely projectability and boundedness, in this model. As a first step towards a characterisation of the class of PESs corresponding to well-formed global types, we identify some simple structural properties satisfied by such PESs.


title: Synthetic Dataset Generation and Learning From Demonstration Applied to Industrial Manipulation

abstract: The aim of this study is to investigate an automated industrial manipulation pipeline, where assembly tasks can be flexibly adapted to production without the need for a robotic expert, both for the vision system and the robot program. The objective of this study is first, to develop a synthetic-dataset-generation pipeline with a special focus on industrial parts, and second, to use Learning-from-Demonstration (LfD) methods to replace manual robot programming, so that a non-robotic expert/process engineer can introduce a new manipulation task by teaching it to the robot.


title: Meson mass and width: Deep learning approach

abstract: It is fascinating to predict the mass and width of the ordinary and exotic mesons solely based on their quark content and quantum numbers. Such prediction goes beyond conventional methodologies traditionally employed in hadron physics for calculating or estimating these quantities. The relation between the quantum numbers and the properties of the mesons, such as the mass and width, is complicated in the world of particle physics. However, the deep neural network (DNN) as a subfield of machine learning techniques provides a solution to this problem. By analyzing large datasets, deep learning algorithms can automatically identify complex patterns among the particles' quantum numbers, and their mass and width, that would otherwise require complex calculations. In this study, we present two approaches using the DNNs to estimate the mass of some ordinary and exotic mesons. Also for the first time, the DNNs are trained to predict the width of ordinary and exotic mesons, whose widths have not been experimentally known. Our predictions obtained through the DNNs, will be useful for future experimental searches.


title: Primordial Black Holes from Spatially Varying Cosmological Constant Induced by Field Fluctuations in Extra Dimensions

abstract: The origin and evolution of supermassive black holes (SMBHs) in our universe have sparked controversy. In this study, we explore the hypothesis that some of these black holes may have seeded from the direct collapse of dark energy domains with density significantly higher than the surrounding regions. The mechanism of the origin of such domains relies on the inflationary evolution of a scalar field acting in D dimensions, which is associated with the cosmological constant in our four-dimensional spacetime manifold. Inner space quantum fluctuations of the field during inflation are responsible for the spatial variations of the dark energy density in our space. This finding holds particular significance, especially considering recent evidence from pulsar timing array observations, which supports the existence of a stochastic gravitational wave background consisting of SMBH mergers.


title: Planning and Editing What You Retrieve for Enhanced Tool Learning

abstract: Recent advancements in integrating external tools with Large Language Models (LLMs) have opened new frontiers, with applications in mathematical reasoning, code generators, and smart assistants. However, existing methods, relying on simple one-time retrieval strategies, fall short on effectively and accurately shortlisting relevant tools. This paper introduces a novel PLUTO (Planning, Learning, and Understanding for TOols) approach, encompassing `Plan-and-Retrieve (P&R)` and `Edit-and-Ground (E&G)` paradigms. The P&R paradigm consists of a neural retrieval module for shortlisting relevant tools and an LLM-based query planner that decomposes complex queries into actionable tasks, enhancing the effectiveness of tool utilization. The E&G paradigm utilizes LLMs to enrich tool descriptions based on user scenarios, bridging the gap between user queries and tool functionalities. Experiment results demonstrate that these paradigms significantly improve the recall and NDCG in tool retrieval tasks, significantly surpassing current state-of-the-art models.


title: Thin-Shell Object Manipulations With Differentiable Physics Simulations

abstract: In this work, we aim to teach robots to manipulate various thin-shell materials. Prior works studying thin-shell object manipulation mostly rely on heuristic policies or learn policies from real-world video demonstrations, and only focus on limited material types and tasks (e.g., cloth unfolding). However, these approaches face significant challenges when extended to a wider variety of thin-shell materials and a diverse range of tasks. While virtual simulations are shown to be effective in diverse robot skill learning and evaluation, prior thin-shell simulation environments only support a subset of thin-shell materials, which also limits their supported range of tasks. We introduce ThinShellLab - a fully differentiable simulation platform tailored for robotic interactions with diverse thin-shell materials possessing varying material properties, enabling flexible thin-shell manipulation skill learning and evaluation. Our experiments suggest that manipulating thin-shell objects presents several unique challenges: 1) thin-shell manipulation relies heavily on frictional forces due to the objects' co-dimensional nature, 2) the materials being manipulated are highly sensitive to minimal variations in interaction actions, and 3) the constant and frequent alteration in contact pairs makes trajectory optimization methods susceptible to local optima, and neither standard reinforcement learning algorithms nor trajectory optimization methods (either gradient-based or gradient-free) are able to solve the tasks alone. To overcome these challenges, we present an optimization scheme that couples sampling-based trajectory optimization and gradient-based optimization, boosting both learning efficiency and converged performance across various proposed tasks. In addition, the differentiable nature of our platform facilitates a smooth sim-to-real transition.


title: Higher Order Fractal Differential Equations

abstract: This paper provides a summary of the fractal calculus framework. It presents higher-order homogeneous and nonhomogeneous linear fractal differential equations with $\alpha$-order. Solutions for these equations with constant coefficients are obtained through the method of variation of parameters and the method of undetermined coefficients. The solution space for higher $\alpha$-order linear fractal differential equations is defined, showcasing its non-integer dimensionality. The solutions to $\alpha$-order linear fractal differential equations are graphically depicted to illustrate their non-differentiability. Additionally, equations of motion governing the behavior of two masses in fractal time are proposed and solved.


title: Predictability of climate anomalies in the regions of Northern Eurasia in the spring-summer months in 2024 in connection with El Nino

abstract: The predictability of climate anomalies in the regions of Northern Eurasia in connection with El Nino phenomena is analyzed. Particular attention is paid to the most likely transition in 2024 from an El Nino phase at the beginning of the year to a La Nina phase at the end of the year, with the greatest probability of high temperatures and dry conditions in European Russia during the spring and summer months, as in 2010. The predictability levels of regional climate anomalies using different El Nino indices are compared. The relationship of the noted seasonal anomalies with atmospheric blockings is considered, taking into account the different phases of the key modes of climate variability like El Nino phenomena and the Pacific Decadal Oscillation. Changes in the predictability of regional climate anomalies under global climate change are discussed.


title: Revisiting the 3{\alpha} reaction rates in helium burning stars

abstract: Helium burning is one of the most fundamental steps of stellar nucleosynthesis, as it describes the formation of life-determining element of carbon, while it plays a key role in the evolution of Red Giant, accreting White Dwarfs and Neutron Stars. In this work we develop a generalized statistical theory for the 3{\alpha} reaction, which is based on the use of the Imaginary Time Method, along with the semi-classical Hybrid {\alpha}-Clustering (H{\alpha}C) and Neck Model (NM) frameworks. The results compared to the methodology and data of the NACRE collaboration, following in several orders of magnitude discrepancies, especially at low temperatures. This may be crucial for the early dynamics of helium burning stars.


title: Strongly discrete subsets with Lindel\"of closures

abstract: We define a topological space to be an "SDL space" if the closure of each one of its strongly discrete subsets is Lindel\"of. After distinguishing this property from the Lindel\"of property we make various remarks about cardinal invariants of SDL spaces. For example we prove that $|X| \leq 2^{\chi(X)}$ for every SDL Urysohn space and that every SDL $P$-space of character $\leq \omega_1$ is regular and has cardinality $\leq 2^{\omega_1}$. Finally, we exploit our results to obtain some partial answers to questions about the cardinality of cellular-Lindel\"of spaces.


title: QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs

abstract: We introduce QuaRot, a new Quantization scheme based on Rotations, which is able to quantize LLMs end-to-end, including all weights, activations, and KV cache in 4 bits. QuaRot rotates LLMs in a way that removes outliers from the hidden state without changing the output, making quantization easier. This computational invariance is applied to the hidden state (residual) of the LLM, as well as to the activations of the feed-forward components, aspects of the attention mechanism and to the KV cache. The result is a quantized model where all matrix multiplications are performed in 4-bits, without any channels identified for retention in higher precision. Our quantized LLaMa2-70B model has losses of at most 0.29 WikiText-2 perplexity and retains 99% of the zero-shot performance. Code is available at: https://github.com/spcl/QuaRot.


title: MetaIE: Distilling a Meta Model from LLM for All Kinds of Information Extraction Tasks

abstract: Information extraction (IE) is a fundamental area in natural language processing where prompting large language models (LLMs), even with in-context examples, cannot defeat small LMs tuned on very small IE datasets. We observe that IE tasks, such as named entity recognition and relation extraction, all focus on extracting important information, which can be formalized as a label-to-span matching. In this paper, we propose a novel framework MetaIE to build a small LM as meta-model by learning to extract "important information", i.e., the meta-understanding of IE, so that this meta-model can be adapted to all kind of IE tasks effectively and efficiently. Specifically, MetaIE obtains the small LM via a symbolic distillation from an LLM following the label-to-span scheme. We construct the distillation dataset via sampling sentences from language model pre-training datasets (e.g., OpenWebText in our implementation) and prompting an LLM to identify the typed spans of "important information". We evaluate the meta-model under the few-shot adaptation setting. Extensive results on 13 datasets from 6 IE tasks confirm that MetaIE can offer a better starting point for few-shot tuning on IE datasets and outperform other meta-models from (1) vanilla language model pre-training, (2) multi-IE-task pre-training with human annotations, and (3) single-IE-task symbolic distillation from LLM. Moreover, we provide comprehensive analyses of MetaIE, such as the size of the distillation dataset, the meta-model architecture, and the size of the meta-model.


title: Beyond One-Size-Fits-All: Multi-Domain, Multi-Task Framework for Embedding Model Selection

abstract: This position paper proposes a systematic approach towards developing a framework to help select the most effective embedding models for natural language processing (NLP) tasks, addressing the challenge posed by the proliferation of both proprietary and open-source encoder models.


title: NumeroLogic: Number Encoding for Enhanced LLMs' Numerical Reasoning

abstract: Language models struggle with handling numerical data and performing arithmetic operations. We hypothesize that this limitation can be partially attributed to non-intuitive textual numbers representation. When a digit is read or generated by a causal language model it does not know its place value (e.g. thousands vs. hundreds) until the entire number is processed. To address this issue, we propose a simple adjustment to how numbers are represented by including the count of digits before each number. For instance, instead of "42", we suggest using "{2:42}" as the new format. This approach, which we term NumeroLogic, offers an added advantage in number generation by serving as a Chain of Thought (CoT). By requiring the model to consider the number of digits first, it enhances the reasoning process before generating the actual number. We use arithmetic tasks to demonstrate the effectiveness of the NumeroLogic formatting. We further demonstrate NumeroLogic applicability to general natural language modeling, improving language understanding performance in the MMLU benchmark.


title: On the weighted Steklov eigenvalue problems in outward cuspidal domains

abstract: IIn this article, we consider the weighted Steklov eigenvalue problem and the weighted Schr\"odinger--Steklov eigenvalue problem in outward cuspidal domains. We prove solvability of this spectral problem both in the linear and non-linear case.


title: Shortcuts Arising from Contrast: Effective and Covert Clean-Label Attacks in Prompt-Based Learning

abstract: Prompt-based learning paradigm has demonstrated remarkable efficacy in enhancing the adaptability of pretrained language models (PLMs), particularly in few-shot scenarios. However, this learning paradigm has been shown to be vulnerable to backdoor attacks. The current clean-label attack, employing a specific prompt as a trigger, can achieve success without the need for external triggers and ensure correct labeling of poisoned samples, which is more stealthy compared to the poisoned-label attack, but on the other hand, it faces significant issues with false activations and poses greater challenges, necessitating a higher rate of poisoning. Using conventional negative data augmentation methods, we discovered that it is challenging to trade off between effectiveness and stealthiness in a clean-label setting. In addressing this issue, we are inspired by the notion that a backdoor acts as a shortcut and posit that this shortcut stems from the contrast between the trigger and the data utilized for poisoning. In this study, we propose a method named Contrastive Shortcut Injection (CSI), by leveraging activation values, integrates trigger design and data selection strategies to craft stronger shortcut features. With extensive experiments on full-shot and few-shot text classification tasks, we empirically validate CSI's high effectiveness and high stealthiness at low poisoning rates. Notably, we found that the two approaches play leading roles in full-shot and few-shot settings, respectively.


title: Zero-shot Safety Prediction for Autonomous Robots with Foundation World Models

abstract: A world model creates a surrogate world to train a controller and predict safety violations by learning the internal dynamic model of systems. However, the existing world models rely solely on statistical learning of how observations change in response to actions, lacking precise quantification of how accurate the surrogate dynamics are, which poses a significant challenge in safety-critical systems. To address this challenge, we propose foundation world models that embed observations into meaningful and causally latent representations. This enables the surrogate dynamics to directly predict causal future states by leveraging a training-free large language model. In two common benchmarks, this novel model outperforms standard world models in the safety prediction task and has a performance comparable to supervised learning despite not using any data. We evaluate its performance with a more specialized and system-relevant metric by comparing estimated states instead of aggregating observation-wide error.


title: Addressing Both Statistical and Causal Gender Fairness in NLP Models

abstract: Statistical fairness stipulates equivalent outcomes for every protected group, whereas causal fairness prescribes that a model makes the same prediction for an individual regardless of their protected characteristics. Counterfactual data augmentation (CDA) is effective for reducing bias in NLP models, yet models trained with CDA are often evaluated only on metrics that are closely tied to the causal fairness notion; similarly, sampling-based methods designed to promote statistical fairness are rarely evaluated for causal fairness. In this work, we evaluate both statistical and causal debiasing methods for gender bias in NLP models, and find that while such methods are effective at reducing bias as measured by the targeted metric, they do not necessarily improve results on other bias metrics. We demonstrate that combinations of statistical and causal debiasing techniques are able to reduce bias measured through both types of metrics.


title: Leveraging Pre-trained and Transformer-derived Embeddings from EHRs to Characterize Heterogeneity Across Alzheimer's Disease and Related Dementias

abstract: Alzheimer's disease is a progressive, debilitating neurodegenerative disease that affects 50 million people globally. Despite this substantial health burden, available treatments for the disease are limited and its fundamental causes remain poorly understood. Previous work has suggested the existence of clinically-meaningful sub-types, which it is suggested may correspond to distinct etiologies, disease courses, and ultimately appropriate treatments. Here, we use unsupervised learning techniques on electronic health records (EHRs) from a cohort of memory disorder patients to characterise heterogeneity in this disease population. Pre-trained embeddings for medical codes as well as transformer-derived Clinical BERT embeddings of free text are used to encode patient EHRs. We identify the existence of sub-populations on the basis of comorbidities and shared textual features, and discuss their clinical significance.


title: A Promising New Dark Matter Candidate, and Implications for the Search for Extraterrestrial Intelligence (SETI)

abstract: We present a speculative exploration of the properties of a proposed new Dark Matter (DM) candidate in a heretofore under-explored region of parameter space. Our proposed ultra-cold candidatae has been a matter of speculation for some time,and has recently been tentatively identified via direct-detection. While unconventional, demonstrated existence of this DM candidate would have wide-ranging implications for a range of fields, from particle cosmology to exobiology and the Search for Extraterrestrial Life (SETI).


title: Computation and Communication Efficient Lightweighting Vertical Federated Learning

abstract: The exploration of computational and communication efficiency within Federated Learning (FL) has emerged as a prominent and crucial field of study. While most existing efforts to enhance these efficiencies have focused on Horizontal FL, the distinct processes and model structures of Vertical FL preclude the direct application of Horizontal FL-based techniques. In response, we introduce the concept of Lightweight Vertical Federated Learning (LVFL), targeting both computational and communication efficiencies. This approach involves separate lightweighting strategies for the feature model, to improve computational efficiency, and for feature embedding, to enhance communication efficiency. Moreover, we establish a convergence bound for our LVFL algorithm, which accounts for both communication and computational lightweighting ratios. Our evaluation of the algorithm on a image classification dataset reveals that LVFL significantly alleviates computational and communication demands while preserving robust learning performance. This work effectively addresses the gaps in communication and computational efficiency within Vertical FL.


title: Characterization of uncertainties in electron-argon collision cross sections under statistical principles

abstract: The predictive capability of a plasma discharge model depends on accurate representations of electron-impact collision cross sections, which determine the key reaction rates and transport properties of the plasma. Although many cross sections have been identified through experiments and quantum mechanical simulations, their uncertainties are not well-investigated. We characterize the uncertainties in electron-argon collision cross sections using a Bayesian framework. Six collision processes -- elastic momentum transfer, ionization, and four excitations -- are characterized with semi-empirical models, whose parametric uncertainties effectively capture the features important to the macroscopic properties of the plasma, namely transport properties and chemical reaction rates. The method is designed to capture the effects of systematic errors that lead to large discrepancies between some data sets. Specifically, for the purposes of Bayesian inference, each of the parametric cross section models is augmented with a Gaussian process representing systematic measurement errors as well as model inadequacies in the parametric form. The results show that the method is able to capture scatter in the data between the electron-beam experiments and ab-initio quantum simulations. The calibrated cross section models are further validated against measurements from swarm-parameter experiments.


title: On P=NP Either False or Independent of ZFC

abstract: Our main result, Theorem 3.3, uses Friedman's Jump Free Theorem, Theorem 2.7, which he has shown to be independent of ZFC, the usual axioms of set theory. We conjecture that Theorem 3.3, a straight forward translation of the statement of Theorem 2.7 into sets and functions, is also independent of ZFC as is its immediate Corollary 3.4. It is easy to show that a proof that P=NP will also prove Corollary 3.4. If Corollary 3.4 is in fact independent of ZFC then a ZFC proof of P=NP is impossible, perhaps because it is false.


title: SceneGraphLoc: Cross-Modal Coarse Visual Localization on 3D Scene Graphs

abstract: We introduce a novel problem, i.e., the localization of an input image within a multi-modal reference map represented by a database of 3D scene graphs. These graphs comprise multiple modalities, including object-level point clouds, images, attributes, and relationships between objects, offering a lightweight and efficient alternative to conventional methods that rely on extensive image databases. Given the available modalities, the proposed method SceneGraphLoc learns a fixed-sized embedding for each node (i.e., representing an object instance) in the scene graph, enabling effective matching with the objects visible in the input query image. This strategy significantly outperforms other cross-modal methods, even without incorporating images into the map embeddings. When images are leveraged, SceneGraphLoc achieves performance close to that of state-of-the-art techniques depending on large image databases, while requiring three orders-of-magnitude less storage and operating orders-of-magnitude faster. The code will be made public.


title: Classification of Short Segment Pediatric Heart Sounds Based on a Transformer-Based Convolutional Neural Network

abstract: Congenital anomalies arising as a result of a defect in the structure of the heart and great vessels are known as congenital heart diseases or CHDs. A PCG can provide essential details about the mechanical conduction system of the heart and point out specific patterns linked to different kinds of CHD. This study aims to investigate the minimum signal duration required for the automatic classification of heart sounds. This study also investigated the optimum signal quality assessment indicator (Root Mean Square of Successive Differences) RMSSD and (Zero Crossings Rate) ZCR value. Mel-frequency cepstral coefficients (MFCCs) based feature is used as an input to build a Transformer-Based residual one-dimensional convolutional neural network, which is then used for classifying the heart sound. The study showed that 0.4 is the ideal threshold for getting suitable signals for the RMSSD and ZCR indicators. Moreover, a minimum signal length of 5s is required for effective heart sound classification. It also shows that a shorter signal (3 s heart sound) does not have enough information to categorize heart sounds accurately, and the longer signal (15 s heart sound) may contain more noise. The best accuracy, 93.69%, is obtained for the 5s signal to distinguish the heart sound.


title: Score-Based Diffusion Models for Photoacoustic Tomography Image Reconstruction

abstract: Photoacoustic tomography (PAT) is a rapidly-evolving medical imaging modality that combines optical absorption contrast with ultrasound imaging depth. One challenge in PAT is image reconstruction with inadequate acoustic signals due to limited sensor coverage or due to the density of the transducer array. Such cases call for solving an ill-posed inverse reconstruction problem. In this work, we use score-based diffusion models to solve the inverse problem of reconstructing an image from limited PAT measurements. The proposed approach allows us to incorporate an expressive prior learned by a diffusion model on simulated vessel structures while still being robust to varying transducer sparsity conditions.


title: Chaotic dynamics under the influence of synthetic magnetic field in optomechanical system

abstract: The optomechanical systems produce chaotic behaviour due to nonlinear interaction between photons and phonons, and the same systems are used to understand the synthetic fields as well. Here, we report on the study of chaotic behaviour in the presence of a phononic synthetic magnetic field in a closed loop configuration consisting of a single optical mode and two mechanical modes. The modulation phase of the mechanical coupling between the two mechanical modes plays a critical role in determining the mechanical and optical intensity dynamics in the nonlinear regime. Our study shows the dark mode breaking effect in the presence of a synthetic magnetic field, which brings about a complex way of mechanical energy exchange that causes the cavity field to alternate between chaotic and regular behaviour periodically in temporal domain. However in the stronger nonlinear regime the temporal dynamics demonstrate predominantly chaotic behaviour. Besides, with the advent of advanced fabrication technologies, this study holds promises in developing phase tunable integrated low-power chaotic light sources to support efficient optical secure communication systems.


title: Privacy Backdoors: Stealing Data with Corrupted Pretrained Models

abstract: Practitioners commonly download pretrained machine learning models from open repositories and finetune them to fit specific applications. We show that this practice introduces a new risk of privacy backdoors. By tampering with a pretrained model's weights, an attacker can fully compromise the privacy of the finetuning data. We show how to build privacy backdoors for a variety of models, including transformers, which enable an attacker to reconstruct individual finetuning samples, with a guaranteed success! We further show that backdoored models allow for tight privacy attacks on models trained with differential privacy (DP). The common optimistic practice of training DP models with loose privacy guarantees is thus insecure if the model is not trusted. Overall, our work highlights a crucial and overlooked supply chain attack on machine learning privacy.


title: Linguistic Calibration of Long-Form Generations

abstract: Language models (LMs) may lead their users to make suboptimal downstream decisions when they confidently hallucinate. This issue can be mitigated by having the LM verbally convey the probability that its claims are correct, but existing models cannot produce long-form text with calibrated confidence statements. Through the lens of decision-making, we define linguistic calibration for long-form generations: an LM is linguistically calibrated if its generations enable its users to make calibrated probabilistic predictions. This definition enables a training framework where a supervised finetuning step bootstraps an LM to emit long-form generations with confidence statements such as "I estimate a 30% chance of..." or "I am certain that...", followed by a reinforcement learning step which rewards generations that enable a user to provide calibrated answers to related questions. We linguistically calibrate Llama 2 7B and find in automated and human evaluations of long-form generations that it is significantly more calibrated than strong finetuned factuality baselines with comparable accuracy. These findings generalize under significant domain shifts to scientific and biomedical questions and to an entirely held-out person biography generation task. Our results demonstrate that long-form generations may be calibrated end-to-end by constructing an objective in the space of the predictions that users make in downstream decision-making.


title: Shill-Proof Auctions

abstract: In a single-item auction, a duplicitous seller may masquerade as one or more bidders in order to manipulate the clearing price. This paper characterizes auction formats that are shill-proof: a profit-maximizing seller has no incentive to submit any shill bids. We distinguish between strong shill-proofness, in which a seller with full knowledge of bidders' valuations can never profit from shilling, and weak shill-proofness, which requires only that the expected equilibrium profit from shilling is nonpositive. The Dutch auction (with suitable reserve) is the unique optimal and strongly shill-proof auction. Moreover, the Dutch auction (with no reserve) is the unique prior-independent auction that is both efficient and weakly shill-proof. While there are a multiplicity of strategy-proof, weakly shill-proof, and optimal auctions; any optimal auction can satisfy only two properties in the set {static, strategy-proof, weakly shill-proof}.


title: Coordinate versus momentum cuts and effects of collective flow on critical fluctuations

abstract: We analyze particle number fluctuations in the crossover region near the critical endpoint of a first-order phase transition by utilizing molecular dynamics simulations of the classical Lennard-Jones fluid. We extend our previous study [V.A. Kuznietsov et al., Phys. Rev. C 105, 044903 (2022)] by incorporating longitudinal collective flow. The scaled variance of particle number distribution inside different coordinate and momentum space acceptances is computed through ensemble averaging and found to agree with earlier results obtained using time averaging, validating the ergodic hypothesis for fluctuation observables. Presence of a sizable collective flow is found to be essential for observing large fluctuations from the critical point in momentum space acceptances. We discuss our findings in the context of heavy-ion collisions.


title: DE-HNN: An effective neural model for Circuit Netlist representation

abstract: The run-time for optimization tools used in chip design has grown with the complexity of designs to the point where it can take several days to go through one design cycle which has become a bottleneck. Designers want fast tools that can quickly give feedback on a design. Using the input and output data of the tools from past designs, one can attempt to build a machine learning model that predicts the outcome of a design in significantly shorter time than running the tool. The accuracy of such models is affected by the representation of the design data, which is usually a netlist that describes the elements of the digital circuit and how they are connected. Graph representations for the netlist together with graph neural networks have been investigated for such models. However, the characteristics of netlists pose several challenges for existing graph learning frameworks, due to the large number of nodes and the importance of long-range interactions between nodes. To address these challenges, we represent the netlist as a directed hypergraph and propose a Directional Equivariant Hypergraph Neural Network (DE-HNN) for the effective learning of (directed) hypergraphs. Theoretically, we show that our DE-HNN can universally approximate any node or hyperedge based function that satisfies certain permutation equivariant and invariant properties natural for directed hypergraphs. We compare the proposed DE-HNN with several State-of-the-art (SOTA) machine learning models for (hyper)graphs and netlists, and show that the DE-HNN significantly outperforms them in predicting the outcome of optimized place-and-route tools directly from the input netlists. Our source code and the netlists data used are publicly available at https://github.com/YusuLab/chips.git


title: Forensic Scientometrics -- An emerging discipline to protect the scholarly record

abstract: Forensic Scientometrics (FoSci) is emerging as a vital discipline at the intersection of scientific integrity and security. Scholarship and scholarly communication are critical for maintaining scientific integrity, influencing public trust in science, health, technology, policy, and law. Yet, these foundations are threatened by the misuse of scientific research for personal, commercial, ideological, and geopolitical gains, including questionable practices and misconduct. The rise of paper mills and predatory publishers, along with ideological and geopolitical motivations, undermines academic integrity. This field pioneers the integration of traditional scientometric methods with ethics to address pressing challenges in research integrity and security, crucial in an era of heightened scrutiny over science's reliability. FoSci's development signifies a collective commitment to maintaining scientific trust, marked by a call for official recognition and support from stakeholders across the scientific ecosystem.


title: Sharp regularity estimates for $0$-order $p$-Laplacian evolution problems

abstract: We study regularity properties of solutions to nonlinear and nonlocal evolution problems driven by the so-called \emph{$0$-order fractional $p-$Laplacian} type operators: $$ \partial_t u(x,t)=\mathcal{J}_p u(x,t):=\int_{\mathbb{R}^n} J(x-y)|u(y,t)-u(x,t)|^{p-2}(u(y,t)-u(x,t))\,dy\,, $$ where $n\ge 1$, $p>1$, $J\colon\mathbb{R}^n\to\mathbb{R}$ is a bounded nonnegative function with compact support, $J(0)>0$ and normalized such that $\|J\|_{\mathrm{L}^1(\mathbb{R}^n)}=1$, but not necessarily smooth. We deal with Cauchy problems on the whole space, and with Dirichlet and Neumann problems on bounded domains. Beside complementing the existing results about existence and uniqueness theory, we focus on sharp regularity results in the whole range $p\in (1,\infty)$. When $p>2$, we find an unexpected $\mathrm{L}^q-\mathrm{L}^\infty$ regularization: the surprise comes from the fact that this result is false in the linear case $p=2$. We show next that bounded solutions automatically gain higher time regularity, more precisely that $u(x,\cdot)\in C^p_t$. We finally show that solutions preserve the regularity of the initial datum up to certain order, that we conjecture to be optimal ($p$-derivatives in space). When $p>1$ is integer we can reach $C^\infty$ regularity (gained in time, preserved in space) and even analyticity in time. The regularity estimates that we obtain are quantitative and constructive (all computable constants), and have a local character, allowing us to show further properties of the solutions: for instance, initial singularities do not move with time. We also study the asymptotic behavior for large times of solutions to Dirichlet and Neumann problems. Our results are new also in the linear case and are sharp when $p$ is integer. We expect them to be optimal for all $p>1$, supporting this claim with some numerical simulations.


title: A New Thermodynamic Approach to Multimode Fibre Self-cleaning and Soliton Condensation

abstract: A new thermodynamic theory for optical multimode systems is proposed. Theory is based on a weighted Bose-Einstein law, and includes the state equation, the fundamental equation for the entropy and a metric to measure the accuracy of the thermodynamic approach. The theory is used to compare the experimental results of two propagation regimes in multimode fibres, specifically the self-cleaning in the normal chromatic dispersion region and the soliton condensation in the anomalous dispersion region. Surprising similarities are found in terms of thermodynamic parameters, suggesting a common basis for the thermalisation processes observed in the two propagation regimes.


title: Convolutional Bayesian Filtering

abstract: Bayesian filtering serves as the mainstream framework of state estimation in dynamic systems. Its standard version utilizes total probability rule and Bayes' law alternatively, where how to define and compute conditional probability is critical to state distribution inference. Previously, the conditional probability is assumed to be exactly known, which represents a measure of the occurrence probability of one event, given the second event. In this paper, we find that by adding an additional event that stipulates an inequality condition, we can transform the conditional probability into a special integration that is analogous to convolution. Based on this transformation, we show that both transition probability and output probability can be generalized to convolutional forms, resulting in a more general filtering framework that we call convolutional Bayesian filtering. This new framework encompasses standard Bayesian filtering as a special case when the distance metric of the inequality condition is selected as Dirac delta function. It also allows for a more nuanced consideration of model mismatch by choosing different types of inequality conditions. For instance, when the distance metric is defined in a distributional sense, the transition probability and output probability can be approximated by simply rescaling them into fractional powers. Under this framework, a robust version of Kalman filter can be constructed by only altering the noise covariance matrix, while maintaining the conjugate nature of Gaussian distributions. Finally, we exemplify the effectiveness of our approach by reshaping classic filtering algorithms into convolutional versions, including Kalman filter, extended Kalman filter, unscented Kalman filter and particle filter.


title: Cross-lingual Named Entity Corpus for Slavic Languages

abstract: This paper presents a corpus manually annotated with named entities for six Slavic languages - Bulgarian, Czech, Polish, Slovenian, Russian, and Ukrainian. This work is the result of a series of shared tasks, conducted in 2017-2023 as a part of the Workshops on Slavic Natural Language Processing. The corpus consists of 5 017 documents on seven topics. The documents are annotated with five classes of named entities. Each entity is described by a category, a lemma, and a unique cross-lingual identifier. We provide two train-tune dataset splits - single topic out and cross topics. For each split, we set benchmarks using a transformer-based neural network architecture with the pre-trained multilingual models - XLM-RoBERTa-large for named entity mention recognition and categorization, and mT5-large for named entity lemmatization and linking.


title: Chromomagnetic dipole moments of light quarks in the Bestest Little Higgs Model

abstract: In this paper, we research into the anomalous Chromomagnetic Dipole Moment (CMDM), denoted as $\hat{\mu}_{q}^{BLHM}$, of the light quarks $q=(u, c, d, s, b)$ within the framework of the Bestest Little Higgs Model (BLHM) as an extension of the Standard Model (SM). Our investigation encompasses novel interactions among the light quarks, the heavy quark $B$, and the heavy bosons $(W^{\prime\pm}, H^{\pm}, \phi^{\pm}, \eta^{\pm})$, incorporating the extended Cabibbo-Kobayashi-Maskawa (CKM) matrix characteristic of the BLHM. We thoroughly explore the permissible parameter space, yielding a spectrum of CMDM values ranging from $10^{-10}$ to $10^{-3}$.


title: Edinburgh Clinical NLP at SemEval-2024 Task 2: Fine-tune your model unless you have access to GPT-4

abstract: The NLI4CT task assesses Natural Language Inference systems in predicting whether hypotheses entail or contradict evidence from Clinical Trial Reports. In this study, we evaluate various Large Language Models (LLMs) with multiple strategies, including Chain-of-Thought, In-Context Learning, and Parameter-Efficient Fine-Tuning (PEFT). We propose a PEFT method to improve the consistency of LLMs by merging adapters that were fine-tuned separately using triplet and language modelling objectives. We found that merging the two PEFT adapters improves the F1 score (+0.0346) and consistency (+0.152) of the LLMs. However, our novel methods did not produce more accurate results than GPT-4 in terms of faithfulness and consistency. Averaging the three metrics, GPT-4 ranks joint-first in the competition with 0.8328. Finally, our contamination analysis with GPT-4 indicates that there was no test data leakage.


title: DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humans

abstract: We present DiffHuman, a probabilistic method for photorealistic 3D human reconstruction from a single RGB image. Despite the ill-posed nature of this problem, most methods are deterministic and output a single solution, often resulting in a lack of geometric detail and blurriness in unseen or uncertain regions. In contrast, DiffHuman predicts a probability distribution over 3D reconstructions conditioned on an input 2D image, which allows us to sample multiple detailed 3D avatars that are consistent with the image. DiffHuman is implemented as a conditional diffusion model that denoises pixel-aligned 2D observations of an underlying 3D shape representation. During inference, we may sample 3D avatars by iteratively denoising 2D renders of the predicted 3D representation. Furthermore, we introduce a generator neural network that approximates rendering with considerably reduced runtime (55x speed up), resulting in a novel dual-branch diffusion framework. Our experiments show that DiffHuman can produce diverse and detailed reconstructions for the parts of the person that are unseen or uncertain in the input image, while remaining competitive with the state-of-the-art when reconstructing visible surfaces.


title: Dialectical Alignment: Resolving the Tension of 3H and Security Threats of LLMs

abstract: With the rise of large language models (LLMs), ensuring they embody the principles of being helpful, honest, and harmless (3H), known as Human Alignment, becomes crucial. While existing alignment methods like RLHF, DPO, etc., effectively fine-tune LLMs to match preferences in the preference dataset, they often lead LLMs to highly receptive human input and external evidence, even when this information is poisoned. This leads to a tendency for LLMs to be Adaptive Chameleons when external evidence conflicts with their parametric memory. This exacerbates the risk of LLM being attacked by external poisoned data, which poses a significant security risk to LLM system applications such as Retrieval-augmented generation (RAG). To address the challenge, we propose a novel framework: Dialectical Alignment (DA), which (1) utilizes AI feedback to identify optimal strategies for LLMs to navigate inter-context conflicts and context-memory conflicts with different external evidence in context window (i.e., different ratios of poisoned factual contexts); (2) constructs the SFT dataset as well as the preference dataset based on the AI feedback and strategies above; (3) uses the above datasets for LLM alignment to defense poisoned context attack while preserving the effectiveness of in-context knowledge editing. Our experiments show that the dialectical alignment model improves poisoned data attack defense by 20 and does not require any additional prompt engineering or prior declaration of ``you may be attacked`` to the LLMs' context window.


title: Contextual AI Journaling: Integrating LLM and Time Series Behavioral Sensing Technology to Promote Self-Reflection and Well-being using the MindScape App

abstract: MindScape aims to study the benefits of integrating time series behavioral patterns (e.g., conversational engagement, sleep, location) with Large Language Models (LLMs) to create a new form of contextual AI journaling, promoting self-reflection and well-being. We argue that integrating behavioral sensing in LLMs will likely lead to a new frontier in AI. In this Late-Breaking Work paper, we discuss the MindScape contextual journal App design that uses LLMs and behavioral sensing to generate contextual and personalized journaling prompts crafted to encourage self-reflection and emotional development. We also discuss the MindScape study of college students based on a preliminary user study and our upcoming study to assess the effectiveness of contextual AI journaling in promoting better well-being on college campuses. MindScape represents a new application class that embeds behavioral intelligence in AI.


title: Noise-Aware Training of Layout-Aware Language Models

abstract: A visually rich document (VRD) utilizes visual features along with linguistic cues to disseminate information. Training a custom extractor that identifies named entities from a document requires a large number of instances of the target document type annotated at textual and visual modalities. This is an expensive bottleneck in enterprise scenarios, where we want to train custom extractors for thousands of different document types in a scalable way. Pre-training an extractor model on unlabeled instances of the target document type, followed by a fine-tuning step on human-labeled instances does not work in these scenarios, as it surpasses the maximum allowable training time allocated for the extractor. We address this scenario by proposing a Noise-Aware Training method or NAT in this paper. Instead of acquiring expensive human-labeled documents, NAT utilizes weakly labeled documents to train an extractor in a scalable way. To avoid degradation in the model's quality due to noisy, weakly labeled samples, NAT estimates the confidence of each training sample and incorporates it as uncertainty measure during training. We train multiple state-of-the-art extractor models using NAT. Experiments on a number of publicly available and in-house datasets show that NAT-trained models are not only robust in performance -- it outperforms a transfer-learning baseline by up to 6% in terms of macro-F1 score, but it is also more label-efficient -- it reduces the amount of human-effort required to obtain comparable performance by up to 73%.


title: PROMPT-SAW: Leveraging Relation-Aware Graphs for Textual Prompt Compression

abstract: Large language models (LLMs) have shown exceptional abilities for multiple different natural language processing tasks. While prompting is a crucial tool for LLM inference, we observe that there is a significant cost associated with exceedingly lengthy prompts. Existing attempts to compress lengthy prompts lead to sub-standard results in terms of readability and interpretability of the compressed prompt, with a detrimental impact on prompt utility. To address this, we propose PROMPT-SAW: Prompt compresSion via Relation AWare graphs, an effective strategy for prompt compression over task-agnostic and task-aware prompts. PROMPT-SAW uses the prompt's textual information to build a graph, later extracts key information elements in the graph to come up with the compressed prompt. We also propose GSM8K-AUG, i.e., an extended version of the existing GSM8k benchmark for task-agnostic prompts in order to provide a comprehensive evaluation platform. Experimental evaluation using benchmark datasets shows that prompts compressed by PROMPT-SAW are not only better in terms of readability, but they also outperform the best-performing baseline models by up to 14.3 and 13.7 respectively for task-aware and task-agnostic settings while compressing the original prompt text by 33.0 and 56.7.


title: Is the geography of Heegaard Floer homology restricted or the $L$-space conjecture false?

abstract: In a recent note F. Lin showed that if a rational homology sphere $Y$ admits a taut foliation then the Heegaard Floer module $HF^-(Y)$ contains a copy of $\mathbf{F}[U]/U$ as a summand (arXiv:2309.01222). This implies that either the $L$-space conjecture is false or that Heegaard Floer homology satisfies a geography restriction. We verify that Lin's geography restriction holds for a wide class of rational homology spheres. Indeed, we show that the Heegaard Floer module $HF^-(Y)$ may satisfy a stronger geography restriction.


title: Denoising Monte Carlo Renders With Diffusion Models

abstract: Physically-based renderings contain Monte-Carlo noise, with variance that increases as the number of rays per pixel decreases. This noise, while zero-mean for good modern renderers, can have heavy tails (most notably, for scenes containing specular or refractive objects). Learned methods for restoring low fidelity renders are highly developed, because suppressing render noise means one can save compute and use fast renders with few rays per pixel. We demonstrate that a diffusion model can denoise low fidelity renders successfully. Furthermore, our method can be conditioned on a variety of natural render information, and this conditioning helps performance. Quantitative experiments show that our method is competitive with SOTA across a range of sampling rates, but current metrics slightly favor competitor methods. Qualitative examination of the reconstructions suggests that the metrics themselves may not be reliable. The image prior applied by a diffusion method strongly favors reconstructions that are "like" real images -- so have straight shadow boundaries, curved specularities, no "fireflies" and the like -- and metrics do not account for this. We show numerous examples where methods preferred by current metrics produce qualitatively weaker reconstructions than ours.


title: Multi-hop Question Answering under Temporal Knowledge Editing

abstract: Multi-hop question answering (MQA) under knowledge editing (KE) has garnered significant attention in the era of large language models. However, existing models for MQA under KE exhibit poor performance when dealing with questions containing explicit temporal contexts. To address this limitation, we propose a novel framework, namely TEMPoral knowLEdge augmented Multi-hop Question Answering (TEMPLE-MQA). Unlike previous methods, TEMPLE-MQA first constructs a time-aware graph (TAG) to store edit knowledge in a structured manner. Then, through our proposed inference path, structural retrieval, and joint reasoning stages, TEMPLE-MQA effectively discerns temporal contexts within the question query. Experiments on benchmark datasets demonstrate that TEMPLE-MQA significantly outperforms baseline models. Additionally, we contribute a new dataset, namely TKEMQA, which serves as the inaugural benchmark tailored specifically for MQA with temporal scopes.


title: The slope of v-function and Waldschmidt constant

abstract: In this paper, we study the asymptotic behaviour of the v-number of a Noetherian graded filtration $\mathcal{I}= \{I_{[k]}\}_{k\geq 0}$ of a Noetherian $\mathbb{N}$-graded domain $R$. Recently, it is shown that $\mathrm{v}(I_{[k]})$ is periodically linear in $k$ for $k \gg 0$. We show that all these linear functions have the same slope, i.e. $\displaystyle \lim_{k \rightarrow \infty}\frac{\mathrm{v}(I_{[k]})}{k}$ exists, which is equal to $\displaystyle \lim_{k \rightarrow \infty}\frac{\alpha(I_{[k]})}{k}$, where $\alpha(I)$ denotes the minimum degree of a non-zero element in $I$. In particular, for any Noetherian symbolic filtration $\mathcal{I}= \{I^{(k)}\}_{k\geq 0}$ of $R$, it follows that $\displaystyle \lim_{k \rightarrow \infty}\frac{\mathrm{v}(I^{(k)})}{k}=\hat{\alpha}(I)$, the Waldschmidt constant of $I$. Next, for a non-equigenerated square-free monomial ideal $I$, we prove that $\mathrm{v}(I^{(k)}) \leq \mathrm{reg}(R/I^{(k)})$ for $k\gg 0$. Also, for an ideal $I$ having the symbolic strong persistence property, we give a linear upper bound on $\mathrm{v}(I^{(k)})$. As an application, we derive some criteria for a square-free monomial ideal $I$ to satisfy $\mathrm{v}(I^{(k)})\leq \mathrm{reg}(R/I^{(k)})$ for all $k\geq 1$, and provide several examples in support. In addition, for any simple graph $G$, we establish that $\mathrm{v}(J(G)^{(k)}) \leq \mathrm{reg}(R/J(G)^{(k)})$ for all $k \geq 1$, and $\mathrm{v}(J(G)^{(k)}) = \mathrm{reg}(R/J(G)^{(k)})=\alpha(J(G)^{(k)})-1$ for all $k\geq 1$ if and only if $G$ is a Cohen-Macaulay very-well covered graph, where $J(G)$ is the cover ideal of $G$.