title: RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning

abstract: Pre-trained language models, trained on large-scale corpora, demonstrate strong generalizability across various NLP tasks. Fine-tuning these models for specific tasks typically involves updating all parameters, which is resource-intensive. Parameter-efficient fine-tuning (PEFT) methods, such as the popular LoRA family, introduce low-rank matrices to learn only a few parameters efficiently. However, during inference, the product of these matrices updates all pre-trained parameters, complicating tasks like knowledge editing that require selective updates. We propose a novel PEFT method, which conducts \textbf{r}ow and c\textbf{o}lumn-wise spar\textbf{se} \textbf{lo}w-\textbf{r}ank \textbf{a}daptation (RoseLoRA), to address this challenge. RoseLoRA identifies and updates only the most important parameters for a specific task, maintaining efficiency while preserving other model knowledge. By adding a sparsity constraint on the product of low-rank matrices and converting it to row and column-wise sparsity, we ensure efficient and precise model updates. Our theoretical analysis guarantees the lower bound of the sparsity with respective to the matrix product. Extensive experiments on five benchmarks across twenty datasets demonstrate that RoseLoRA outperforms baselines in both general fine-tuning and knowledge editing tasks.


title: Heterogeneous Entity Representation for Medicinal Synergy Prediction

abstract: Medicinal synergy prediction is a powerful tool in drug discovery and development that harnesses the principles of combination therapy to enhance therapeutic outcomes by improving efficacy, reducing toxicity, and preventing drug resistance. While a myriad of computational methods has emerged for predicting synergistic drug combinations, a large portion of them may overlook the intricate, yet critical relationships between various entities in drug interaction networks, such as drugs, cell lines, and diseases. These relationships are complex and multidimensional, requiring sophisticated modeling to capture nuanced interplay that can significantly influence therapeutic efficacy. We introduce a salient deep hypergraph learning method, namely, Heterogeneous Entity Representation for MEdicinal Synergy prediction (HERMES), to predict anti-cancer drug synergy. HERMES integrates heterogeneous data sources, encompassing drug, cell line, and disease information, to provide a comprehensive understanding of the interactions involved. By leveraging advanced hypergraph neural networks with gated residual mechanisms, HERMES can effectively learn complex relationships/interactions within the data. Our results show HERMES demonstrates state-of-the-art performance, particularly in forecasting new drug combinations, significantly surpassing previous methods. This advancement underscores the potential of HERMES to facilitate more effective and precise drug combination predictions, thereby enhancing the development of novel therapeutic strategies.


title: Quarkonium fragmentation in a variable-flavor number scheme: Towards NRFF1.0

abstract: We report progress on the determination and study of quarkonium production within the fragmentation approximation. Our analyses address the moderate and large transverse-momentum regime, where the collinear fragmentation of a single parton is expected to dominate over the short-distance production, directly from the hard scattering, of the constituent $(Q \bar{Q})$ system. Parton fragmentation channels to pseudoscalar and vector quarkonia are built on the basis of non-Relativistic QCD next-to-leading computations, which we use to model initial-scale fragmentation inputs. Thus, a preliminary family of Variable-Flavor Number-Scheme (VFNS) fragmentation functions, named NRFF1.0, are constructed through standard DGLAP evolution. Statistical uncertainties are obtained from a Monte Carlo, replica-like approach embodying missing higher-order uncertainties.


title: Colouring negative exact-distance graphs of signed graphs

abstract: The $k$-th exact-distance graph, of a graph $G$ has $V(G)$ as its vertex set, and $xy$ as an edge if and only if the distance between $x$ and $y$ is (exactly) $k$ in $G$. We consider two possible extensions of this notion for signed graphs. Finding the chromatic number of a negative exact-distance square of a signed graph is a weakening of the problem of finding the smallest target graph to which the signed graph has a sign-preserving homomorphism. We study the chromatic number of negative exact-distance graphs of signed graphs that are planar, and also the relation of these chromatic numbers with the generalised colouring numbers of the underlying graphs. Our results are related to a theorem of Alon and Marshall about homomorphisms of signed graphs.


title: Riesz capacity: monotonicity, continuity, diameter and volume

abstract: Properties of Riesz capacity are developed with respect to the kernel exponent $p \in (-\infty,n)$, namely that capacity is monotonic as a function of $p$, that its endpoint limits recover the diameter and volume of the set, and that capacity is left-continuous with respect to $p$ and is right-continuous provided (when $p \geq 0$) that an additional hypothesis holds. Left and right continuity properties of the equilibrium measure are obtained too.


title: On bifurcation and spectral instability of asymptotic quasinormal modes in the modified P\"oschl-Teller effective potential

abstract: The P\"ochl-Teller effective potential mimics an asymptotically de Sitter black hole bounded by an event horizon and a cosmological one. Owing to the benefit of being analytically soluble, the asymptotic quasinormal modes in the modified P\"oschl-Teller potential have been extensively explored in the literature by various authors, and the results bear distinct features. Specifically, for small discontinuities placed at the potential's peak, Skakala and Visser showed that the resulting modes lie primarily along the imaginary frequency axis, in line with the numerical results encountered for most black hole metrics. However, it was also suggested that under ultraviolet perturbations, asymptotic modes are expected to lie parallel to the real axis, closely intervening with recent developments on spectral instability. In this work, by numerical and semi-analytical approaches, we aim to resolve the above apparent ambiguity. The numerical scheme is based on an improved version of the matrix method, which is implemented in compactified hyperboloidal coordinates on the Chebyshev grid. It is demonstrated that both asymptotic behaviors indeed agree with the numerical findings, which is somewhat to one's surprise. Specifically, we report the emergence of a novel branch of purely imaginary modes originating from a bifurcation in the asymptotic quasinormal mode spectrum. Moreover, we demonstrate how the bifurcation and asymptotic modes evolve as the discontinuity moves away from the potential's peak, furnishing a dynamic picture as the spectral instability unfolds. It is further argued that they can be partly attributed to the observed parity-dependent deviations occurring for the low-lying perturbed modes of the original P\"oschl-Teller effective potential.


title: Odd-even mass differences of well and rigidly deformed nuclei in the rare earth region: A test of a newly proposed fit of pairing matrix elements

abstract: We discuss a test of a recently proposed approach to determine average pairing matrix elements within a given interval of single-particle states (sp) around the Fermi level $\lambda$ as obtained in the so-called uniform gap method (UGM). It takes stock of the crucial role played by the averaged sp level density $\tilde{\rho}(e)$. These matrix elements are deduced within the UGM approach, from microscopically calculated $\tilde{\rho}(e)$ and gaps obtained from analytical formulae of a semi-classical nature. Two effects generally ignored in similar fits have been taken care of. They are: (a) the correction for a systematic bias in choosing to fit pairing gaps corresponding to equilibrium deformation solutions as discussed by M\"{o}ller and Nix [Nucl. Phys. A 476, 1 (1992)] and (b) the correction for a systematic spurious enhancement of $\tilde{\rho}(e)$ for protons in the vicinity of $\lambda$, because of the local Slater approximation used for the treatment of the Coulomb exchange terms in most calculations (see e.g. [Phys. Rev C 84, 014310 (2011)]). This approach has been deemed to be very efficient upon performing Hartree-Fock + BCS (with seniority force and self-consistent blocking when dealing with odd nuclei) calculations of a large sample of well and rigidly deformed even-even rare-earth nuclei. The reproduction of their experimental moments of inertia has been found to be at least of the same quality as what has been obtained in a direct fit of these data [Phys. Rev C 99, 064306 (2019)]. We extend here the test of our approach to the reproduction, in the same region, of three-point odd-even mass differences centered on odd-$N$ or odd-$Z$ nuclei. The agreement with the data is again roughly of the same quality as what has been obtained in a direct fit, as performed in [Phys. Rev C 99, 064306 (2019)].


title: Braid Group Action and Quantum Queer Superalgebra

abstract: In this paper, we present explicit actions of braid group on the universal enveloping superalgebra ${\boldsymbol U}(\mathfrak{{q}}_n)$ and the quantum queer superalgebra ${\boldsymbol U}_{\!{v}}(\mathfrak{{q}}_{n})$. Then we provide a new definition of root vectors and some explicit expression for them. With these procedures, we obtain the PBW-type basis containing the product of root vectors.


title: ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank Adaptation

abstract: This study introduces an approach to optimize Parameter Efficient Fine Tuning (PEFT) for Pretrained Language Models (PLMs) by implementing a Shared Low Rank Adaptation (ShareLoRA). By strategically deploying ShareLoRA across different layers and adapting it for the Query, Key, and Value components of self-attention layers, we achieve a substantial reduction in the number of training parameters and memory usage. Importantly, ShareLoRA not only maintains model performance but also exhibits robustness in both classification and generation tasks across a variety of models, including RoBERTa, GPT-2, LLaMA and LLaMA2. It demonstrates superior transfer learning capabilities compared to standard LoRA applications and mitigates overfitting by sharing weights across layers. Our findings affirm that ShareLoRA effectively boosts parameter efficiency while ensuring scalable and high-quality performance across different language model architectures.


title: Evaluating LLMs with Multiple Problems at once: A New Paradigm for Probing LLM Capabilities

abstract: Current LLM evaluation predominantly performs evaluation with prompts comprising single problems. We propose multi-problem evaluation as an additional approach to study the multiple problem handling capabilities of LLMs. We present a systematic study in this regard by comprehensively examining 7 LLMs on 4 related types of tasks constructed from 6 classification benchmarks. The 4 task types include traditional single-problem tasks, homogeneous multi-problem tasks, and two index selection tasks that embed the multi-problem tasks. We find that LLMs are competent multi-problem solvers: they generally perform (nearly) as well on multi-problem tasks as on single-problem tasks. Furthermore, contrary to common expectation, they often do not suffer from a positional bias with long inputs. This makes multi-problem prompting a simple and cost-efficient prompting method of practical significance. However, our results also strongly indicate that LLMs lack true understanding: they perform significantly worse in the two index selection tasks than in the multi-problem task under various evaluation settings, although they can indeed do index selection in general.


title: Evidential Uncertainty Sets in Deep Classifiers Using Conformal Prediction

abstract: In this paper, we propose Evidential Conformal Prediction (ECP) method for image classifiers to generate the conformal prediction sets. Our method is designed based on a non-conformity score function that has its roots in Evidential Deep Learning (EDL) as a method of quantifying model (epistemic) uncertainty in DNN classifiers. We use evidence that are derived from the logit values of target labels to compute the components of our non-conformity score function: the heuristic notion of uncertainty in CP, uncertainty surprisal, and expected utility. Our extensive experimental evaluation demonstrates that ECP outperforms three state-of-the-art methods for generating CP sets, in terms of their set sizes and adaptivity while maintaining the coverage of true labels.


title: Physically Embodied Gaussian Splatting: A Realtime Correctable World Model for Robotics

abstract: For robots to robustly understand and interact with the physical world, it is highly beneficial to have a comprehensive representation - modelling geometry, physics, and visual observations - that informs perception, planning, and control algorithms. We propose a novel dual Gaussian-Particle representation that models the physical world while (i) enabling predictive simulation of future states and (ii) allowing online correction from visual observations in a dynamic world. Our representation comprises particles that capture the geometrical aspect of objects in the world and can be used alongside a particle-based physics system to anticipate physically plausible future states. Attached to these particles are 3D Gaussians that render images from any viewpoint through a splatting process thus capturing the visual state. By comparing the predicted and observed images, our approach generates visual forces that correct the particle positions while respecting known physical constraints. By integrating predictive physical modelling with continuous visually-derived corrections, our unified representation reasons about the present and future while synchronizing with reality. Our system runs in realtime at 30Hz using only 3 cameras. We validate our approach on 2D and 3D tracking tasks as well as photometric reconstruction quality. Videos are found at https://embodied-gaussians.github.io/.


title: Learning Traffic Crashes as Language: Datasets, Benchmarks, and What-if Causal Analyses

abstract: The increasing rate of road accidents worldwide results not only in significant loss of life but also imposes billions financial burdens on societies. Current research in traffic crash frequency modeling and analysis has predominantly approached the problem as classification tasks, focusing mainly on learning-based classification or ensemble learning methods. These approaches often overlook the intricate relationships among the complex infrastructure, environmental, human and contextual factors related to traffic crashes and risky situations. In contrast, we initially propose a large-scale traffic crash language dataset, named CrashEvent, summarizing 19,340 real-world crash reports and incorporating infrastructure data, environmental and traffic textual and visual information in Washington State. Leveraging this rich dataset, we further formulate the crash event feature learning as a novel text reasoning problem and further fine-tune various large language models (LLMs) to predict detailed accident outcomes, such as crash types, severity and number of injuries, based on contextual and environmental factors. The proposed model, CrashLLM, distinguishes itself from existing solutions by leveraging the inherent text reasoning capabilities of LLMs to parse and learn from complex, unstructured data, thereby enabling a more nuanced analysis of contributing factors. Our experiments results shows that our LLM-based approach not only predicts the severity of accidents but also classifies different types of accidents and predicts injury outcomes, all with averaged F1 score boosted from 34.9% to 53.8%. Furthermore, CrashLLM can provide valuable insights for numerous open-world what-if situational-awareness traffic safety analyses with learned reasoning features, which existing models cannot offer. We make our benchmark, datasets, and model public available for further exploration.


title: Periodic Orbits in Fermi-Pasta-Ulam-Tsingou Systems

abstract: The FPUT paradox is the phenomenon whereby a one-dimensional chain of oscillators with nonlinear couplings shows non-ergodic behavior. The trajectory of the system in phase space, with a long wavelength initial condition, closely follows that of the Toda model over short times, as both systems seem to relax quickly to a non-thermal, metastable state. Over longer times, resonances in the FPUT spectrum drive the system towards equilibrium, away from the Toda trajectory. Similar resonances are observed in $q$-breather spectra, suggesting that $q$-breathers are involved in the route towards thermalization. In this article we investigate such resonances and show that they occur due to exact overlaps of $q$-breather frequencies of the type $m\Omega_1 = \Omega_k$. The resonances appear as peaks in the energy spectrum. Further, they give rise to new composite periodic orbits, which exist simultaneously with the original $q$-breathers. We find that such resonances are absent in integrable systems, as a consequence of the (infinite number of) conservation laws associated with integrability.


title: Quantum Analogues for Two Simple Classical Channels

abstract: We present some of the peculiar dynamics of two simple sans-entanglement quantum communication channels in a digestible form. Specifically, we contrast the classical gaussian additive channel to its quantum analogue and find that the quantum version features a capacity with interesting time dependence and counterintuitive effects of quantization. We also consider a simple two-level system and comment on the time dependence of its capacity.


title: Data-Adaptive Identification of Subpopulations Vulnerable to Chemical Exposures using Stochastic Interventions

abstract: In environmental epidemiology, identifying subpopulations vulnerable to chemical exposures and those who may benefit differently from exposure-reducing policies is essential. For instance, sex-specific vulnerabilities, age, and pregnancy are critical factors for policymakers when setting regulatory guidelines. However, current semi-parametric methods for heterogeneous treatment effects are often limited to binary exposures and function as black boxes, lacking clear, interpretable rules for subpopulation-specific policy interventions. This study introduces a novel method using cross-validated targeted minimum loss-based estimation (TMLE) paired with a data-adaptive target parameter strategy to identify subpopulations with the most significant differential impact from simulated policy interventions that reduce exposure. Our approach is assumption-lean, allowing for the integration of machine learning while still yielding valid confidence intervals. We demonstrate the robustness of our methodology through simulations and application to NHANES data. Our analysis of NHANES data for persistent organic pollutants on leukocyte telomere length (LTL) identified age as the maximum effect modifier. Specifically, we found that exposure to 3,3',4,4',5-pentachlorobiphenyl (pcnb) consistently had a differential impact on LTL, with a one standard deviation reduction in exposure leading to a more pronounced increase in LTL among younger populations compared to older ones. We offer our method as an open-source software package, \texttt{EffectXshift}, enabling researchers to investigate the effect modification of continuous exposures. The \texttt{EffectXshift} package provides clear and interpretable results, informing targeted public health interventions and policy decisions.


title: Symplectic Extra-gradient Type Method for Solving General Non-monotone Inclusion Problem

abstract: In recent years, accelerated extra-gradient methods have attracted much attention by researchers, for solving monotone inclusion problems. A limitation of most current accelerated extra-gradient methods lies in their direct utilization of the initial point, which can potentially decelerate numerical convergence rate. In this work, we present a new accelerated extra-gradient method, by utilizing the symplectic acceleration technique. We establish the inverse of quadratic convergence rate by employing the Lyapunov function technique. Also, we demonstrate a faster inverse of quadratic convergence rate alongside its weak convergence property under stronger assumptions. To improve practical efficiency, we introduce a line search technique for our symplectic extra-gradient method. Theoretically, we prove the convergence of the symplectic extra-gradient method with line search. Numerical tests show that this adaptation exhibits faster convergence rates in practice compared to several existing extra-gradient type methods.


title: Towards Understanding Jailbreak Attacks in LLMs: A Representation Space Analysis

abstract: Large language models (LLMs) are susceptible to a type of attack known as jailbreaking, which misleads LLMs to output harmful contents. Although there are diverse jailbreak attack strategies, there is no unified understanding on why some methods succeed and others fail. This paper explores the behavior of harmful and harmless prompts in the LLM's representation space to investigate the intrinsic properties of successful jailbreak attacks. We hypothesize that successful attacks share some similar properties: They are effective in moving the representation of the harmful prompt towards the direction to the harmless prompts. We leverage hidden representations into the objective of existing jailbreak attacks to move the attacks along the acceptance direction, and conduct experiments to validate the above hypothesis using the proposed objective. We hope this study provides new insights into understanding how LLMs understand harmfulness information.


title: Improving Reward-Conditioned Policies for Multi-Armed Bandits using Normalized Weight Functions

abstract: Recently proposed reward-conditioned policies (RCPs) offer an appealing alternative in reinforcement learning. Compared with policy gradient methods, policy learning in RCPs is simpler since it is based on supervised learning, and unlike value-based methods, it does not require optimization in the action space to take actions. However, for multi-armed bandit (MAB) problems, we find that RCPs are slower to converge and have inferior expected rewards at convergence, compared with classic methods such as the upper confidence bound and Thompson sampling. In this work, we show that the performance of RCPs can be enhanced by constructing policies through the marginalization of rewards using normalized weight functions, whose sum or integral equal $1$, although the function values may be negative. We refer to this technique as generalized marginalization, whose advantage is that negative weights for policies conditioned on low rewards can make the resulting policies more distinct from them. Strategies to perform generalized marginalization in MAB with discrete action spaces are studied. Through simulations, we demonstrate that the proposed technique improves RCPs and makes them competitive with classic methods, showing superior performance on challenging MABs with large action spaces and sparse reward signals.


title: Diffusion Models Are Promising for Ab Initio Structure Solutions from Nanocrystalline Powder Diffraction Data

abstract: A major challenge in materials science is the determination of the structure of nanometer sized objects. Here we present a novel approach that uses a generative machine learning model based on a Diffusion model that is trained on 45,229 known structures. The model factors both the measured diffraction pattern as well as relevant statistical priors on the unit cell of atomic cluster structures. Conditioned only on the chemical formula and the information-scarce finite-size broadened powder diffraction pattern, we find that our model, PXRDnet, can successfully solve simulated nanocrystals as small as 10 angstroms across 200 materials of varying symmetry and complexity, including structures from all seven crystal systems. We show that our model can determine structural solutions with up to $81.5\%$ accuracy, as measured by structural correlation. Furthermore, PXRDnet is capable of solving structures from noisy diffraction patterns gathered in real-world experiments. We suggest that data driven approaches, bootstrapped from theoretical simulation, will ultimately provide a path towards determining the structure of previously unsolved nano-materials.

categories: physics.comp-ph cond-mat.mes-hall cs.AI cs.LG


title: STAR: Scale-wise Text-to-image generation via Auto-Regressive representations

abstract: We present STAR, a text-to-image model that employs scale-wise auto-regressive paradigm. Unlike VAR, which is limited to class-conditioned synthesis within a fixed set of predetermined categories, our STAR enables text-driven open-set generation through three key designs: To boost diversity and generalizability with unseen combinations of objects and concepts, we introduce a pre-trained text encoder to extract representations for textual constraints, which we then use as guidance. To improve the interactions between generated images and fine-grained textual guidance, making results more controllable, additional cross-attention layers are incorporated at each scale. Given the natural structure correlation across different scales, we leverage 2D Rotary Positional Encoding (RoPE) and tweak it into a normalized version. This ensures consistent interpretation of relative positions across token maps at different scales and stabilizes the training process. Extensive experiments demonstrate that STAR surpasses existing benchmarks in terms of fidelity,image text consistency, and aesthetic quality. Our findings emphasize the potential of auto-regressive methods in the field of high-quality image synthesis, offering promising new directions for the T2I field currently dominated by diffusion methods.


title: Federated Learning Optimization: A Comparative Study of Data and Model Exchange Strategies in Dynamic Networks

abstract: The promise and proliferation of large-scale dynamic federated learning gives rise to a prominent open question - is it prudent to share data or model across nodes, if efficiency of transmission and fast knowledge transfer are the prime objectives. This work investigates exactly that. Specifically, we study the choices of exchanging raw data, synthetic data, or (partial) model updates among devices. The implications of these strategies in the context of foundational models are also examined in detail. Accordingly, we obtain key insights about optimal data and model exchange mechanisms considering various environments with different data distributions and dynamic device and network connections. Across various scenarios that we considered, time-limited knowledge transfer efficiency can differ by up to 9.08\%, thus highlighting the importance of this work.


title: Toward a quantum field theoretical description of oscillation effects

abstract: In this paper, we propose an approach based on the theory of an axiomatic $S$ matrix and partially switching on an interaction, which is extremely suitable for describing the phenomenon of oscillations within the framework of quantum field theory. We discuss the relation of the proposed approach with other approaches based on considering of wave packets as asymptotic states or introducing of ``distance- or time-dependent propagators''.


title: Injectivity theorems and cubical descent for schemes, stacks, and analytic spaces

abstract: We prove relative injectivity, torsion-freeness, and vanishing theorems for generalized normal crossing pairs on schemes, algebraic stacks, formal schemes, semianalytic germs of complex analytic spaces, rigid analytic spaces, Berkovich spaces, and adic spaces locally of weakly finite type over a field, all in equal characteristic zero. We give a uniform proof for all these theorems in all the categories of spaces mentioned above, which were previously only known for varieties and complex analytic spaces due to work of Ambro and Fujino. Ambro and Fujino's results are integral in the proofs of the fundamental theorems of the minimal model program for (semi-)log canonical pairs and the theory of quasi-log structures. Our results resolve a significant barrier to extending these results on (semi-)log canonical pairs and quasi-log structures beyond the setting of varieties and complex analytic spaces. In order to prove our most general injectivity theorems, we generalize to all these categories of spaces a criterion due to Guill\'en and Navarro Aznar characterizing when functors defined on smooth varieties extend to all varieties. This extension result uses cubical hyperresolutions, which we construct in all categories of spaces mentioned above. Our extension result is very general and is of independent interest. We use this extension result to prove our injectivity theorems for generalized normal crossing pairs. We also apply our extension result to develop the theoretical foundations for the Deligne-Du Bois complex in these categories of spaces and to construct a weight filtration on the (pro-)\'etale cohomology of schemes and rigid analytic spaces. These results establish some aspects of Deligne-Hodge theory in all categories of spaces mentioned above.


title: Saliency-guided and Patch-based Mixup for Long-tailed Skin Cancer Image Classification

abstract: Medical image datasets often exhibit long-tailed distributions due to the inherent challenges in medical data collection and annotation. In long-tailed contexts, some common disease categories account for most of the data, while only a few samples are available in the rare disease categories, resulting in poor performance of deep learning methods. To address this issue, previous approaches have employed class re-sampling or re-weighting techniques, which often encounter challenges such as overfitting to tail classes or difficulties in optimization during training. In this work, we propose a novel approach, namely \textbf{S}aliency-guided and \textbf{P}atch-based \textbf{Mix}up (SPMix) for long-tailed skin cancer image classification. Specifically, given a tail-class image and a head-class image, we generate a new tail-class image by mixing them under the guidance of saliency mapping, which allows for preserving and augmenting the discriminative features of the tail classes without any interference of the head-class features. Extensive experiments are conducted on the ISIC2018 dataset, demonstrating the superiority of SPMix over existing state-of-the-art methods.


title: KGPA: Robustness Evaluation for Large Language Models via Cross-Domain Knowledge Graphs

abstract: Existing frameworks for assessing robustness of large language models (LLMs) overly depend on specific benchmarks, increasing costs and failing to evaluate performance of LLMs in professional domains due to dataset limitations. This paper proposes a framework that systematically evaluates the robustness of LLMs under adversarial attack scenarios by leveraging knowledge graphs (KGs). Our framework generates original prompts from the triplets of knowledge graphs and creates adversarial prompts by poisoning, assessing the robustness of LLMs through the results of these adversarial attacks. We systematically evaluate the effectiveness of this framework and its modules. Experiments show that adversarial robustness of the ChatGPT family ranks as GPT-4-turbo > GPT-4o > GPT-3.5-turbo, and the robustness of large language models is influenced by the professional domains in which they operate.


title: HiddenTables & PyQTax: A Cooperative Game and Dataset For TableQA to Ensure Scale and Data Privacy Across a Myriad of Taxonomies

abstract: A myriad of different Large Language Models (LLMs) face a common challenge in contextually analyzing table question-answering tasks. These challenges are engendered from (1) finite context windows for large tables, (2) multi-faceted discrepancies amongst tokenization patterns against cell boundaries, and (3) various limitations stemming from data confidentiality in the process of using external models such as gpt-3.5-turbo. We propose a cooperative game dubbed "HiddenTables" as a potential resolution to this challenge. In essence, "HiddenTables" is played between the code-generating LLM "Solver" and the "Oracle" which evaluates the ability of the LLM agents to solve Table QA tasks. This game is based on natural language schemas and importantly, ensures the security of the underlying data. We provide evidential experiments on a diverse set of tables that demonstrate an LLM's collective inability to generalize and perform on complex queries, handle compositional dependencies, and align natural language to programmatic commands when concrete table schemas are provided. Unlike encoder-based models, we have pushed the boundaries of "HiddenTables" to not be limited by the number of rows - therefore we exhibit improved efficiency in prompt and completion tokens. Our infrastructure has spawned a new dataset "PyQTax" that spans across 116,671 question-table-answer triplets and provides additional fine-grained breakdowns & labels for varying question taxonomies. Therefore, in tandem with our academic contributions regarding LLMs' deficiency in TableQA tasks, "HiddenTables" is a tactile manifestation of how LLMs can interact with massive datasets while ensuring data security and minimizing generation costs.


title: A Representation Theoretic Approach to Toeplitz Quantization on Flag Manifolds

abstract: In this paper, we study Toeplitz operators on generalized flag manifolds of compact Lie groups using a representation-theoretic point of view. We prove several basic properties of these Toeplitz operators, including an abstract formula for their matrix coefficients in terms of the decomposition of certain tensor product representations. We also show how to identify large commuting families of Toeplitz operators based on invariance of their symbols under certain subgroups. Finally, we realize the Berezin transform as a convolution with certain functions that form an approximate identity on the generalized flag manifold, which allows us to prove a Szeg\"o Limit Theorem using certain results due to Hirschman, Liang, and Wilson.


title: The skew-symmetric-Laplace-uniform distribution

abstract: Laplace distribution is popular in the field of economics and finance. Still, data sets often show a lack of symmetry and a tendency of being bounded from either side of their support. In view of this, we introduce a new family of skew distribution using the skewing mechanism of Azzalini (1985), namely, skew-symmetric-Laplace-uniform distribution (SSLUD). Here uniform distribution is used not only to introduce skewness in Laplace distribution but also to restrict distribution support on one side of the real line. This paper provides a comprehensive description of the essential distributional properties of SSLUD. Estimators of the parameter are obtained using the method of moments and the method of maximum likelihood. The finite sample and asymptotic properties of these estimators are studied using simulation. It is observed that the maximum likelihood estimator is better than the moment estimator through a simulation study. Finally, an application of SSLUD to real-life data on the daily percentage change in the price of NIFTY 50, an Indian stock market index, is presented.


title: ptt5-v2: A Closer Look at Continued Pretraining of T5 Models for the Portuguese Language

abstract: Despite advancements in Natural Language Processing (NLP) and the growing availability of pretrained models, the English language remains the primary focus of model development. Continued pretraining on language-specific corpora provides a practical solution for adapting models to other languages. However, the impact of different pretraining settings on downstream tasks remains underexplored. This work introduces $\texttt{ptt5-v2}$, investigating the continued pretraining of T5 models for Portuguese. We first develop a baseline set of settings and pretrain models with sizes up to 3B parameters. Finetuning on three Portuguese downstream tasks (assin2 STS, assin2 RTE, and TweetSentBR) yields SOTA results on the latter two. We then explore the effects of different pretraining configurations, including quality filters, optimization strategies, and multi-epoch pretraining. Perhaps surprisingly, their impact remains subtle compared to our baseline. We release $\texttt{ptt5-v2}$ pretrained checkpoints and the finetuned MonoT5 rerankers on HuggingFace at https://huggingface.co/collections/unicamp-dl/ptt5-v2-666538a650188ba00aa8d2d0 and https://huggingface.co/collections/unicamp-dl/monoptt5-66653981877df3ea727f720d.


title: Bayesian Networks and Machine Learning for COVID-19 Severity Explanation and Demographic Symptom Classification

abstract: With the prevailing efforts to combat the coronavirus disease 2019 (COVID-19) pandemic, there are still uncertainties that are yet to be discovered about its spread, future impact, and resurgence. In this paper, we present a three-stage data-driven approach to distill the hidden information about COVID-19. The first stage employs a Bayesian network structure learning method to identify the causal relationships among COVID-19 symptoms and their intrinsic demographic variables. As a second stage, the output from the Bayesian network structure learning, serves as a useful guide to train an unsupervised machine learning (ML) algorithm that uncovers the similarities in patients' symptoms through clustering. The final stage then leverages the labels obtained from clustering to train a demographic symptom identification (DSID) model which predicts a patient's symptom class and the corresponding demographic probability distribution. We applied our method on the COVID-19 dataset obtained from the Centers for Disease Control and Prevention (CDC) in the United States. Results from the experiments show a testing accuracy of 99.99%, as against the 41.15% accuracy of a heuristic ML method. This strongly reveals the viability of our Bayesian network and ML approach in understanding the relationship between the virus symptoms, and providing insights on patients' stratification towards reducing the severity of the virus.


title: Diffusion Model With Optimal Covariance Matching

abstract: The probabilistic diffusion model has become highly effective across various domains. Typically, sampling from a diffusion model involves using a denoising distribution characterized by a Gaussian with a learned mean and either fixed or learned covariances. In this paper, we leverage the recently proposed full covariance moment matching technique and introduce a novel method for learning covariances. Unlike traditional data-driven covariance approximation approaches, our method involves directly regressing the optimal analytic covariance using a new, unbiased objective named Optimal Covariance Matching (OCM). This approach can significantly reduce the approximation error in covariance prediction. We demonstrate how our method can substantially enhance the sampling efficiency of both Markovian (DDPM) and non-Markovian (DDIM) diffusion model families.


title: Post-hoc Utterance Refining Method by Entity Mining for Faithful Knowledge Grounded Conversations

abstract: Despite the striking advances in recent language generation performance, model-generated responses have suffered from the chronic problem of hallucinations that are either untrue or unfaithful to a given source. Especially in the task of knowledge grounded conversation, the models are required to generate informative responses, but hallucinated utterances lead to miscommunication. In particular, entity-level hallucination that causes critical misinformation and undesirable conversation is one of the major concerns. To address this issue, we propose a post-hoc refinement method called REM. It aims to enhance the quality and faithfulness of hallucinated utterances by refining them based on the source knowledge. If the generated utterance has a low source-faithfulness score with the given knowledge, REM mines the key entities in the knowledge and implicitly uses them for refining the utterances. We verify that our method reduces entity hallucination in the utterance. Also, we show the adaptability and efficacy of REM with extensive experiments and generative results. Our code is available at https://github.com/YOONNAJANG/REM.


title: RGBlimp-Q: Robotic Gliding Blimp With Moving Mass Control Based on a Bird-Inspired Continuum Arm

abstract: Robotic blimps, as lighter-than-air aerial systems, offer prolonged duration and enhanced safety in human-robot interactions due to their buoyant lift. However, robust flight against environmental airflow disturbances remains a significant challenge, limiting the broader application of these robots. Drawing inspiration from the flight mechanics of birds and their ability to perch against natural wind, this article introduces RGBlimp-Q, a robotic gliding blimp equipped with a bird-inspired continuum arm. This arm allows for flexible attitude adjustments through moving mass control to enhance disturbance resilience, while also enabling object capture by using claws to counteract environmental disturbances, similar to a bird. This article presents the design, modeling, and prototyping of RGBlimp-Q, thus extending the advantages of robotic blimps to more complex environments. To the best of the authors' knowledge, this is the first interdisciplinary design integrating continuum mechanisms onto robotic blimps. Experimental results from both indoor and outdoor settings validate the improved flight robustness against environmental disturbances offered by this novel design.


title: LLMFactor: Extracting Profitable Factors through Prompts for Explainable Stock Movement Prediction

abstract: Recently, Large Language Models (LLMs) have attracted significant attention for their exceptional performance across a broad range of tasks, particularly in text analysis. However, the finance sector presents a distinct challenge due to its dependence on time-series data for complex forecasting tasks. In this study, we introduce a novel framework called LLMFactor, which employs Sequential Knowledge-Guided Prompting (SKGP) to identify factors that influence stock movements using LLMs. Unlike previous methods that relied on keyphrases or sentiment analysis, this approach focuses on extracting factors more directly related to stock market dynamics, providing clear explanations for complex temporal changes. Our framework directs the LLMs to create background knowledge through a fill-in-the-blank strategy and then discerns potential factors affecting stock prices from related news. Guided by background knowledge and identified factors, we leverage historical stock prices in textual format to predict stock movement. An extensive evaluation of the LLMFactor framework across four benchmark datasets from both the U.S. and Chinese stock markets demonstrates its superiority over existing state-of-the-art methods and its effectiveness in financial time-series forecasting.


title: Majorana qubit readout by a point-contact detector under finite bias voltages

abstract: In this work we revisit the problem of four Majorana-zero-modes (4-MZMs) qubit readout by a point-contact (PC) detector. The logic states of the 4-MZMs qubit are converted to different charge occupations of a tunnel-coupled quantum dot (QD), which is further measured by a nearby PC detector. This type of measurement in principle requires that the PC detector is to be biased at small voltages, which should be comparable to the energy scales of the QD level and its coupling to the qubit. Going beyond existing studies on this problem, we present a unified treatment for both the steady-state current and the current power spectrum, which allow us to infer the qubit state information from either the QD occupation or the characteristic peak at the oscillation frequency. Moreover, we carry out the peak-to-pedestal ratio of each single characteristic peak (associated with each logic state of the qubit) and the signal-to-noise ratio of the two peaks. From these two figures of merit, we reveal the optimal bias voltage window for the PC detector at low temperature limit.


title: Self-Evolution Fine-Tuning for Policy Optimization

abstract: The alignment of large language models (LLMs) is crucial not only for unlocking their potential in specific tasks but also for ensuring that responses meet human expectations and adhere to safety and ethical principles. Current alignment methodologies face considerable challenges. For instance, supervised fine-tuning (SFT) requires extensive, high-quality annotated samples, while reinforcement learning from human feedback (RLHF) is complex and often unstable. In this paper, we introduce self-evolution fine-tuning (SEFT) for policy optimization, with the aim of eliminating the need for annotated samples while retaining the stability and efficiency of SFT. SEFT first trains an adaptive reviser to elevate low-quality responses while maintaining high-quality ones. The reviser then gradually guides the policy's optimization by fine-tuning it with enhanced responses. One of the prominent features of this method is its ability to leverage unlimited amounts of unannotated data for policy optimization through supervised fine-tuning. Our experiments on AlpacaEval 2.0 and MT-Bench demonstrate the effectiveness of SEFT. We also provide a comprehensive analysis of its advantages over existing alignment techniques.


title: Signed projective cubes, a homomorphism point of view

abstract: The (signed) projective cubes, as a special class of graphs closely related to the hypercubes, are on the crossroad of geometry, algebra, discrete mathematics and linear algebra. Defined as Cayley graphs on binary groups, they represent basic linear dependencies. Capturing the four-color theorem as a homomorphism target they show how mapping of discrete objects, namely graphs, may relate to special mappings of plane to projective spaces of higher dimensions. In this work, viewed as a signed graph, first we present a number of equivalent definitions each of which leads to a different development. In particular, the new notion of common product of signed graphs is introduced which captures both Cartesian and tensor products of graphs. We then have a look at some of their homomorphism properties. We first introduce an inverse technique for the basic no-homomorphism lemma, using which we show that every signed projective cube is of circular chromatic number 4. Then observing that the 4-color theorem is about mapping planar graphs into signed projective cube of dimension 2, we study some conjectures in extension of 4CT. Toward a better understanding of these conjectures we present the notion of extended double cover as a key operation in formulating the conjectures. With a deeper look into connection between some of these graphs and algebraic geometry, we discover that projective cube of dimension 4, widely known as the Clebsh graph, but also known as Greenwood-Gleason graph, is the intersection graph of the 16 straight lines of an algebraic surface known as Segre surface, which is a Del Pezzo surface of degree 4. We note that an algebraic surface known as the Clebsch surface is one of the most symmetric presentations of a cubic surface. Recall that each smooth cubic surface contains 27 lines. Hence, from hereafter, we believe, a proper name for this graph should be Segre graph.


title: On the Effectiveness of Supervision in Asymmetric Non-Contrastive Learning

abstract: Supervised contrastive representation learning has been shown to be effective in various transfer learning scenarios. However, while asymmetric non-contrastive learning (ANCL) often outperforms its contrastive learning counterpart in self-supervised representation learning, the extension of ANCL to supervised scenarios is less explored. To bridge the gap, we study ANCL for supervised representation learning, coined SupSiam and SupBYOL, leveraging labels in ANCL to achieve better representations. The proposed supervised ANCL framework improves representation learning while avoiding collapse. Our analysis reveals that providing supervision to ANCL reduces intra-class variance, and the contribution of supervision should be adjusted to achieve the best performance. Experiments demonstrate the superiority of supervised ANCL across various datasets and tasks. The code is available at: https://github.com/JH-Oh-23/Sup-ANCL.


title: Optimization of Armv9 architecture general large language model inference performance based on Llama.cpp

abstract: This article optimizes the inference performance of the Qwen-1.8B model by performing Int8 quantization, vectorizing some operators in llama.cpp, and modifying the compilation script to improve the compiler optimization level. On the Yitian 710 experimental platform, the prefill performance is increased by 1.6 times, the decoding performance is increased by 24 times, the memory usage is reduced to 1/5 of the original, and the accuracy loss is almost negligible.


title: A framework for optimisation based stochastic process discovery

abstract: Process mining is concerned with deriving formal models capable of reproducing the behaviour of a given organisational process by analysing observed executions collected in an event log. The elements of an event log are finite sequences (i.e., traces or words) of actions. Many effective algorithms have been introduced which issue a control flow model (commonly in Petri net form) aimed at reproducing, as precisely as possible, the language of the considered event log. However, given that identical executions can be observed several times, traces of an event log are associated with a frequency and, hence, an event log inherently yields also a stochastic language. By exploiting the trace frequencies contained in the event log, the stochastic extension of process mining, therefore, consists in deriving stochastic (Petri nets) models capable of reproducing the likelihood of the observed executions. In this paper, we introduce a novel stochastic process mining approach. Starting from a ``standard'' Petri net model mined through classical mining algorithms, we employ optimization to identify optimal weights for the transitions of the mined net so that the stochastic language issued by the stochastic interpretation of the mined net closely resembles that of the event log. The optimization is either based on the maximum likelihood principle or on the earth moving distance. Experiments on some popular real system logs show an improved accuracy w.r.t. to alternative approaches.


title: Diffusion in a two Phases System: Application to Ion Exchange in Silicate Glasses

abstract: Diffusion in a two-phase system is a classical problem discussed in the literature. The general solution of the one-dimensional case to this problem is revisited and a detailed derivation is proposed. The solution is discussed in relationship with ion exchange in silicate glasses. The general solution is compared with the complementary error function solution and they have identified the assumptions under which the general solution reduces to the erfc one. Interface or glass surface issues related to ion exchange are discussed in terms of the ratio between the diffusion coefficients of the diffusing alkali ions in the glass and the ion reservoir phases respectively. Another relevant issue can be identified in the assumption of instantaneous equilibrium at the two-phase interface once the contact is established. Even though this last assumption is somehow unphysical it is the common approach used in the technological application of ion exchange in silicate glass which is justified when the contact time that is immersion time of glass with an ion reservoir is much larger than the time to achieve thermodynamic equilibrium at the surface.


title: GUI-WORLD: A Dataset for GUI-oriented Multimodal LLM-based Agents

abstract: Recently, Multimodal Large Language Models (MLLMs) have been used as agents to control keyboard and mouse inputs by directly perceiving the Graphical User Interface (GUI) and generating corresponding code. However, current agents primarily exhibit excellent understanding capabilities in static environments and are predominantly applied in relatively simple domains, such as Web or mobile interfaces. We argue that a robust GUI agent should be capable of perceiving temporal information on the GUI, including dynamic Web content and multi-step tasks. Additionally, it should possess a comprehensive understanding of various GUI scenarios, including desktop software and multi-window interactions. To this end, this paper introduces a new dataset, termed GUI-World, which features meticulously crafted Human-MLLM annotations, extensively covering six GUI scenarios and eight types of GUI-oriented questions in three formats. We evaluate the capabilities of current state-of-the-art MLLMs, including ImageLLMs and VideoLLMs, in understanding various types of GUI content, especially dynamic and sequential content. Our findings reveal that ImageLLMs struggle with dynamic GUI content without manually annotated keyframes or operation history. On the other hand, VideoLLMs fall short in all GUI-oriented tasks given the sparse GUI video dataset. Based on GUI-World, we take the initial step of leveraging a fine-tuned VideoLLM as a GUI agent, demonstrating an improved understanding of various GUI tasks. However, due to the limitations in the performance of base LLMs, we conclude that using VideoLLMs as GUI agents remains a significant challenge. We believe our work provides valuable insights for future research in dynamic GUI content understanding. The code and dataset are publicly available at our project homepage: https://gui-world.github.io/.


title: Approximation measures for shifted logarithms of algebraic numbers via effective Poincare-Perron

abstract: In this article, we show new effective approximation measures for the shifted logarithm of algebraic numbers which belong to a number field of arbitrary degree. Our measures refine previous ones including those for usual logarithms. We adapt Pade approximants constructed by M. Kawashima and A. Poels in the rational case. Our key ingredient relies on the Poincare-Perron theorem which gives us asymptotic estimates at every archimedean place of the number field, that we apply to decide whether the shifted logarithm lies outside of the number field. We use Perron's second theorem and its modification due to M. Pituk to handle general cases.


title: Casimir Wormholes in Brans-Dicke Theory

abstract: In recent years there has been a growing interest in the field of wormhole physics in the presence of the Casimir effect. As this effect provides negative energy density, it can be utilized as an ideal candidate for the exotic matter required for creating a traversable wormhole. In the context of modified theories of gravity such as Brans-Dicke (BD) theory \cite{BDTH}, wormhole geometries {have} been vastly investigated{. However}, the scientific literature is silent on the issue of BD wormholes in the presence of Casimir energy. Our aim in the present study is to seek for static spherically symmetric solutions representing wormhole configurations in BD theory with Casimir energy as the supporting matter. The Casimir {setup} we assume comprises two electrically neutral, infinitely large parallel planes placed in a vacuum. We then consider the Casimir vacuum energy density of a scalar field in such a configuration with Dirichlet {and} mixed boundary conditions. In the former case, the corresponding Casimir force is attractive and in the latter this force is repulsive. We present exact zero tidal force wormhole solutions as well as those with non-vanishing redshift function for both types of Casimir energies. The conditions on wormhole solutions along with the weak (WEC) and null (NEC) energy conditions put constraints on the values of BD coupling parameter. These constraints are also subject to the value of BD scalar field at the throat and the throat radius. We therefore find that BD wormholes in the presence of Casimir energy can exist without violating NEC and WEC (for the repulsive Casimir force). Finally, we examine the equilibrium condition for the stability of the obtained solutions using Tolman-Oppenheimer-Volkoff (TOV) equation.


title: A priori estimates and large population limits for some nonsymmetric Nash systems with semimonotonicity

abstract: We address the problem of regularity of solutions $u^i(t, x^1, \ldots, x^N)$ to a family of semilinear parabolic systems of $N$ equations, which describe closed-loop equilibria of some $N$-player differential games with quadratic Lagrangian in the velocity, running costs $f^i(x)$ and final costs $g^i(x)$. By global (semi)monotonicity assumptions on the data $f,g$, and assuming that derivatives of $f^i, g^i$ in directions $x_j$ are of order $1/N$ for $j \neq i$, we prove that derivatives of $u^i$ enjoy the same property. The estimates are uniform in the number of players $N$. Such behaviour of the derivatives of $f^i, g^i$ arise in the theory of Mean Field Games, though here we do not make any symmetry assumption on the data. Then, by the estimates obtained we address the convergence problem $N \to \infty$ in a ``heterogeneous'' Mean Field framework, where players all observe the empirical measure of the whole population, but may react differently from one another.


title: Iterated Schr\"odinger bridge approximation to Wasserstein Gradient Flows

abstract: We introduce a novel discretization scheme for Wasserstein gradient flows that involves successively computing Schr\"{o}dinger bridges with the same marginals. This is different from both the forward/geodesic approximation and the backward/Jordan-Kinderlehrer-Otto (JKO) approximations. The proposed scheme has two advantages: one, it avoids the use of the score function, and, two, it is amenable to particle-based approximations using the Sinkhorn algorithm. Our proof hinges upon showing that relative entropy between the Schr\"{o}dinger bridge with the same marginals at temperature $\epsilon$ and the joint distribution of a stationary Langevin diffusion at times zero and $\epsilon$ is of the order $o(\epsilon^2)$ with an explicit dependence given by Fisher information. Owing to this inequality, we can show, using a triangular approximation argument, that the interpolated iterated application of the Schr\"{o}dinger bridge approximation converge to the Wasserstein gradient flow, for a class of gradient flows, including the heat flow. The results also provide a probabilistic and rigorous framework for the convergence of the self-attention mechanisms in transformer networks to the solutions of heat flows, first observed in the inspiring work SABP22 in machine learning research.


title: Citation-Based Summarization of Landmark Judgments

abstract: Landmark judgments are of prime importance in the Common Law System because of their exceptional jurisprudence and frequent references in other judgments. In this work, we leverage contextual references available in citing judgments to create an extractive summary of the target judgment. We evaluate the proposed algorithm on two datasets curated from the judgments of Indian Courts and find the results promising.


title: Griesmer and Optimal Linear Codes from the Affine Solomon-Stiffler Construction

abstract: In their fundamental paper published in 1965, G. Solomon and J. J. Stiffler invented infinite families of codes meeting the Griesmer bound. These codes are then called Solomon-Stiffler codes and have motivated various constructions of codes meeting or close the Griesmer bound. In this paper, we give a geometric construction of infinite families of affine and modified affine Solomon-Stiffler codes. Projective Solomon-Stiffler codes are special cases of our modified affine Solomon-Stiffler codes. Several infinite families of $q$-ary Griesmer, optimal, almost optimal two-weight, three-weight, four-weight and five-weight linear codes are constructed as special cases of our construction. Weight distributions of these Griesmer, optimal or almost optimal codes are determined. Many optimal linear codes documented in Grassl's list are re-constructed as (modified) affine Solomon-Stiffler codes. Several infinite families of optimal or Griesmer codes were constructed in two published papers in IEEE Transactions on Information Theory 2017 and 2019, via Gray images of codes over finite rings. Parameters and weight distributions of these Griesmer or optimal codes and very special case codes in our construction are the same. We also indicate that more general distance-optimal binary linear codes than that constructed in a recent paper of IEEE Transactions on Information Theory can be obtained directly from codimension one subcodes in binary Solomon-Stiffler codes.


title: Integrating sensing and communications: Simultaneously transmitting and reflecting digital coding metasurfaces

abstract: Wireless networks are undergoing a transformative shift, driven by the crucial factors of cost effectiveness and sustainability. Digital coding metasurfaces (DCMs) might play a key role in realizing cost-effective digital modulators by harnessing energy embedded in electromagnetic waves traversing through the air. Integrated sensing and communication (ISAC) optimize power and spectral resources by combining sensing and communication functionalities on a shared hardware platform. This article presents a tutorial-style overview of the applications and advantages of DCMs in ISAC-based networks. Emphasis is placed on the dual-functionality of ISAC, necessitating the design of DCMs with simultaneously transmitting and reflecting (STAR) capabilities for comprehensive space control. Additionally, the article explores key signal processing challenges and outlines future research directions stemming from the convergence of ISAC and emerging STAR-DCM technologies.


title: Algorithm Selection for Optimal Multi-Agent Path Finding via Graph Embedding

abstract: Multi-agent path finding (MAPF) is the problem of finding paths for multiple agents such that they do not collide. This problem manifests in numerous real-world applications such as controlling transportation robots in automated warehouses, moving characters in video games, and coordinating self-driving cars in intersections. Finding optimal solutions to MAPF is NP-Hard, yet modern optimal solvers can scale to hundreds of agents and even thousands in some cases. Different solvers employ different approaches, and there is no single state-of-the-art approach for all problems. Furthermore, there are no clear, provable, guidelines for choosing when each optimal MAPF solver to use. Prior work employed Algorithm Selection (AS) techniques to learn such guidelines from past data. A major challenge when employing AS for choosing an optimal MAPF algorithm is how to encode the given MAPF problem. Prior work either used hand-crafted features or an image representation of the problem. We explore graph-based encodings of the MAPF problem and show how they can be used on-the-fly with a modern graph embedding algorithm called FEATHER. Then, we show how this encoding can be effectively joined with existing encodings, resulting in a novel AS method we call MAPF Algorithm selection via Graph embedding (MAG). An extensive experimental evaluation of MAG on several MAPF algorithm selection tasks reveals that it is either on-par or significantly better than existing methods.


title: PyramidMamba: Rethinking Pyramid Feature Fusion with Selective Space State Model for Semantic Segmentation of Remote Sensing Imagery

abstract: Semantic segmentation, as a basic tool for intelligent interpretation of remote sensing images, plays a vital role in many Earth Observation (EO) applications. Nowadays, accurate semantic segmentation of remote sensing images remains a challenge due to the complex spatial-temporal scenes and multi-scale geo-objects. Driven by the wave of deep learning (DL), CNN- and Transformer-based semantic segmentation methods have been explored widely, and these two architectures both revealed the importance of multi-scale feature representation for strengthening semantic information of geo-objects. However, the actual multi-scale feature fusion often comes with the semantic redundancy issue due to homogeneous semantic contents in pyramid features. To handle this issue, we propose a novel Mamba-based segmentation network, namely PyramidMamba. Specifically, we design a plug-and-play decoder, which develops a dense spatial pyramid pooling (DSPP) to encode rich multi-scale semantic features and a pyramid fusion Mamba (PFM) to reduce semantic redundancy in multi-scale feature fusion. Comprehensive ablation experiments illustrate the effectiveness and superiority of the proposed method in enhancing multi-scale feature representation as well as the great potential for real-time semantic segmentation. Moreover, our PyramidMamba yields state-of-the-art performance on three publicly available datasets, i.e. the OpenEarthMap (70.8% mIoU), ISPRS Vaihingen (84.8% mIoU) and Potsdam (88.0% mIoU) datasets. The code will be available at https://github.com/WangLibo1995/GeoSeg.


title: Solving Co-Path/Cycle Packing Faster than $3^k$

abstract: The \textsc{Co-Path/Cycle Packing} problem asks whether we can delete at most $k$ vertices from the input graph such that the remaining graph is a collection of induced paths and cycles. \textsc{Co-Path/Cycle Packing} is a fundamental graph problem that has important applications in bioinformatics. Although this problem has been extensively studied in parameterized algorithms, it seems hard to break the running time bound $3^k$. In 2015, Feng et al. provided an $O^*(3^k)$-time randomized algorithm. Recently, Tsur showed that this problem can be solved in $O^*(3^k)$ time deterministically. In this paper, by combining several techniques such as path decomposition, dynamic programming, and branch-and-search methods, we show that \textsc{Co-Path/Cycle Packing} can be solved in $O^*(2.8192^k)$ time. As a by-product, we also show that the \textsc{$d$-Bounded-Degree Vertex Deletion} problem, a generalization of \textsc{Co-Path/Cycle Packing}, can be solved in $O^*((d + 2)^p)$ time if a path decomposition of width $p$ is given, which implies that \textsc{$d$-Bounded-Degree Vertex Deletion} is FPT with parameter $p+d$.


title: Exponentially Enhanced Scheme for the Heralded Qudit GHZ State in Linear Optics

abstract: High-dimensional multipartite entanglement plays a crucial role in quantum information science. However, existing schemes for generating such entanglement become increasingly complex and costly as the dimension of quantum units increases. In this work, we overcome the limitation by proposing a significantly enhanced linear optical heralded scheme that generates the $d$-level $N$-partite GHZ state with single-photon sources and their linear operations. Our scheme requires $dN$ photons to generate the target state with substantially improved success probability from previous schemes. It employs linear optical logic gates compatible with any qudit encoding system and can generate generalized GHZ states with installments of beamsplitters. With efficient generations of high-dimensional resource states, our work opens avenues for further exploration in high-dimensional quantum information processing.


title: Design and Optimization of Hierarchical Gradient Coding for Distributed Learning at Edge Devices

abstract: Edge computing has recently emerged as a promising paradigm to boost the performance of distributed learning by leveraging the distributed resources at edge nodes. Architecturally, the introduction of edge nodes adds an additional intermediate layer between the master and workers in the original distributed learning systems, potentially leading to more severe straggler effect. Recently, coding theory-based approaches have been proposed for stragglers mitigation in distributed learning, but the majority focus on the conventional workers-master architecture. In this paper, along a different line, we investigate the problem of mitigating the straggler effect in hierarchical distributed learning systems with an additional layer composed of edge nodes. Technically, we first derive the fundamental trade-off between the computational loads of workers and the stragglers tolerance. Then, we propose a hierarchical gradient coding framework, which provides better stragglers mitigation, to achieve the derived computational trade-off. To further improve the performance of our framework in heterogeneous scenarios, we formulate an optimization problem with the objective of minimizing the expected execution time for each iteration in the learning process. We develop an efficient algorithm to mathematically solve the problem by outputting the optimum strategy. Extensive simulation results demonstrate the superiority of our schemes compared with conventional solutions.


title: Acceleration Noise Induced Decoherence in Stern-Gerlach Interferometers for Gravity Experiments

abstract: Stern-Gerlach interferometer (SGI) is a kind of matter-wave interferometer driven by magnetic field and has been proposed for many gravity experiments. Acceleration noises such as vibration and inertial forces, together with higher-order noises like the fluctuation of the gravity gradient or the magnetic field, can cause decoherence problems of SGI, including dephasing, loss of contrast and position localization decoherence. In this paper, I will theoretically study these mechanisms of decoherence based on the analytical time-evolution operator of an SGI modeled as a harmonic oscillator under acceleration noises described by Gaussian stochastic processes. As will be proved, for a single arm of an SGI, the shape of the Wigner function keeps invariant under an acceleration noise, although the phase and the coordinate in the classical phase space fluctuate as linear responses to the noise, and its density matrix also experiences a position localization decoherence due to the ensemble average. For the witness constructed in the spin space, the degrees of freedom in the classical phase space have to be traced out. Then acceleration noises can lead to dephasing effects on the witness, while the fluctuation on the trajectories in the phase space and position localization decoherence of the two arms will be canceled with each other. On the other hand, higher-order noises can be treated as non-uniform acceleration noises in the leading order, and they will cause decoherence in the spin space due to the contrast loss besides the dephasing. Remarkably, the randomness of the noise is essential for dephasing and position-localization decoherence, and these two mechanisms don't cause purity loss or entropy increase if the noise is monitored as a deterministic process during the experiment.


title: A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery

abstract: In many scientific fields, large language models (LLMs) have revolutionized the way with which text and other modalities of data (e.g., molecules and proteins) are dealt, achieving superior performance in various applications and augmenting the scientific discovery process. Nevertheless, previous surveys on scientific LLMs often concentrate on one to two fields or a single modality. In this paper, we aim to provide a more holistic view of the research landscape by unveiling cross-field and cross-modal connections between scientific LLMs regarding their architectures and pre-training techniques. To this end, we comprehensively survey over 250 scientific LLMs, discuss their commonalities and differences, as well as summarize pre-training datasets and evaluation tasks for each field and modality. Moreover, we investigate how LLMs have been deployed to benefit scientific discovery. Resources related to this survey are available at https://github.com/yuzhimanhua/Awesome-Scientific-Language-Models.


title: Exposing the Achilles' Heel: Evaluating LLMs Ability to Handle Mistakes in Mathematical Reasoning

abstract: Large Language Models (LLMs) have been applied to Math Word Problems (MWPs) with transformative impacts, revolutionizing how these complex problems are approached and solved in various domains including educational settings. However, the evaluation of these models often prioritizes final accuracy, overlooking the crucial aspect of reasoning capabilities. This work addresses this gap by focusing on the ability of LLMs to detect and correct reasoning mistakes. We introduce a novel dataset MWP-MISTAKE, incorporating MWPs with both correct and incorrect reasoning steps generated through rule-based methods and smaller language models. Our comprehensive benchmarking reveals significant insights into the strengths and weaknesses of state-of-the-art models, such as GPT-4o, GPT-4, GPT-3.5Turbo, and others. We highlight GPT-$o's superior performance in mistake detection and rectification and the persistent challenges faced by smaller models. Additionally, we identify issues related to data contamination and memorization, impacting the reliability of LLMs in real-world applications. Our findings emphasize the importance of rigorous evaluation of reasoning processes and propose future directions to enhance the generalization and robustness of LLMs in mathematical problem-solving.


title: The MIRI/MRS Library I. Empirically correcting detector charge migration in unresolved sources

abstract: The JWST has been collecting scientific data for over two years now. Scientists are now looking deeper into the data, which introduces the need to correct known systematic effects. Important limiting factors for the MIRI/MRS are the pointing accuracy, non-linearity, detector charge migration, detector scattering, the accuracy of the PSF model, and the complex interplay between these. The Cycle 2 programme 3779 proposed a 72-point intra-pixel dither raster of the calibration star 10-Lac. In this first work of the paper series, we aim to address the degeneracy between the non-linearity and BFE that affect the pixel voltage integration ramps of the MRS. Due to the low flux in the longer wavelengths, we only do this in the 4.9 to 11.7 micron region. We fitted the ramps per pixel and dither, in order to fold in the deviations from classical non-linearity that are caused by charge migration. The ramp shapes should be repeatable depending on the part of the PSF that is sampled. By doing so, we defined both a grid-based linearity correction, and an interpolated linearity correction. We find significant improvements compared to the uniform illumination assumption. The standard deviation on the pixel ramp residual non-linearity is between 70-90% smaller than the current standard pipeline when self-calibrating with the grid. We are able to interpolate these coefficients to apply to any unresolved source not on the grid points, resulting in an up to 70% smaller standard deviation on the residual deviation from linearity. The FWHM is up to 20% narrower. The depth of the fringes is now consistent up the ramp. Pointing-specific linearity corrections allow us to fix the systematic deviation in the slopes. We demonstrated this for unresolved sources. The discovered trends with PSF sampling suggest that, we may be able to model ramps for spatially extended and resolved illumination as well.


title: Revisiting and Improving Scoring Fusion for Spoofing-aware Speaker Verification Using Compositional Data Analysis

abstract: Fusing outputs from automatic speaker verification (ASV) and spoofing countermeasure (CM) is expected to make an integrated system robust to zero-effort imposters and synthesized spoofing attacks. Many score-level fusion methods have been proposed, but many remain heuristic. This paper revisits score-level fusion using tools from decision theory and presents three main findings. First, fusion by summing the ASV and CM scores can be interpreted on the basis of compositional data analysis, and score calibration before fusion is essential. Second, the interpretation leads to an improved fusion method that linearly combines the log-likelihood ratios of ASV and CM. However, as the third finding reveals, this linear combination is inferior to a non-linear one in making optimal decisions. The outcomes of these findings, namely, the score calibration before fusion, improved linear fusion, and better non-linear fusion, were found to be effective on the SASV challenge database.


title: EM Estimation of Conditional Matrix Variate $t$ Distributions

abstract: Conditional matrix variate student $t$ distribution was introduced by Battulga (2024a). In this paper, we propose a new version of the conditional matrix variate student $t$ distribution. The paper provides EM algorithms, which estimate parameters of the conditional matrix variate student $t$ distributions, including general cases and special cases with Minnesota prior.


title: Digital Wireless Image Transmission via Distribution Matching

abstract: Deep learning-based joint source-channel coding (JSCC) is emerging as a potential technology to meet the demand for effective data transmission, particularly for image transmission. Nevertheless, most existing advancements only consider analog transmission, where the channel symbols are continuous, making them incompatible with practical digital communication systems. In this work, we address this by involving the modulation process and consider mapping the continuous channel symbols into discrete space. Recognizing the non-uniform distribution of the output channel symbols in existing methods, we propose two effective methods to improve the performance. Firstly, we introduce a uniform modulation scheme, where the distance between two constellations is adjustable to match the non-uniform nature of the distribution. In addition, we further design a non-uniform modulation scheme according to the output distribution. To this end, we first generate the constellations by performing feature clustering on an analog image transmission system, then the generated constellations are employed to modulate the continuous channel symbols. For both schemes, we fine-tune the digital system to alleviate the performance loss caused by modulation. Here, the straight-through estimator (STE) is considered to overcome the non-differentiable nature. Our experimental results demonstrate that the proposed schemes significantly outperform existing digital image transmission systems.


title: Reminding Multimodal Large Language Models of Object-aware Knowledge with Retrieved Tags

abstract: Despite recent advances in the general visual instruction-following ability of Multimodal Large Language Models (MLLMs), they still struggle with critical problems when required to provide a precise and detailed response to a visual instruction: (1) failure to identify novel objects or entities, (2) mention of non-existent objects, and (3) neglect of object's attributed details. Intuitive solutions include improving the size and quality of data or using larger foundation models. They show effectiveness in mitigating these issues, but at an expensive cost of collecting a vast amount of new data and introducing a significantly larger model. Standing at the intersection of these approaches, we examine the three object-oriented problems from the perspective of the image-to-text mapping process by the multimodal connector. In this paper, we first identify the limitations of multimodal connectors stemming from insufficient training data. Driven by this, we propose to enhance the mapping with retrieval-augmented tag tokens, which contain rich object-aware information such as object names and attributes. With our Tag-grounded visual instruction tuning with retrieval Augmentation (TUNA), we outperform baselines that share the same language model and training data on 12 benchmarks. Furthermore, we show the zero-shot capability of TUNA when provided with specific datastores.


title: CBGBench: Fill in the Blank of Protein-Molecule Complex Binding Graph

abstract: Structure-based drug design (SBDD) aims to generate potential drugs that can bind to a target protein and is greatly expedited by the aid of AI techniques in generative models. However, a lack of systematic understanding persists due to the diverse settings, complex implementation, difficult reproducibility, and task singularity. Firstly, the absence of standardization can lead to unfair comparisons and inconclusive insights. To address this dilemma, we propose CBGBench, a comprehensive benchmark for SBDD, that unifies the task as a generative heterogeneous graph completion, analogous to fill-in-the-blank of the 3D complex binding graph. By categorizing existing methods based on their attributes, CBGBench facilitates a modular and extensible framework that implements various cutting-edge methods. Secondly, a single task on \textit{de novo} molecule generation can hardly reflect their capabilities. To broaden the scope, we have adapted these models to a range of tasks essential in drug design, which are considered sub-tasks within the graph fill-in-the-blank tasks. These tasks include the generative designation of \textit{de novo} molecules, linkers, fragments, scaffolds, and sidechains, all conditioned on the structures of protein pockets. Our evaluations are conducted with fairness, encompassing comprehensive perspectives on interaction, chemical properties, geometry authenticity, and substructure validity. We further provide the pre-trained versions of the state-of-the-art models and deep insights with analysis from empirical studies. The codebase for CBGBench is publicly accessible at \url{https://github.com/Edapinenut/CBGBench}.


title: Local Hardy spaces associated with ball quasi-Banach function spaces and their dual spaces

abstract: Let $X$ be a ball quasi-Banach function space on $\mathbb R^{n}$ and $h_{X}(\mathbb R^{n})$ the local Hardy space associated with $X$. In this paper, under some reasonable assumptions on $X$, the infinite and finite atomic decompositions for the local Hardy space $h_{X}(\mathbb R^{n})$ are established directly, without relying on the relation between $H_{X}(\mathbb R^{n})$ and $h_{X}(\mathbb R^{n})$. Moreover, we apply the finite atomic decomposition to obtain the dual space of the local Hardy space $h_{X}(\mathbb R^{n})$. Especially, the above results can be applied to several specific ball quasi-Banach function spaces, demonstrating their wide range of applications.


title: Large Language Models for Automatic Milestone Detection in Group Discussions

abstract: Large language models like GPT have proven widely successful on natural language understanding tasks based on written text documents. In this paper, we investigate an LLM's performance on recordings of a group oral communication task in which utterances are often truncated or not well-formed. We propose a new group task experiment involving a puzzle with several milestones that can be achieved in any order. We investigate methods for processing transcripts to detect if, when, and by whom a milestone has been completed. We demonstrate that iteratively prompting GPT with transcription chunks outperforms semantic similarity search methods using text embeddings, and further discuss the quality and randomness of GPT responses under different context window sizes.


title: Enriching the Machine Learning Workloads in BigBench

abstract: In the era of Big Data and the growing support for Machine Learning, Deep Learning and Artificial Intelligence algorithms in the current software systems, there is an urgent need of standardized application benchmarks that stress test and evaluate these new technologies. Relying on the standardized BigBench (TPCx-BB) benchmark, this work enriches the improved BigBench V2 with three new workloads and expands the coverage of machine learning algorithms. Our workloads utilize multiple algorithms and compare different implementations for the same algorithm across several popular libraries like MLlib, SystemML, Scikit-learn and Pandas, demonstrating the relevance and usability of our benchmark extension.


title: Multi-Scale Accent Modeling with Disentangling for Multi-Speaker Multi-Accent TTS Synthesis

abstract: Synthesizing speech across different accents while preserving the speaker identity is essential for various real-world customer applications. However, the individual and accurate modeling of accents and speakers in a text-to-speech (TTS) system is challenging due to the complexity of accent variations and the intrinsic entanglement between the accent and speaker identity. In this paper, we present a novel approach for multi-speaker multi-accent TTS synthesis, which aims to synthesize voices of multiple speakers, each with various accents. Our proposed approach employs a multi-scale accent modeling strategy to address accent variations at different levels. Specifically, we introduce both global (utterance level) and local (phoneme level) accent modeling, supervised by individual accent classifiers to capture the overall variation within accented utterances and fine-grained variations between phonemes, respectively. To control accents and speakers separately, speaker-independent accent modeling is necessary, which is achieved by adversarial training with speaker classifiers to disentangle speaker identity within the multi-scale accent modeling. Consequently, we obtain speaker-independent and accent-discriminative multi-scale embeddings as comprehensive accent features. Additionally, we propose a local accent prediction model that allows to generate accented speech directly from phoneme inputs. Extensive experiments are conducted on an accented English speech corpus. Both objective and subjective evaluations show the superiority of our proposed system compared to baselines systems. Detailed component analysis demonstrates the effectiveness of global and local accent modeling, and speaker disentanglement on multi-speaker multi-accent speech synthesis.


title: LAIP: Learning Local Alignment from Image-Phrase Modeling for Text-based Person Search

abstract: Text-based person search aims at retrieving images of a particular person based on a given textual description. A common solution for this task is to directly match the entire images and texts, i.e., global alignment, which fails to deal with discerning specific details that discriminate against appearance-similar people. As a result, some works shift their attention towards local alignment. One group matches fine-grained parts using forward attention weights of the transformer yet underutilizes information. Another implicitly conducts local alignment by reconstructing masked parts based on unmasked context yet with a biased masking strategy. All limit performance improvement. This paper proposes the Local Alignment from Image-Phrase modeling (LAIP) framework, with Bidirectional Attention-weighted local alignment (BidirAtt) and Mask Phrase Modeling (MPM) module.BidirAtt goes beyond the typical forward attention by considering the gradient of the transformer as backward attention, utilizing two-sided information for local alignment. MPM focuses on mask reconstruction within the noun phrase rather than the entire text, ensuring an unbiased masking strategy. Extensive experiments conducted on the CUHK-PEDES, ICFG-PEDES, and RSTPReid datasets demonstrate the superiority of the LAIP framework over existing methods.


title: NBA: defensive distillation for backdoor removal via neural behavior alignment

abstract: Recently, deep neural networks have been shown to be vulnerable to backdoor attacks. A backdoor is inserted into neural networks via this attack paradigm, thus compromising the integrity of the network. As soon as an attacker presents a trigger during the testing phase, the backdoor in the model is activated, allowing the network to make specific wrong predictions. It is extremely important to defend against backdoor attacks since they are very stealthy and dangerous. In this paper, we propose a novel defense mechanism, Neural Behavioral Alignment (NBA), for backdoor removal. NBA optimizes the distillation process in terms of knowledge form and distillation samples to improve defense performance according to the characteristics of backdoor defense. NBA builds high-level representations of neural behavior within networks in order to facilitate the transfer of knowledge. Additionally, NBA crafts pseudo samples to induce student models exhibit backdoor neural behavior. By aligning the backdoor neural behavior from the student network with the benign neural behavior from the teacher network, NBA enables the proactive removal of backdoors. Extensive experiments show that NBA can effectively defend against six different backdoor attacks and outperform five state-of-the-art defenses.


title: TorchOpera: A Compound AI System for LLM Safety

abstract: We introduce TorchOpera, a compound AI system for enhancing the safety and quality of prompts and responses for Large Language Models. TorchOpera ensures that all user prompts are safe, contextually grounded, and effectively processed, while enhancing LLM responses to be relevant and high quality. TorchOpera utilizes the vector database for contextual grounding, rule-based wrappers for flexible modifications, and specialized mechanisms for detecting and adjusting unsafe or incorrect content. We also provide a view of the compound AI system to reduce the computational cost. Extensive experiments show that TorchOpera ensures the safety, reliability, and applicability of LLMs in real-world settings while maintaining the efficiency of LLM responses.


title: A transparency-based action model implemented in a robotic physical trainer for improved HRI

abstract: Transparency is an important aspect of human-robot interaction (HRI), as it can improve system trust and usability leading to improved communication and performance. However, most transparency models focus only on the amount of information given to users. In this paper, we propose a bidirectional transparency model, termed a transparency-based action (TBA) model, which in addition to providing transparency information (robot-to-human), allows the robot to take actions based on transparency information received from the human (robot-of-human and human-to-robot). We implemented a three-level (High, Medium and Low) TBA model on a robotic system trainer in two pilot studies (with students as participants) to examine its impact on acceptance and HRI. Based on the pilot studies results, the Medium TBA level was not included in the main experiment, which was conducted with older adults (aged 75-85). In that experiment, two TBA levels were compared: Low (basic information including only robot-to-human transparency) and High (including additional information relating to predicted outcomes with robot-of-human and human-to-robot transparency). The results revealed a significant difference between the two TBA levels of the model in terms of perceived usefulness, ease of use, and attitude. The High TBA level resulted in improved user acceptance and was preferred by the users.


title: A parallel framework for graphical optimal transport

abstract: We study multi-marginal optimal transport (MOT) problems where the underlying cost has a graphical structure. These graphical multi-marginal optimal transport problems have found applications in several domains including traffic flow control and regression problems in the Wasserstein space. MOT problem can be approached through two aspects: a single big MOT problem, or coupled minor OT problems. In this paper, we focus on the latter approach and demonstrate it has efficiency gain from the parallelization. For tree-structured MOT problems, we introduce a novel parallelizable algorithm that significantly reduces computational complexity. Additionally, we adapt this algorithm for general graphs, employing the modified junction trees to enable parallel updates. Our contributions, validated through numerical experiments, offer new avenues for MOT applications and establish benchmarks in computational efficiency.


title: Column reduced digital nets

abstract: Digital nets provide an efficient way to generate integration nodes of quasi-Monte Carlo (QMC) rules. For certain applications, as e.g. in Uncertainty Quantification, we are interested in obtaining a speed-up in computing products of a matrix with the vectors corresponding to the nodes of a QMC rule. In the recent paper "The fast reduced QMC matrix-vector product" (J. Comput. Appl. Math. 440, 115642, 2024), a speed up was obtained by using so-called reduced lattices and row reduced digital nets. In this work, we propose a different multiplication algorithm where we exploit the repetitive structure of column reduced digital nets instead of row reduced digital nets. This method has advantages over the previous one, as it facilitates the error analysis when using the integration nodes in a QMC rule. We also provide an upper bound for the quality parameter of column reduced digital nets, and numerical tests to illustrate the efficiency of the new algorithm.


title: Leading Whitespaces of Language Models' Subword Vocabulary Poses a Confound for Calculating Word Probabilities

abstract: Word-by-word conditional probabilities from Transformer-based language models are increasingly being used to evaluate their predictions over minimal pairs or to model the incremental processing difficulty of human readers. In this paper, we argue that there is a confound posed by the subword tokenization scheme of such language models, which has gone unaddressed thus far. This is due to the fact that tokens in the subword vocabulary of most language models have leading whitespaces and therefore do not naturally define stop probabilities of words. We first prove that this can result in word probabilities that sum to more than one, thereby violating the axiom that $\mathsf{P}(\Omega) = 1$. This property results in a misallocation of word-by-word surprisal, where the unacceptability of the current 'end of word' is incorrectly carried over to the next word. Additionally, language models' such implicit prediction of word boundaries is incongruous with psycholinguistic experiments where human subjects directly observe upcoming word boundaries. We present a simple decoding technique to reaccount the probability of the trailing whitespace into that of the current word, which resolves this confound. As a case study, we show that this results in significantly different estimates of garden-path effects in transitive/intransitive sentences, where a comma is strongly expected before the critical word.


title: IG2: Integrated Gradient on Iterative Gradient Path for Feature Attribution

abstract: Feature attribution explains Artificial Intelligence (AI) at the instance level by providing importance scores of input features' contributions to model prediction. Integrated Gradients (IG) is a prominent path attribution method for deep neural networks, involving the integration of gradients along a path from the explained input (explicand) to a counterfactual instance (baseline). Current IG variants primarily focus on the gradient of explicand's output. However, our research indicates that the gradient of the counterfactual output significantly affects feature attribution as well. To achieve this, we propose Iterative Gradient path Integrated Gradients (IG2), considering both gradients. IG2 incorporates the counterfactual gradient iteratively into the integration path, generating a novel path (GradPath) and a novel baseline (GradCF). These two novel IG components effectively address the issues of attribution noise and arbitrary baseline choice in earlier IG methods. IG2, as a path method, satisfies many desirable axioms, which are theoretically justified in the paper. Experimental results on XAI benchmark, ImageNet, MNIST, TREC questions answering, wafer-map failure patterns, and CelebA face attributes validate that IG2 delivers superior feature attributions compared to the state-of-the-art techniques. The code is released at: https://github.com/JoeZhuo-ZY/IG2.


title: MV2Cyl: Reconstructing 3D Extrusion Cylinders from Multi-View Images

abstract: We present MV2Cyl, a novel method for reconstructing 3D from 2D multi-view images, not merely as a field or raw geometry but as a sketch-extrude CAD model. Extracting extrusion cylinders from raw 3D geometry has been extensively researched in computer vision, while the processing of 3D data through neural networks has remained a bottleneck. Since 3D scans are generally accompanied by multi-view images, leveraging 2D convolutional neural networks allows these images to be exploited as a rich source for extracting extrusion cylinder information. However, we observe that extracting only the surface information of the extrudes and utilizing it results in suboptimal outcomes due to the challenges in the occlusion and surface segmentation. By synergizing with the extracted base curve information, we achieve the optimal reconstruction result with the best accuracy in 2D sketch and extrude parameter estimation. Our experiments, comparing our method with previous work that takes a raw 3D point cloud as input, demonstrate the effectiveness of our approach by taking advantage of multi-view images.