title: Many-Objective Multi-Solution Transport

abstract: Optimizing the performance of many objectives (instantiated by tasks or clients) jointly with a few Pareto stationary solutions (models) is critical in machine learning. However, previous multi-objective optimization methods often focus on a few number of objectives and cannot scale to many objectives that outnumber the solutions, leading to either subpar performance or ignored objectives. We introduce Many-objective multi-solution Transport (MosT), a framework that finds multiple diverse solutions in the Pareto front of many objectives. Our insight is to seek multiple solutions, each performing as a domain expert and focusing on a specific subset of objectives while collectively covering all of them. MosT formulates the problem as a bi-level optimization of weighted objectives for each solution, where the weights are defined by an optimal transport between the objectives and solutions. Our algorithm ensures convergence to Pareto stationary solutions for complementary subsets of objectives. On a range of applications in federated learning, multi-task learning, and mixture-of-prompt learning for LLMs, MosT distinctly outperforms strong baselines, delivering high-quality, diverse solutions that profile the entire Pareto frontier, thus ensuring balanced trade-offs across many objectives.


title: Computing Representatives of Persistent Homology Generators with a Double Twist

abstract: With the growing availability of efficient tools, persistent homology is becoming a useful methodology in a variety of applications. Significant work has been devoted to implementing tools for persistent homology diagrams; however, computing representative cycles corresponding to each point in the diagram can still be inefficient. To circumvent this problem, we extend the twist algorithm of Chen and Kerber. Our extension is based on a new technique we call saving, which supplements their existing killing technique. The resulting two-pass strategy can be realized using an existing matrix reduction implementation as a black-box and improves the efficiency of computing representatives of persistent homology generators. We prove the correctness of the new approach and experimentally show its performance.


title: Schur positivity of difference of products of derived Schur polynomials

abstract: To any Schur polynomial $s_{\lambda}$ one can associated its derived polynomials $s_{\lambda}{(i)}$ $i=0,\ldots,|\lambda|$ by the rule $$s_{\lambda}(x_1+t,\ldots,x_n+t) = \sum_i s_{\lambda}^{(i)}(x_1,\ldots,x_n) t^i.$$ We conjecture that $$(s_{\lambda}^{(i)})^2 - s_{\lambda}^{(i-1)} s_{\lambda}^{(i+1)}$$ is always Schur positive and prove this when $i=1$ for rectangles $\lambda = (k^\ell)$, for hooks $\lambda = (k, 1^{\ell -1})$, and when $\lambda = (k,k,1)$ or $\lambda = (3,2^{k-1})$.


title: Integral Varadhan formula for non-linear heat flow

abstract: We prove the integral Varadhan short-time formula for non-linear heat flow on measured Finsler manifolds. To the best of the authors' knowledge, this is the first result establishing a Varadhan-type formula for non-linear semigroups. We do not assume the reversibility of the metric, and the distance function can be asymmetric. Within this generality, we reveal that the probabilistic interpretation is well-suited for our formula; the probability that a particle starting from a set $A$ can be found in another set $B$ describes the distance from $A$ to $B$. One side of the estimates (the upper bound of the probability) is also established in the nonsmooth setting of infinitesimally strictly convex metric measure spaces satisfying the local Sobolev-to-Lipschitz property.


title: How do polymers stretch in capillary-driven extensional flows?

abstract: Measurements of the capillary-driven thinning and breakup of fluid filaments are widely used to extract extensional rheological properties of complex materials. For viscoelastic (e.g., polymeric) fluids, the determination of the longest relaxation time depends on several assumptions concerning the polymeric response to the flow that are derived from constitutive models. Our capillary thinning experiments using polymeric fluids with a wide range of extensibility, suggest that these assumptions are likely only valid for highly extensible polymers but do not hold in general. For polymers with relatively low extensibility, such as polyectrolytes in salt-free media, conventional extrapolation of the longest relaxation time from capillary thinning techniques leads to a significant underestimation.


title: Testing Business Cycle Theories: Evidence from the Great Recession

abstract: Empirical business cycle studies using cross-country data usually cannot achieve causal relationships while within-country studies mostly focus on the bust period. We provide the first causal investigation into the boom period of the 1999-2010 U.S. cross-metropolitan business cycle. Using a novel research design, we show that credit expansion in private-label mortgages causes a differentially stronger boom (2000-2006) and bust (2007-2010) cycle in the house-related industries in the high net-export-growth areas. Most importantly, our unique research design enables us to perform the most comprehensive tests on theories (hypotheses) regarding the business cycle. We show that the following theories (hypotheses) cannot explain the cause of the 1999-2010 U.S. business cycle: the speculative euphoria hypothesis, the real business cycle theory, the collateral-driven credit cycle theory, the business uncertainty theory, and the extrapolative expectation theory.


title: Artificial Intelligence Exploring the Patent Field

abstract: Advanced language-processing and machine-learning techniques promise massive efficiency improvements in the previously widely manual field of patent and technical knowledge management. This field presents large-scale and complex data with very precise contents and language representation of those contents. Particularly, patent texts can differ from mundane texts in various aspects, which entails significant opportunities and challenges. This paper presents a systematic overview of patent-related tasks and popular methodologies with a special focus on evolving and promising techniques. Language processing and particularly large language models as well as the recent boost of general generative methods promise to become game changers in the patent field. The patent literature and the fact-based argumentative procedures around patents appear almost as an ideal use case. However, patents entail a number of difficulties with which existing models struggle. The paper introduces fundamental aspects of patents and patent-related data that affect technology that wants to explore or manage them. It further reviews existing methods and approaches and points out how important reliable and unbiased evaluation metrics become. Although research has made substantial progress on certain tasks, the performance across many others remains suboptimal, sometimes because of either the special nature of patents and their language or inconsistencies between legal terms and the everyday meaning of terms. Moreover, yet few methods have demonstrated the ability to produce satisfactory text for specific sections of patents. By pointing out key developments, opportunities, and gaps, we aim to encourage further research and accelerate the advancement of this field.


title: Understanding Biology in the Age of Artificial Intelligence

abstract: Modern life sciences research is increasingly relying on artificial intelligence approaches to model biological systems, primarily centered around the use of machine learning (ML) models. Although ML is undeniably useful for identifying patterns in large, complex data sets, its widespread application in biological sciences represents a significant deviation from traditional methods of scientific inquiry. As such, the interplay between these models and scientific understanding in biology is a topic with important implications for the future of scientific research, yet it is a subject that has received little attention. Here, we draw from an epistemological toolkit to contextualize recent applications of ML in biological sciences under modern philosophical theories of understanding, identifying general principles that can guide the design and application of ML systems to model biological phenomena and advance scientific knowledge. We propose that conceptions of scientific understanding as information compression, qualitative intelligibility, and dependency relation modelling provide a useful framework for interpreting ML-mediated understanding of biological systems. Through a detailed analysis of two key application areas of ML in modern biological research - protein structure prediction and single cell RNA-sequencing - we explore how these features have thus far enabled ML systems to advance scientific understanding of their target phenomena, how they may guide the development of future ML models, and the key obstacles that remain in preventing ML from achieving its potential as a tool for biological discovery. Consideration of the epistemological features of ML applications in biology will improve the prospects of these methods to solve important problems and advance scientific understanding of living systems.


title: General Mneimneh-type Binomial Sum involving Harmonic Numbers

abstract: Recently, Mneimneh proved the remarkable identity \begin{align*} \sum_{k=0}^n H_k\binom{n}{k} p^k(1-p)^{n-k}=\sum_{i=1}^n \frac{1-(1-p)^i}{i}\quad (p\in [0,1]) \end{align*} as the main result of a 2023 \emph{Discrete Mathematics} paper, where $H_k:=\sum\nolimits_{i=1}^k 1/i$ is the classical $k$-th harmonic number. Thereafter, Campbell provided several other proofs of Mneimneh's formula as above in a note published in \emph{Discrete Mathematics} in 2023. Moreover, Campbell also considered how Mneimneh's identity may be proved and generalized using the \emph{Mathematica package Sigma}. In particular, he found the generalized Mneimneh's identity \begin{align*} \sum_{k=0}^n x^k y^{n-k} \binom{n}{k}H_k =(x+y)^n \left(H_n-\sum_{i=1}^n \frac{y^i (x+y)^{-i}}{i}\right). \end{align*} In this paper, we will prove a more generalization of Mneimneh's identity involving Bell numbers and some Mneimneh-type identities involving (alternating) harmonic numbers by using a few results of our previous papers.


title: Monotonicity of Recurrence in Random Walks

abstract: We consider non-homogeneous random walks on the positive quadrant in two dimensions. In the 1960's the following question was asked: is it true if such a random walk $X$ is recurrent and $Y$ is another random walk that at every point is more likely to go down and more likely to go left than $Y$, then $Y$ is also recurrent? We provide an example showing that the answer is negative. We also show that if either the random walk $X$ or $Y$ is sufficiently homogeneous then the answer is in fact positive.


title: Using Causal Trees to Estimate Personalized Task Difficulty in Post-Stroke Individuals

abstract: Adaptive training programs are crucial for recovery post stroke. However, developing programs that automatically adapt depends on quantifying how difficult a task is for a specific individual at a particular stage of their recovery. In this work, we propose a method that automatically generates regions of different task difficulty levels based on an individual's performance. We show that this technique explains the variance in user performance for a reaching task better than previous approaches to estimating task difficulty.


title: Outerplanar graphs with positive Lin-Lu-Yau curvature

abstract: In this paper, we show that all simple outerplanar graphs $G$ with minimum degree at least $2$ and positive Lin-Lu-Yau Ricci curvature on every edge have maximum degree at most $9$. Furthermore, if $G$ is maximally outerplanar, then $G$ has at most $10$ vertices. Both upper bounds are sharp.


title: Multi-Level Attention Aggregation for Language-Agnostic Speaker Replication

abstract: This paper explores the task of language-agnostic speaker replication, a novel endeavor that seeks to replicate a speaker's voice irrespective of the language they are speaking. Towards this end, we introduce a multi-level attention aggregation approach that systematically probes and amplifies various speaker-specific attributes in a hierarchical manner. Through rigorous evaluations across a wide range of scenarios including seen and unseen speakers conversing in seen and unseen lingua, we establish that our proposed model is able to achieve substantial speaker similarity, and is able to generalize to out-of-domain (OOD) cases.


title: Multi-Object Tracking with Camera-LiDAR Fusion for Autonomous Driving

abstract: This paper presents a novel multi-modal Multi-Object Tracking (MOT) algorithm for self-driving cars that combines camera and LiDAR data. Camera frames are processed with a state-of-the-art 3D object detector, whereas classical clustering techniques are used to process LiDAR observations. The proposed MOT algorithm comprises a three-step association process, an Extended Kalman filter for estimating the motion of each detected dynamic obstacle, and a track management phase. The EKF motion model requires the current measured relative position and orientation of the observed object and the longitudinal and angular velocities of the ego vehicle as inputs. Unlike most state-of-the-art multi-modal MOT approaches, the proposed algorithm does not rely on maps or knowledge of the ego global pose. Moreover, it uses a 3D detector exclusively for cameras and is agnostic to the type of LiDAR sensor used. The algorithm is validated both in simulation and with real-world data, with satisfactory results.


title: ZTRAN: Prototyping Zero Trust Security xApps for Open Radio Access Network Deployments

abstract: The open radio access network (O-RAN) offers new degrees of freedom for building and operating advanced cellular networks. Emphasizing on RAN disaggregation, open interfaces, multi-vendor support, and RAN intelligent controllers (RICs), O-RAN facilitates adaptation to new applications and technology trends. Yet, this architecture introduces new security challenges. This paper proposes leveraging zero trust principles for O-RAN security. We introduce zero trust RAN (ZTRAN), which embeds service authentication, intrusion detection, and secure slicing subsystems that are encapsulated as xApps. We implement ZTRAN on the open artificial intelligence cellular (OAIC) research platform and demonstrate its feasibility and effectiveness in terms of legitimate user throughput and latency figures. Our experimental analysis illustrates how ZTRAN's intrusion detection and secure slicing microservices operate effectively and in concert as part of O-RAN Alliance's containerized near-real time RIC. Research directions include exploring machine learning and additional threat intelligence feeds for improving the performance and extending the scope of ZTRAN.


title: Closing the Visual Sim-to-Real Gap with Object-Composable NeRFs

abstract: Deep learning methods for perception are the cornerstone of many robotic systems. Despite their potential for impressive performance, obtaining real-world training data is expensive, and can be impractically difficult for some tasks. Sim-to-real transfer with domain randomization offers a potential workaround, but often requires extensive manual tuning and results in models that are brittle to distribution shift between sim and real. In this work, we introduce Composable Object Volume NeRF (COV-NeRF), an object-composable NeRF model that is the centerpiece of a real-to-sim pipeline for synthesizing training data targeted to scenes and objects from the real world. COV-NeRF extracts objects from real images and composes them into new scenes, generating photorealistic renderings and many types of 2D and 3D supervision, including depth maps, segmentation masks, and meshes. We show that COV-NeRF matches the rendering quality of modern NeRF methods, and can be used to rapidly close the sim-to-real gap across a variety of perceptual modalities.


title: DNAct: Diffusion Guided Multi-Task 3D Policy Learning

abstract: This paper presents DNAct, a language-conditioned multi-task policy framework that integrates neural rendering pre-training and diffusion training to enforce multi-modality learning in action sequence spaces. To learn a generalizable multi-task policy with few demonstrations, the pre-training phase of DNAct leverages neural rendering to distill 2D semantic features from foundation models such as Stable Diffusion to a 3D space, which provides a comprehensive semantic understanding regarding the scene. Consequently, it allows various applications to challenging robotic tasks requiring rich 3D semantics and accurate geometry. Furthermore, we introduce a novel approach utilizing diffusion training to learn a vision and language feature that encapsulates the inherent multi-modality in the multi-task demonstrations. By reconstructing the action sequences from different tasks via the diffusion process, the model is capable of distinguishing different modalities and thus improving the robustness and the generalizability of the learned representation. DNAct significantly surpasses SOTA NeRF-based multi-task manipulation approaches with over 30% improvement in success rate. Project website: dnact.github.io.


title: Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesis

abstract: X-ray is widely applied for transmission imaging due to its stronger penetration than natural light. When rendering novel view X-ray projections, existing methods mainly based on NeRF suffer from long training time and slow inference speed. In this paper, we propose a 3D Gaussian splatting-based framework, namely X-Gaussian, for X-ray novel view synthesis. Firstly, we redesign a radiative Gaussian point cloud model inspired by the isotropic nature of X-ray imaging. Our model excludes the influence of view direction when learning to predict the radiation intensity of 3D points. Based on this model, we develop a Differentiable Radiative Rasterization (DRR) with CUDA implementation. Secondly, we customize an Angle-pose Cuboid Uniform Initialization (ACUI) strategy that directly uses the parameters of the X-ray scanner to compute the camera information and then uniformly samples point positions within a cuboid enclosing the scanned object. Experiments show that our X-Gaussian outperforms state-of-the-art methods by 6.5 dB while enjoying less than 15% training time and over 73x inference speed. The application on sparse-view CT reconstruction also reveals the practical values of our method. Code and models will be publicly available at https://github.com/caiyuanhao1998/X-Gaussian . A video demo of the training process visualization is at https://www.youtube.com/watch?v=gDVf_Ngeghg .


title: New quasi-Einstein metrics on a two-sphere

abstract: We construct all axi-symmetric non-gradient $m$-quasi-Einstein structures on a two-sphere. This includes the spatial cross-section of the extreme Kerr black hole horizon corresponding to $m=2$, as well as a family of new regular metrics with $m\neq 2$ given in terms of hypergeometric functions. We also show that in the case $m=-1$ with vanishing cosmological constant the only orientable compact solution in dimension two is the flat torus, which proves that there are no compact surfaces with a metrisable affine connection with skew Ricci tensor.


title: Globally Stable Neural Imitation Policies

abstract: Imitation learning presents an effective approach to alleviate the resource-intensive and time-consuming nature of policy learning from scratch in the solution space. Even though the resulting policy can mimic expert demonstrations reliably, it often lacks predictability in unexplored regions of the state-space, giving rise to significant safety concerns in the face of perturbations. To address these challenges, we introduce the Stable Neural Dynamical System (SNDS), an imitation learning regime which produces a policy with formal stability guarantees. We deploy a neural policy architecture that facilitates the representation of stability based on Lyapunov theorem, and jointly train the policy and its corresponding Lyapunov candidate to ensure global stability. We validate our approach by conducting extensive experiments in simulation and successfully deploying the trained policies on a real-world manipulator arm. The experimental results demonstrate that our method overcomes the instability, accuracy, and computational intensity problems associated with previous imitation learning methods, making our method a promising solution for stable policy learning in complex planning scenarios.


title: Shalika newforms for GL(n)

abstract: Let (pi,V) be a generic irreducible representation of a general linear group over a p-adic field. Jacquet, Piatetski-Shapiro, and Shalika gave an open compact subgroup K, so that the subspace V^K consisting of v in V fixed by K is one-dimensional. If pi has a Shalika model Lambda, then we call vectors in Lambda(V) the Shalika forms of pi, and those in Lambda(V^{K}) the Shalika newforms. In this article, we give a method to determine all values of the Shalika newforms on the mirabolic subgroup in the case where pi is supercuspidal. Using this result, we give another Shalika form with nice properties, which is not fixed by K in the case where the character defining the Shalika model is ramified.


title: A data-centric approach to class-specific bias in image data augmentation

abstract: Data augmentation (DA) enhances model generalization in computer vision but may introduce biases, impacting class accuracy unevenly. Our study extends this inquiry, examining DA's class-specific bias across various datasets, including those distinct from ImageNet, through random cropping. We evaluated this phenomenon with ResNet50, EfficientNetV2S, and SWIN ViT, discovering that while residual models showed similar bias effects, Vision Transformers exhibited greater robustness or altered dynamics. This suggests a nuanced approach to model selection, emphasizing bias mitigation. We also refined a "data augmentation robustness scouting" method to manage DA-induced biases more efficiently, reducing computational demands significantly (training 112 models instead of 1860; a reduction of factor 16.2) while still capturing essential bias trends.


title: Can Large Language Models Reason and Plan?

abstract: While humans sometimes do show the capability of correcting their own erroneous guesses with self-critiquing, there seems to be no basis for that assumption in the case of LLMs.


title: Sliding into DM: Determining the local dark matter density and speed distribution using only the local circular speed of the Galaxy

abstract: We use FIRE-2 zoom simulations of Milky Way size disk galaxies to derive easy-to-use relationships between the observed circular speed of the Galaxy at the Solar location, $v_\mathrm{c}$, and dark matter properties of relevance for direct detection experiments: the dark matter density, the dark matter velocity dispersion, and the speed distribution of dark matter particles near the Solar location. We find that both the local dark matter density and 3D velocity dispersion follow tight power laws with $v_\mathrm{c}$. Using this relation together with the observed circular speed of the Milky Way at the Solar radius, we infer the local dark matter density and velocity dispersion near the Sun to be $\rho = 0.42\pm 0.06\,\mathrm{GeV\,cm^{-3}}$ and $\sigma_\mathrm{3D} = 280^{+19}_{-18}\,\mathrm{km\,s^{-1}}$. We also find that the distribution of dark matter particle speeds is well-described by a modified Maxwellian with two shape parameters, both of which correlate with the observed $v_{\rm c}$. We use that modified Maxwellian to predict the speed distribution of dark matter near the Sun and find that it peaks at a most probable speed of $250\,\mathrm{km\,s^{-1}}$ and begins to truncate sharply above $470\,\mathrm{km\,s^{-1}}$. This peak speed is somewhat higher than expected from the standard halo model, and the truncation occurs well below the formal escape speed to infinity, with fewer very-high-speed particles than assumed in the standard halo model.


title: Exploring LLM-based Agents for Root Cause Analysis

abstract: The growing complexity of cloud based software systems has resulted in incident management becoming an integral part of the software development lifecycle. Root cause analysis (RCA), a critical part of the incident management process, is a demanding task for on-call engineers, requiring deep domain knowledge and extensive experience with a team's specific services. Automation of RCA can result in significant savings of time, and ease the burden of incident management on on-call engineers. Recently, researchers have utilized Large Language Models (LLMs) to perform RCA, and have demonstrated promising results. However, these approaches are not able to dynamically collect additional diagnostic information such as incident related logs, metrics or databases, severely restricting their ability to diagnose root causes. In this work, we explore the use of LLM based agents for RCA to address this limitation. We present a thorough empirical evaluation of a ReAct agent equipped with retrieval tools, on an out-of-distribution dataset of production incidents collected at Microsoft. Results show that ReAct performs competitively with strong retrieval and reasoning baselines, but with highly increased factual accuracy. We then extend this evaluation by incorporating discussions associated with incident reports as additional inputs for the models, which surprisingly does not yield significant performance improvements. Lastly, we conduct a case study with a team at Microsoft to equip the ReAct agent with tools that give it access to external diagnostic services that are used by the team for manual RCA. Our results show how agents can overcome the limitations of prior work, and practical considerations for implementing such a system in practice.


title: Privacy-preserving Fine-tuning of Large Language Models through Flatness

abstract: The privacy concerns associated with the use of Large Language Models (LLMs) have grown recently with the development of LLMs such as ChatGPT. Differential Privacy (DP) techniques are explored in existing work to mitigate their privacy risks at the cost of generalization degradation. Our paper reveals that the flatness of DP-trained models' loss landscape plays an essential role in the trade-off between their privacy and generalization. We further propose a holistic framework to enforce appropriate weight flatness, which substantially improves model generalization with competitive privacy preservation. It innovates from three coarse-to-grained levels, including perturbation-aware min-max optimization on model weights within a layer, flatness-guided sparse prefix-tuning on weights across layers, and weight knowledge distillation between DP \& non-DP weights copies. Comprehensive experiments of both black-box and white-box scenarios are conducted to demonstrate the effectiveness of our proposal in enhancing generalization and maintaining DP characteristics. For instance, on text classification dataset QNLI, DP-Flat achieves similar performance with non-private full fine-tuning but with DP guarantee under privacy budget $\epsilon=3$, and even better performance given higher privacy budgets. Codes are provided in the supplement.


title: ComFe: Interpretable Image Classifiers With Foundation Models, Transformers and Component Features

abstract: Interpretable computer vision models are able to explain their reasoning through comparing the distances between the image patch embeddings and prototypes within a latent space. However, many of these approaches introduce additional complexity, can require multiple training steps and often have a performance cost in comparison to black-box approaches. In this work, we introduce Component Features (ComFe), a novel interpretable-by-design image classification approach that is highly scalable and can obtain better accuracy and robustness in comparison to non-interpretable methods. Inspired by recent developments in computer vision foundation models, ComFe uses a transformer-decoder head and a hierarchical mixture-modelling approach with a foundation model backbone to obtain higher accuracy compared to previous interpretable models across a range of fine-grained vision benchmarks, without the need to individually tune hyper-parameters for each dataset. With only global image labels and no segmentation or part annotations, ComFe can identify consistent component features within an image and determine which of these features are informative in making a prediction.


title: Optimal Scheduling of Graph States via Path Decompositions

abstract: We study the optimal scheduling of graph states in measurement-based quantum computation, establishing an equivalence between measurement schedules and path decompositions of graphs. We define the spatial cost of a measurement schedule based on the number of simultaneously active qubits and prove that an optimal measurement schedule corresponds to a path decomposition of minimal width. Our analysis shows that approximating the spatial cost of a graph is $\textsf{NP}$-hard, while for graphs with bounded spatial cost, we establish an efficient algorithm for computing an optimal measurement schedule.


title: Constraints on the topology of Type IIB string theory

abstract: We discuss some topological constraints on Type IIB string theory that cannot be described by elementary characteristic classes. Anomaly cancellation of the worldvolume theory of a D3-brane requires a shifted Dirac quantization condition of the Ramond-Ramond 5-form flux. However, the required shift is sometimes inconsistent depending on the topology of spacetime backgrounds. The obstruction to the existence of a shifted quantization is described by a degree-6 cohomology class whose definition involves spin structure of spacetime manifolds. The cohomology class is interpreted as a background D3-charge, and the Gauss law constraint requires inclusion of additional D3-branes to cancel it.


title: Low-Dimensional Projection of Reactive Islands in Chemical Reaction Dynamics Using a Supervised Dimensionality Reduction Method

abstract: Transition state theory is a standard framework for predicting the rate of a chemical reaction. Although the transition state theory has been successfully applied to numerous chemical reaction analyses, many experimental and theoretical studies have reported chemical reactions with a reactivity which cannot be explained by the transition state theory due to dynamic effects. Dynamical systems theory provides a theoretical framework for elucidating dynamical mechanisms of such chemical reactions. In particular, reactive islands are essential phase space structures revealing dynamical reaction patterns. However, the numerical computation of reactive islands in a reaction system of many degrees of freedom involves an intrinsic challenge -- the curse of dimensionality. In this paper, we propose a dimensionality reduction algorithm for computing reactive islands in a reaction system of many degrees of freedom. Using the supervised principal component analysis, the proposed algorithm projects reactive islands into a low-dimensional phase space with preserving the dynamical information on reactivity as much as possible. The effectiveness of the proposed algorithm is examined by numerical experiments for H\'enon-Heiles systems extended to many degrees of freedom. The numerical results indicate that our proposed algorithm is effective in terms of the quality of reactivity prediction and the clearness of the boundaries of projected reactive islands. The proposed algorithm is a promising elemental technology for practical applications of dynamical systems analysis to real chemical systems.


title: Quasiperiods of Magic Labeling Quasipolynomials

abstract: A magic labeling of a graph is a labeling of the edges by nonnegative integers such that the label sum over the edges incident to every vertex is the same. This common label sum is known as the index. We count magic labelings by maximum edge label, rather than index, using an Ehrhart-theoretic approach. In contrast to Stanley's 1973 work showing that the function counting magic labelings with bounded index is a quasipolynomial with quasiperiod $2$, we show by construction that the minimum quasiperiod of the quasipolynomial counting magic labelings with bounded maximum label can be arbitrarily large, even for planar bipartite graphs. Unfortunately, this rules out a certain Ehrhart-theoretic approach to proving Hartsfield and Ringel's Antimagic Graph Conjecture. However, we show that this quasipolynomial is in fact a polynomial for any bipartite graph with matching preclusion number at most $1$, which includes any bipartite graph with a leaf.


title: An Explainable AI Framework for Artificial Intelligence of Medical Things

abstract: The healthcare industry has been revolutionized by the convergence of Artificial Intelligence of Medical Things (AIoMT), allowing advanced data-driven solutions to improve healthcare systems. With the increasing complexity of Artificial Intelligence (AI) models, the need for Explainable Artificial Intelligence (XAI) techniques become paramount, particularly in the medical domain, where transparent and interpretable decision-making becomes crucial. Therefore, in this work, we leverage a custom XAI framework, incorporating techniques such as Local Interpretable Model-Agnostic Explanations (LIME), SHapley Additive exPlanations (SHAP), and Gradient-weighted Class Activation Mapping (Grad-Cam), explicitly designed for the domain of AIoMT. The proposed framework enhances the effectiveness of strategic healthcare methods and aims to instill trust and promote understanding in AI-driven medical applications. Moreover, we utilize a majority voting technique that aggregates predictions from multiple convolutional neural networks (CNNs) and leverages their collective intelligence to make robust and accurate decisions in the healthcare system. Building upon this decision-making process, we apply the XAI framework to brain tumor detection as a use case demonstrating accurate and transparent diagnosis. Evaluation results underscore the exceptional performance of the XAI framework, achieving high precision, recall, and F1 scores with a training accuracy of 99% and a validation accuracy of 98%. Combining advanced XAI techniques with ensemble-based deep-learning (DL) methodologies allows for precise and reliable brain tumor diagnoses as an application of AIoMT.


title: Extract Mechanisms from Heterogeneous Effects: Identification Strategy for Mediation Analysis

abstract: Understanding causal mechanisms is essential for explaining and generalizing empirical phenomena. Causal mediation analysis offers statistical techniques to quantify mediation effects. However, existing methods typically require strong identification assumptions or sophisticated research designs. We develop a new identification strategy that simplifies these assumptions, enabling the simultaneous estimation of causal and mediation effects. The strategy is based on a novel decomposition of total treatment effects, which transforms the challenging mediation problem into a simple linear regression problem. The new method establishes a new link between causal mediation and causal moderation. We discuss several research designs and estimators to increase the usability of our identification strategy for a variety of empirical studies. We demonstrate the application of our method by estimating the causal mediation effect in experiments concerning common pool resource governance and voting information. Additionally, we have created statistical software to facilitate the implementation of our method.


title: Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference

abstract: Large Language Models (LLMs) have unlocked new capabilities and applications; however, evaluating the alignment with human preferences still poses significant challenges. To address this issue, we introduce Chatbot Arena, an open platform for evaluating LLMs based on human preferences. Our methodology employs a pairwise comparison approach and leverages input from a diverse user base through crowdsourcing. The platform has been operational for several months, amassing over 240K votes. This paper describes the platform, analyzes the data we have collected so far, and explains the tried-and-true statistical methods we are using for efficient and accurate evaluation and ranking of models. We confirm that the crowdsourced questions are sufficiently diverse and discriminating and that the crowdsourced human votes are in good agreement with those of expert raters. These analyses collectively establish a robust foundation for the credibility of Chatbot Arena. Because of its unique value and openness, Chatbot Arena has emerged as one of the most referenced LLM leaderboards, widely cited by leading LLM developers and companies. Our demo is publicly available at \url{https://chat.lmsys.org}.


title: Towards learning-based planning:The nuPlan benchmark for real-world autonomous driving

abstract: Machine Learning (ML) has replaced traditional handcrafted methods for perception and prediction in autonomous vehicles. Yet for the equally important planning task, the adoption of ML-based techniques is slow. We present nuPlan, the world's first real-world autonomous driving dataset, and benchmark. The benchmark is designed to test the ability of ML-based planners to handle diverse driving situations and to make safe and efficient decisions. To that end, we introduce a new large-scale dataset that consists of 1282 hours of diverse driving scenarios from 4 cities (Las Vegas, Boston, Pittsburgh, and Singapore) and includes high-quality auto-labeled object tracks and traffic light data. We exhaustively mine and taxonomize common and rare driving scenarios which are used during evaluation to get fine-grained insights into the performance and characteristics of a planner. Beyond the dataset, we provide a simulation and evaluation framework that enables a planner's actions to be simulated in closed-loop to account for interactions with other traffic participants. We present a detailed analysis of numerous baselines and investigate gaps between ML-based and traditional methods. Find the nuPlan dataset and code at nuplan.org.


title: An Adaptable, Safe, and Portable Robot-Assisted Feeding System

abstract: We demonstrate a robot-assisted feeding system that enables people with mobility impairments to feed themselves. Our system design embodies Safety, Portability, and User Control, with comprehensive full-stack safety checks, the ability to be mounted on and powered by any powered wheelchair, and a custom web-app allowing care-recipients to leverage their own assistive devices for robot control. For bite acquisition, we leverage multi-modal online learning to tractably adapt to unseen food types. For bite transfer, we leverage real-time mouth perception and interaction-aware control. Co-designed with community researchers, our system has been validated through multiple end-user studies.


title: Unsupervised Learning of Harmonic Analysis Based on Neural HSMM with Code Quality Templates

abstract: This paper presents a method of unsupervised learning of harmonic analysis based on a hidden semi-Markov model (HSMM). We introduce the chord quality templates, which specify the probability of pitch class emissions given a root note and a chord quality. Other probability distributions that comprise the HSMM are automatically learned via unsupervised learning, which has been a challenge in existing research. The results of the harmonic analysis of the proposed model were evaluated using existing labeled data. While our proposed method has yet to perform as well as existing models that used supervised learning and complex rule design, it has the advantage of not requiring expensive labeled data or rule elaboration. Furthermore, we also show how to recognize the tonic without prior knowledge, based on the transition probabilities of the Markov model.


title: Optically Probing Unconventional Superconductivity in Atomically Thin Bi$_2$Sr$_2$Ca$_{0.92}$Y$_{0.08}$Cu$_2$O$_{8+{\delta}}$

abstract: Atomically thin cuprates exhibiting a superconducting phase transition temperature similar to bulk have recently been realized, although the device fabrication remains a challenge and limits the potential for many novel studies and applications. Here we use an optical pump-probe approach to noninvasively study the unconventional superconductivity in atomically thin Bi$_2$Sr$_2$Ca$_{0.92}$Y$_{0.08}$Cu$_2$O$_{8+{\delta}}$ (Y-Bi2212). Apart from finding an optical response due to the superconducting phase transition that is similar to bulk Y-Bi2212, we observe that the sign and amplitude of the pump-probe signal in the atomically thin flake vary significantly in different dielectric environments depending on the nature of the optical excitation. By exploiting the spatial resolution of the optical probe, we uncover the exceptional sensitivity of monolayer Y-Bi2212 to the environment. Our results provide the first optical evidence for the intralayer nature of the superconducting condensate in Bi2212, and highlight the role of double-sided encapsulation in preserving superconductivity in atomically thin cuprates.


title: The compact operators on $c_0$ as a Calkin algebra

abstract: For a Banach space $X$, let $\mathcal{L}(X)$ denote the algebra of all bounded linear operators on $X$ and let $\mathcal{K}(X)$ denote the compact operator ideal in $\mathcal{L}(X)$. The quotient algebra $\mathcal{L}(X)/\mathcal{K}(X)$ is called the Calkin algebra of $X$, and it is denoted $\mathcal{C}al(X)$. We prove that the unitization of $\mathcal{K}(c_0)$ is isomorphic as a Banach algebra to the Calkin algebra of some Banach space $\mathcal{Z}_{\mathcal{K}(c_0)}$. This Banach space is an Argyros-Haydon sum $(\oplus_{n=1}^\infty X_n)_\mathrm{AH}$ of a sequence of copies $X_n$ of a single Argyros-Haydon space $\mathfrak{X}_\mathrm{AH}$, and the external versus the internal Argyros-Haydon construction parameters are chosen from disjoint sets.


title: Astrochemical effect of the fundamental grain surface processes I. The diffusion of grain surface species and the pre-exponential factor

abstract: Abbreviation. Thermal diffusion is one of the basic processes for the mobility and formation of species on cosmic dust grains. Recent laboratory measurements have found that the diffusion pre-exponential factor can differ from that for desorption by several orders of magnitude. We aim to evaluate the effect of the newly experimentally measured diffusion pre-exponential factor on the chemistry under cold molecular cloud conditions. We found that statistically, more than half of the total gas-phase and grain surface species are not affected by the new pre-exponential factor after a chemical evolution of 10$^5$ yr. The most abundant gas-phase CO and grain surface water ice are not affected by the new pre-exponential factor. For the grain surface species that are affected, compared to the commonly adopted value of the pre-exponential factor for diffusion used in the chemical models, they could be either overproduced or underproduced with the lower diffusion pre-factor used in this work. The former case applies to radicals and the species that serve as reactants, while the latter case applies to complex organic molecules (COMs) on the grain and the species that rarely react with other species. Gas-phase species could also be affected due to the desorption of the grain surface species. The abundance of some gas-phase COMs could be varied by over one order of magnitude depending on the adopted grain surface temperature and/or the ratio of diffusion to desorption energy in the model. Key species whose diffusion pre-exponential factor significantly affects the model predictions were also evaluated, and these specie include CH3OH, H2CO, and NO. The results presented in this study show that the pre-exponential factor is one of the basic and important parameters in astrochemical models.


title: Snevily's Conjecture about $\mathcal{L}$-intersecting Families on Set Systems and its Analogue on Vector Spaces

abstract: The classical Erd\H{o}s-Ko-Rado theorem on the size of an intersecting family of $k$-subsets of the set $[n] = \{1, 2, \dots, n\}$ is one of the fundamental intersection theorems for set systems. After the establishment of the EKR theorem, many intersection theorems on set systems have appeared in the literature, such as the well-known Frankl-Wilson theorem, Alon-Babai-Suzuki theorem, and Grolmusz-Sudakov theorem. In 1995, Snevily proposed the conjecture that the upper bound for the size of an $\mathcal{L}$-intersecting family of subsets of $[n]$ is ${{n} \choose {s}}$ under the condition $\max \{l_{i}\} < \min \{k_{j}\}$, where $\mathcal{L} = \{l_{1}, \dots, l_{s}\}$ with $0 \leq l_{1} < \cdots < l_{s}$ and $k_{j}$ are subset sizes in the family. In this paper, we prove that Snevily's conjecture holds for $n \geq {{k^{2}} \choose {l_{1}+1}}s + l_{1}$, where $k$ is the maximum subset size in the family. We then derive an analogous result for $\mathcal{L}$-intersecting families of subspaces of an $n$-dimensional vector space over a finite field $\mathbb{F}_{q}$.


title: Contrastive Augmented Graph2Graph Memory Interaction for Few Shot Continual Learning

abstract: Few-Shot Class-Incremental Learning (FSCIL) has gained considerable attention in recent years for its pivotal role in addressing continuously arriving classes. However, it encounters additional challenges. The scarcity of samples in new sessions intensifies overfitting, causing incompatibility between the output features of new and old classes, thereby escalating catastrophic forgetting. A prevalent strategy involves mitigating catastrophic forgetting through the Explicit Memory (EM), which comprise of class prototypes. However, current EM-based methods retrieves memory globally by performing Vector-to-Vector (V2V) interaction between features corresponding to the input and prototypes stored in EM, neglecting the geometric structure of local features. This hinders the accurate modeling of their positional relationships. To incorporate information of local geometric structure, we extend the V2V interaction to Graph-to-Graph (G2G) interaction. For enhancing local structures for better G2G alignment and the prevention of local feature collapse, we propose the Local Graph Preservation (LGP) mechanism. Additionally, to address sample scarcity in classes from new sessions, the Contrast-Augmented G2G (CAG2G) is introduced to promote the aggregation of same class features thus helps few-shot learning. Extensive comparisons on CIFAR100, CUB200, and the challenging ImageNet-R dataset demonstrate the superiority of our method over existing methods.


title: VLBI Astrometry of Radio Stars to Link Radio and Optical Celestial Reference Frames: Observing Strategies

abstract: The Gaia celestial reference frame (Gaia-CRF) will benefit from a close assessment with independent methods, such as Very Long Baseline Interferometry (VLBI) measurements of radio stars at bright magnitudes. However, obtaining full astrometric parameters for each radio star through VLBI measurements demands a significant amount of observation time. This study proposes an efficient observing strategy that acquires double-epoch VLBI positions to measure the positions and proper motions of radio stars at a reduced cost. The solution for CRF link compatible with individual VLBI position measurements is introduced, and the optimized observing epoch scheduling is discussed. Applying this solution to observational data yields results sensitive to sample increase or decrease, yet they remain consistently in line with the literature at the 1-sigma level. This suggests the potential for improvement with a larger sample size. Simulations for adding observations demonstrate the double-epoch strategy reduces CRF link parameter uncertainties by over 30% compared to the five-parameter strategy.


title: Hitchhiker's guide to cancer-associated lymphoid aggregates in histology images: manual and deep learning-based quantification approaches

abstract: Quantification of lymphoid aggregates including tertiary lymphoid structures with germinal centers in histology images of cancer is a promising approach for developing prognostic and predictive tissue biomarkers. In this article, we provide recommendations for identifying lymphoid aggregates in tissue sections from routine pathology workflows such as hematoxylin and eosin staining. To overcome the intrinsic variability associated with manual image analysis (such as subjective decision making, attention span), we recently developed a deep learning-based algorithm called HookNet-TLS to detect lymphoid aggregates and germinal centers in various tissues. Here, we additionally provide a guideline for using manually annotated images for training and implementing HookNet-TLS for automated and objective quantification of lymphoid aggregates in various cancer types.


title: Incremental Bayesian Learning for Fail-Operational Control in Autonomous Driving

abstract: Abrupt maneuvers by surrounding vehicles (SVs) can typically lead to safety concerns and affect the task efficiency of the ego vehicle (EV), especially with model uncertainties stemming from environmental disturbances. This paper presents a real-time fail-operational controller that ensures the asymptotic convergence of an uncertain EV to a safe state, while preserving task efficiency in dynamic environments. An incremental Bayesian learning approach is developed to facilitate online learning and inference of changing environmental disturbances. Leveraging disturbance quantification and constraint transformation, we develop a stochastic fail-operational barrier based on the control barrier function (CBF). With this development, the uncertain EV is able to converge asymptotically from an unsafe state to a defined safe state with probabilistic stability. Subsequently, the stochastic fail-operational barrier is integrated into an efficient fail-operational controller based on quadratic programming (QP). This controller is tailored for the EV operating under control constraints in the presence of environmental disturbances, with both safety and efficiency objectives taken into consideration. We validate the proposed framework in connected cruise control (CCC) tasks, where SVs perform aggressive driving maneuvers. The simulation results demonstrate that our method empowers the EV to swiftly return to a safe state while upholding task efficiency in real time, even under time-varying environmental disturbances.


title: FedClust: Optimizing Federated Learning on Non-IID Data through Weight-Driven Client Clustering

abstract: Federated learning (FL) is an emerging distributed machine learning paradigm enabling collaborative model training on decentralized devices without exposing their local data. A key challenge in FL is the uneven data distribution across client devices, violating the well-known assumption of independent-and-identically-distributed (IID) training samples in conventional machine learning. Clustered federated learning (CFL) addresses this challenge by grouping clients based on the similarity of their data distributions. However, existing CFL approaches require a large number of communication rounds for stable cluster formation and rely on a predefined number of clusters, thus limiting their flexibility and adaptability. This paper proposes FedClust, a novel CFL approach leveraging correlations between local model weights and client data distributions. FedClust groups clients into clusters in a one-shot manner using strategically selected partial model weights and dynamically accommodates newcomers in real-time. Experimental results demonstrate FedClust outperforms baseline approaches in terms of accuracy and communication costs.


title: A Crosstalk-Aware Timing Prediction Method in Routing

abstract: With shrinking interconnect spacing in advanced technology nodes, existing timing predictions become less precise due to the challenging quantification of crosstalk-induced delay. During the routing, the crosstalk effect is typically modeled by predicting coupling capacitance with congestion information. However, the timing estimation tends to be overly pessimistic, as the crosstalk-induced delay depends not only on the coupling capacitance but also on the signal arrival time. This work presents a crosstalk-aware timing estimation method using a two-step machine learning approach. Interconnects that are physically adjacent and overlap in signal timing windows are filtered first. Crosstalk delay is predicted by integrating physical topology and timing features without relying on post-routing results and the parasitic extraction. Experimental results show a match rate of over 99% for identifying crosstalk nets compared to the commercial tool on the OpenCores benchmarks, with prediction results being more accurate than those of other state-of-the-art methods.


title: FL-GUARD: A Holistic Framework for Run-Time Detection and Recovery of Negative Federated Learning

abstract: Federated learning (FL) is a promising approach for learning a model from data distributed on massive clients without exposing data privacy. It works effectively in the ideal federation where clients share homogeneous data distribution and learning behavior. However, FL may fail to function appropriately when the federation is not ideal, amid an unhealthy state called Negative Federated Learning (NFL), in which most clients gain no benefit from participating in FL. Many studies have tried to address NFL. However, their solutions either (1) predetermine to prevent NFL in the entire learning life-cycle or (2) tackle NFL in the aftermath of numerous learning rounds. Thus, they either (1) indiscriminately incur extra costs even if FL can perform well without such costs or (2) waste numerous learning rounds. Additionally, none of the previous work takes into account the clients who may be unwilling/unable to follow the proposed NFL solutions when using those solutions to upgrade an FL system in use. This paper introduces FL-GUARD, a holistic framework that can be employed on any FL system for tackling NFL in a run-time paradigm. That is, to dynamically detect NFL at the early stage (tens of rounds) of learning and then to activate recovery measures when necessary. Specifically, we devise a cost-effective NFL detection mechanism, which relies on an estimation of performance gain on clients. Only when NFL is detected, we activate the NFL recovery process, in which each client learns in parallel an adapted model when training the global model. Extensive experiment results confirm the effectiveness of FL-GUARD in detecting NFL and recovering from NFL to a healthy learning state. We also show that FL-GUARD is compatible with previous NFL solutions and robust against clients unwilling/unable to take any recovery measures.


title: Dual Symmetry Classification of Non-Hermitian Systems and $\mathbb{Z}_2$ Point-Gap Topology of a Non-Unitary Quantum Walk

abstract: Non-Hermitian systems exhibit richer topological properties compared to their Hermitian counterparts. It is well known that non-Hermitian systems have been classified based on either the symmetry relations for non-Hermitian Hamiltonians or the symmetry relations for non-unitary time-evolution operators in the context of Floquet topological phases. In this work, we propose that non-Hermitian systems can always be classified in two ways; a non-Hermitian system can be classified using the symmetry relations for non-Hermitian Hamiltonians or time-evolution operator regardless of the Floquet topological phases or not. We refer to this as dual symmetry classification. To demonstrate this, we successfully introduce a new non-unitary quantum walk that exhibits point gaps with a $\mathbb{Z}_2$ point-gap topological phase applying the dual symmetry classification and treating the time-evolution operator of this quantum walk as the non-Hermitian Hamiltonian.


title: Optical turbulence profiling at the Table Mountain Facility with the Laser Communication Relay Demonstration GEO downlink

abstract: We report the first measurement of the atmospheric optical turbulence profile using the transmitted beam from a satellite laser communication terminal. A Ring Image Next Generation Scintillation Sensor (RINGSS) instrument for turbulence profiling, as described in Tokovinin (MNRAS, 502.1, 2021, 747-808), was deployed at the NASA/Jet Propulsion Laboratory's Table Mountain Facility (TMF) in California. The optical turbulence profile was measured with the downlink optical beam from the Laser Communication Relay Demonstration (LCRD) Geostationary satellite. LCRD conducts links with the Optical Communication Telescope Laboratory ground station and the RINGSS instrument was co-located at TMF to conduct measurements. Turbulence profiles were measured at day and night and atmospheric coherence lengths were compared with other turbulence monitors such as a solar scintillometer and Polaris motion monitor. RINGSS sensitivity to boundary layer turbulence, a feature not provided by many profilers, is also shown to agree with a boundary layer scintillometer at TMF (R=0.85). Diurnal evolution of optical turbulence and measured profiles are presented. The correlation of RINGSS with other turbulence monitors (R=0.75-0.86) demonstrates the concept of free-space optical communications turbulence profiling, which could be adopted as a way to support optical ground stations in a future Geostationary feeder link network. These results also provide further evidence that RINGSS, a relatively new instrument concept, correlates well with other instruments in daytime and nighttime turbulence.


title: MAP: MAsk-Pruning for Source-Free Model Intellectual Property Protection

abstract: Deep learning has achieved remarkable progress in various applications, heightening the importance of safeguarding the intellectual property (IP) of well-trained models. It entails not only authorizing usage but also ensuring the deployment of models in authorized data domains, i.e., making models exclusive to certain target domains. Previous methods necessitate concurrent access to source training data and target unauthorized data when performing IP protection, making them risky and inefficient for decentralized private data. In this paper, we target a practical setting where only a well-trained source model is available and investigate how we can realize IP protection. To achieve this, we propose a novel MAsk Pruning (MAP) framework. MAP stems from an intuitive hypothesis, i.e., there are target-related parameters in a well-trained model, locating and pruning them is the key to IP protection. Technically, MAP freezes the source model and learns a target-specific binary mask to prevent unauthorized data usage while minimizing performance degradation on authorized data. Moreover, we introduce a new metric aimed at achieving a better balance between source and target performance degradation. To verify the effectiveness and versatility, we have evaluated MAP in a variety of scenarios, including vanilla source-available, practical source-free, and challenging data-free. Extensive experiments indicate that MAP yields new state-of-the-art performance.


title: Simultaneous Localization and Recognition of Subwavelength Non-Cooperative Entities Based on SISO Time Reversal and Neural Networks

abstract: The simultaneous localization and recognition of subwavelength non-cooperative entities within complex multi-scattering environments using a simplified system continues to pose a substantial challenge. This letter addresses this challenge by synergistically integrating time reversal time-frequency phase prints (TRTFPPs) and neural networks. Initially, a time reversal (TR) single-input single-output (SISO) framework is employed to generate TRTFPPs. To enhance the models' adaptability, particularly in the presence of noise, data augmentation techniques are applied. Subsequently, neural networks are employed to comprehend the TRTFPPs. Specifically, a cascaded neural network structure is embraced, encompassing both a recognition neural network and distinct neural networks for localizing different entities. Through the devised approach, two types of subwavelength entities are successfully identified and precisely localized through numerical simulations and experimental verification in laboratory environment. The proposed methodology holds applicability across various electromagnetic systems, including but not limited to detection, imaging, human-computer interaction, and the Internet of Things (IoT).


title: Dual-path Frequency Discriminators for Few-shot Anomaly Detection

abstract: Few-shot anomaly detection (FSAD) is essential in industrial manufacturing. However, existing FSAD methods struggle to effectively leverage a limited number of normal samples, and they may fail to detect and locate inconspicuous anomalies in the spatial domain. We further discover that these subtle anomalies would be more noticeable in the frequency domain. In this paper, we propose a Dual-Path Frequency Discriminators (DFD) network from a frequency perspective to tackle these issues. Specifically, we generate anomalies at both image-level and feature-level. Differential frequency components are extracted by the multi-frequency information construction module and supplied into the fine-grained feature construction module to provide adapted features. We consider anomaly detection as a discriminative classification problem, wherefore the dual-path feature discrimination module is employed to detect and locate the image-level and feature-level anomalies in the feature space. The discriminators aim to learn a joint representation of anomalous features and normal features in the latent space. Extensive experiments conducted on MVTec AD and VisA benchmarks demonstrate that our DFD surpasses current state-of-the-art methods. Source code will be available.


title: The infinitesimal behavior of the sum of Cauchy kernels and its derivative at infinity

abstract: In analysis, it's often useful to know the value of a function at infinity, this operation possesses pleasant properties. However, even when the limit does not exist, some intuitive considerations may suggest that the function still assumes a specific value at infinity in a certain sense. In Nevanlinna theory, all objects are studied on average, i.e., their integrals, hence the integral interpretation of the concept of convergence to a limit is beneficial for the theory of meromorphic functions. This is precisely the focus of this work, applied to sums of Cauchy kernels and their derivatives.


title: Designing Social Robots that Engage Older Adults in Exercise: A Case Study

abstract: We present and evaluate a prototype social robot to encourage daily exercise among older adults in a home setting. Our prototype system, designed to lead users through exercise sessions with motivational feedback, was assessed through a case study with a 78-year-old participant for one week. Our case study highlighted preferences for greater user control over exercise choices and questioned the necessity of precise motion tracking. Feedback also indicated a desire for more varied exercises and suggested improvements in user engagement techniques. The insights suggest that further research is needed to enhance system adaptability and effectiveness to better promote daily exercise. Future efforts will aim to refine the prototype based on participant feedback and extend the evaluation to broader in-home deployments.


title: Stabilizing Policy Gradients for Stochastic Differential Equations via Consistency with Perturbation Process

abstract: Considering generating samples with high rewards, we focus on optimizing deep neural networks parameterized stochastic differential equations (SDEs), the advanced generative models with high expressiveness, with policy gradient, the leading algorithm in reinforcement learning. Nevertheless, when applying policy gradients to SDEs, since the policy gradient is estimated on a finite set of trajectories, it can be ill-defined, and the policy behavior in data-scarce regions may be uncontrolled. This challenge compromises the stability of policy gradients and negatively impacts sample complexity. To address these issues, we propose constraining the SDE to be consistent with its associated perturbation process. Since the perturbation process covers the entire space and is easy to sample, we can mitigate the aforementioned problems. Our framework offers a general approach allowing for a versatile selection of policy gradient methods to effectively and efficiently train SDEs. We evaluate our algorithm on the task of structure-based drug design and optimize the binding affinity of generated ligand molecules. Our method achieves the best Vina score -9.07 on the CrossDocked2020 dataset.


title: A generic model with unconventional Rashba bands and giant spin galvanic effect

abstract: In two-dimensional system, Rashba spin-orbit coupling can lift spin degeneracy and gives the opposite spin chirality of two split Fermi circles from two Rashba bands. Here, we propose a generic model which can produce unconventional Rashba bands. In such a case, the two Fermi circles from two bands have the same spin chirality. When various interactions are taken into account, many unique physics can emerge in case of unconventional Rashba bands in comparison with in case of conventional Rashba bands. For instance, we study the spin galvanic effect by considering two cases with potential impurity scattering and magnetic impurity scattering, respectively. In both cases, we find the efficiency of spin galvanic effect is strongly enhanced in unconventional Rashba bands in comparison with conventional Rashba bands. More intriguingly, we find the effeiciency of conventional Rashba bands is insensitive to potential or magnetic impurity scattering. However, such efficiency of uncoventional Rashba bands can be further enhanced by the magnetic impurity scattering in comparison with the potential impurity scattering. Thus, the unconventional Rashba bands can give giant spin galvanic effect. These results show that this model is useful to explore abnormal physics in the systems with unconventional Rashba bands.


title: Destratification in the Progenitor Interior of the Mg-rich Supernova Remnant N49B

abstract: Simulations of pre-supernova evolution suggest that some intense shell burning can be so active that, in extreme cases, it can merge with the outer shell, changing the initial conditions for the supernova explosion. However, such violent activity in the interior of stars has been difficult to confirm from observations of stars. Here we propose that the elemental composition of O-rich ejecta in supernova remnants can be a tool to test for this kind of intense shell burning activity in the final stages of progenitor evolution. As an example, we discuss the origin of "Mg-rich" ejecta in the supernova remnant N49B. A high Mg/Ne mass ratio $\gtrsim 1$ suggests that the Ne- or O-burning shell has broken into or merged with the outer shell before the collapse. Such Mg-rich (or Ne-poor) ejecta has been identified in some other supernova remnants, supporting the idea that some destratification process, such as a shell merger, does indeed occur in the interiors of some massive stars, although they may not be the majority. Our results suggest that X-ray observations of O-rich ejecta in core-collapse supernova remnants will be a unique tool to probe the shell burning activity during the final stage of a massive star's interior.


title: On the diameter of intersection graphs of finite groups

abstract: The intersection graph $\Delta_G$ of a finite group $G$ is a simple graph with vertices the non-trivial proper subgroups of $G$, and an edge between two vertices if their corresponding subgroups intersect non-trivially. These graphs were introduced by Cs\'ak\'any and Poll\'ak in 1969. In this paper we answer two long-standing open questions posed by Cs\'ak\'any and Poll\'ak concerning the diameter of intersection graphs. We prove some necessary conditions for a non-simple group to have an intersection graph of diameter 4. We also construct the first examples of non-simple groups and alternating groups whose intersection graphs have diameter 4.


title: DA-Net: A Disentangled and Adaptive Network for Multi-Source Cross-Lingual Transfer Learning

abstract: Multi-Source cross-lingual transfer learning deals with the transfer of task knowledge from multiple labelled source languages to an unlabeled target language under the language shift. Existing methods typically focus on weighting the predictions produced by language-specific classifiers of different sources that follow a shared encoder. However, all source languages share the same encoder, which is updated by all these languages. The extracted representations inevitably contain different source languages' information, which may disturb the learning of the language-specific classifiers. Additionally, due to the language gap, language-specific classifiers trained with source labels are unable to make accurate predictions for the target language. Both facts impair the model's performance. To address these challenges, we propose a Disentangled and Adaptive Network (DA-Net). Firstly, we devise a feedback-guided collaborative disentanglement method that seeks to purify input representations of classifiers, thereby mitigating mutual interference from multiple sources. Secondly, we propose a class-aware parallel adaptation method that aligns class-level distributions for each source-target language pair, thereby alleviating the language pairs' language gap. Experimental results on three different tasks involving 38 languages validate the effectiveness of our approach.


title: Metrical theory of power-2-decaying Gauss-like expansion

abstract: Each $x\in (0,1]$ can be uniquely expanded as a power-2-decaying Gauss-like expansion, in the form of \begin{equation*} x=\sum_{i=1}^{\infty}2^{-(d_1(x)+d_2(x)+\cdots+d_i(x))},\qquad d_i(x)\in \mathbb{N}. \end{equation*} Let $\phi:\mathbb{N}\to \mathbb{R}^{+}$ be an arbitrary positive function. We are interested in the size of the set $$F(\phi)=\{x\in (0,1]:d_n(x)\ge \phi(n)~~\text{for infinity many}~n\}.$$ We prove a Borel-Bernstein theorem on the zero-one law of the Lebesgue measure of $F(\phi)$. When the Lebesgue measure of $F(\phi)$ is zero, we calculate its Hausdorff dimension. Furthermore, we analyse the growth rate of the maximal digit among the first $n$ digits from probability and multifractal perspectives.


title: Improving Retrieval in Theme-specific Applications using a Corpus Topical Taxonomy

abstract: Document retrieval has greatly benefited from the advancements of large-scale pre-trained language models (PLMs). However, their effectiveness is often limited in theme-specific applications for specialized areas or industries, due to unique terminologies, incomplete contexts of user queries, and specialized search intents. To capture the theme-specific information and improve retrieval, we propose to use a corpus topical taxonomy, which outlines the latent topic structure of the corpus while reflecting user-interested aspects. We introduce ToTER (Topical Taxonomy Enhanced Retrieval) framework, which identifies the central topics of queries and documents with the guidance of the taxonomy, and exploits their topical relatedness to supplement missing contexts. As a plug-and-play framework, ToTER can be flexibly employed to enhance various PLM-based retrievers. Through extensive quantitative, ablative, and exploratory experiments on two real-world datasets, we ascertain the benefits of using topical taxonomy for retrieval in theme-specific applications and demonstrate the effectiveness of ToTER.


title: SWAP-NAS: Sample-Wise Activation Patterns for Ultra-fast NAS

abstract: Training-free metrics (a.k.a. zero-cost proxies) are widely used to avoid resource-intensive neural network training, especially in Neural Architecture Search (NAS). Recent studies show that existing training-free metrics have several limitations, such as limited correlation and poor generalisation across different search spaces and tasks. Hence, we propose Sample-Wise Activation Patterns and its derivative, SWAP-Score, a novel high-performance training-free metric. It measures the expressivity of networks over a batch of input samples. The SWAP-Score is strongly correlated with ground-truth performance across various search spaces and tasks, outperforming 15 existing training-free metrics on NAS-Bench-101/201/301 and TransNAS-Bench-101. The SWAP-Score can be further enhanced by regularisation, which leads to even higher correlations in cell-based search space and enables model size control during the search. For example, Spearman's rank correlation coefficient between regularised SWAP-Score and CIFAR-100 validation accuracies on NAS-Bench-201 networks is 0.90, significantly higher than 0.80 from the second-best metric, NWOT. When integrated with an evolutionary algorithm for NAS, our SWAP-NAS achieves competitive performance on CIFAR-10 and ImageNet in approximately 6 minutes and 9 minutes of GPU time respectively.


title: Noisy Spiking Actor Network for Exploration

abstract: As a general method for exploration in deep reinforcement learning (RL), NoisyNet can produce problem-specific exploration strategies. Spiking neural networks (SNNs), due to their binary firing mechanism, have strong robustness to noise, making it difficult to realize efficient exploration with local disturbances. To solve this exploration problem, we propose a noisy spiking actor network (NoisySAN) that introduces time-correlated noise during charging and transmission. Moreover, a noise reduction method is proposed to find a stable policy for the agent. Extensive experimental results demonstrate that our method outperforms the state-of-the-art performance on a wide range of continuous control tasks from OpenAI gym.


title: Error Correction in Dynamical Codes

abstract: We ask what is the general framework for a quantum error correcting code that is defined by a sequence of measurements. Recently, there has been much interest in Floquet codes and space-time codes. In this work, we define and study the distance of a dynamical code. This is a subtle concept and difficult to determine: At any given time, the system will be in a subspace which forms a quantum error-correcting code with a given distance, but the full error correction capability of that code may not be available due to the schedule of measurements associated with the code. We address this challenge by developing an algorithm that tracks information we have learned about the error syndromes through the protocol and put that together to determine the distance of a dynamical code, in a non-fault-tolerant context. We use the tools developed for the algorithm to analyze the initialization and masking properties of a generic Floquet code. Further, we look at properties of dynamical codes under the constraint of geometric locality with a view to understand whether the fundamental limitations on logical gates and code parameters imposed by geometric locality for traditional codes can be surpassed in the dynamical paradigm. We find that codes with a limited number of long range connectivity will not allow non-Clifford gates to be implemented with finite depth circuits in the 2D setting.


title: ProMISe: Promptable Medical Image Segmentation using SAM

abstract: With the proposal of the Segment Anything Model (SAM), fine-tuning SAM for medical image segmentation (MIS) has become popular. However, due to the large size of the SAM model and the significant domain gap between natural and medical images, fine-tuning-based strategies are costly with potential risk of instability, feature damage and catastrophic forgetting. Furthermore, some methods of transferring SAM to a domain-specific MIS through fine-tuning strategies disable the model's prompting capability, severely limiting its utilization scenarios. In this paper, we propose an Auto-Prompting Module (APM), which provides SAM-based foundation model with Euclidean adaptive prompts in the target domain. Our experiments demonstrate that such adaptive prompts significantly improve SAM's non-fine-tuned performance in MIS. In addition, we propose a novel non-invasive method called Incremental Pattern Shifting (IPS) to adapt SAM to specific medical domains. Experimental results show that the IPS enables SAM to achieve state-of-the-art or competitive performance in MIS without the need for fine-tuning. By coupling these two methods, we propose ProMISe, an end-to-end non-fine-tuned framework for Promptable Medical Image Segmentation. Our experiments demonstrate that both using our methods individually or in combination achieves satisfactory performance in low-cost pattern shifting, with all of SAM's parameters frozen.


title: Super-resolution on network telemetry time series

abstract: Fine-grained monitoring is crucial for multiple data-driven tasks such as debugging, provisioning, and securing networks. Yet, practical constraints in collecting, extracting, and storing data often force operators to use coarse-grained sampled monitoring, degrading the performance of the various tasks. In this work, we explore the feasibility of leveraging the correlations among coarse-grained time series to impute their fine-grained counterparts in software. We present Zoom2Net, a transformer-based model for network imputation that incorporates domain knowledge through operational and measurement constraints, ensuring that the imputed network telemetry time series are not only realistic but also align with existing measurements and are plausible. This approach enhances the capabilities of current monitoring infrastructures, allowing operators to gain more insights into system behaviors without the need for hardware upgrades. We evaluate Zoom2Net on four diverse datasets (e.g. cloud telemetry and Internet data transfer) and use cases (such as bursts analysis and traffic classification). We demonstrate that Zoom2Net consistently achieves high imputation accuracy with a zoom-in factor of up to 100 and performs better on downstream tasks compared to baselines by an average of 38%.


title: Nonequilibrium magnonic thermal transport engineering

abstract: Thermal conductivity, a fundamental parameter characterizing thermal transport in solids, is typically determined by electron and phonon transport. Although other transport properties including electrical conductivity and thermoelectric conversion coefficients have material-specific values, it is known that thermal conductivity can be modulated artificially via phonon engineering techniques. Here, we demonstrate another way of artificially modulating the heat conduction in solids: magnonic thermal transport engineering. The time-domain thermoreflectance measurements using ferromagnetic metal/insulator junction systems reveal that the thermal conductivity of the ferromagnetic metals and interfacial thermal conductance vary significantly depending on the spatial distribution of nonequilibrium spin currents. Systematic measurements of the thermal transport properties with changing the boundary conditions for spin currents show that the observed thermal transport modulation stems from magnon origin. This observation unveils that magnons significantly contribute to the heat conduction even in ferromagnetic metals at room temperature, upsetting the conventional wisdom that the thermal conductivity mediated by magnons is very small in metals except at low temperatures. The magnonic thermal transport engineering offers a new principle and method for active thermal management.


title: Projective smoothing of varieties with simple normal crossings

abstract: In this article, we introduce a new approach to show the existence and smoothing of simple normal crossing varieties in a given projective space. Our approach relates the above to the existence of nowhere reduced schemes called ribbons and their smoothings via deformation theory of morphisms. As a consequence, we prove results on the existence and smoothing of snc subvarieties $V \subset \mathbb{P}^N$, with two irreducible components, each of which are Fano varieties of dimension $n>2$, embedded inside $\mathbb{P}^{N}$ for effective values of $N$, by the complete linear series of a line bundle $H$. The general fibers of the resulting one parameter families are either smooth Fano, Calabi-Yau or varieties of general type, depending on the positivity of the canonical divisor of their intersections. An interesting consequence of projective smoothing is that it automatically gives a smoothing of the semi-log-canonical (slc) pair $(V, \Delta)$, where $\Delta = cH$, $c < 1$, is a rational multiple of a general hyperplane section of $H$. For threefolds, we are able to give explicit descriptions of the smoothable snc subvarieties due to the classification results of Iskovskikh-Mori-Mukai. In particular, we show the existence of unions V = $Y_1 \bigcup_D Y_2 \subset \mathbb{P}^N$, where $Y_i$'s are smooth anticanonically (resp. bi-anticanonically) embedded Fano threefolds, intersecting along $D$, where $D$ is either a del-Pezzo surface or a $K3$ surface (resp. a smooth surface with ample canonical bundle) and their smoothing in $\mathbb{P}^N$ to smooth Fano or Calabi-Yau threefolds (resp. to threefolds with ample canonical bundle) for various values of $N$ between $10$ and $163$. In cases when the general fiber is a smooth Fano or Calabi-Yau threefold, one can choose $c$ such that $(V, \Delta)$ is a Calabi-Yau pair while in all cases $c$ can be chosen so that $(V, \Delta)$ is a stable pair.


title: Impact of the Antenna on the Sub-Terahertz Indoor Channel Characteristics: An Experimental Approach

abstract: Terahertz-band (100 GHz-10 THz) communication is a promising radio technology envisioned to enable ultra-high data rate, reliable and low-latency wireless connectivity in next-generation wireless systems. However, the low transmission power of THz transmitters, the need for high gain directional antennas, and the complex interaction of THz radiation with common objects along the propagation path make crucial the understanding of the THz channel. In this paper, we conduct an extensive channel measurement campaign in an indoor setting (i.e., a conference room) through a channel sounder with 0.1 ns time resolution and 20 GHz bandwidth at 140 GHz. Particularly, the impact of different antenna directivities (and, thus, beam widths) on the channel characteristics is extensively studied. The experimentally obtained dataset is processed to develop the path loss model and, subsequently, derive key channel metrics such as the path loss exponent, delay spread, and K-factor. The results highlight the multi-faceted impact of the antenna gain on the channel and, by extension, the wireless system and, thus, show that an antenna-agnostic channel model cannot capture the propagation characteristics of the THz channel.


title: Social Robots for Sleep Health: A Scoping Review

abstract: Poor sleep health is an increasingly concerning public healthcare crisis, especially when coupled with a dwindling number of health professionals qualified to combat it. However, there is a growing body of scientific literature on the use of digital technologies in supporting and sustaining individuals' healthy sleep habits. Social robots are a relatively recent technology that has been used to facilitate health care interventions and may have potential in improving sleep health outcomes, as well. Social robots' unique characteristics -- such as anthropomorphic physical embodiment or effective communication methods -- help to engage users and motivate them to comply with specific interventions, thus improving the interventions' outcomes. This scoping review aims to evaluate current scientific evidence for employing social robots in sleep health interventions, identify critical research gaps, and suggest future directions for developing and using social robots to improve people's sleep health. Our analysis of the reviewed studies found them limited due to a singular focus on the older adult population, use of small sample sizes, limited intervention durations, and other compounding factors. Nevertheless, the reviewed studies reported several positive outcomes, highlighting the potential social robots hold in this field. Although our review found limited clinical evidence for the efficacy of social robots as purveyors of sleep health interventions, it did elucidate the potential for a successful future in this domain if current limitations are addressed and more research is conducted.


title: The Power of Lorentz Quantum Computer

abstract: We demonstrate the superior capabilities of the recently proposed Lorentz quantum computer (LQC) compared to conventional quantum computers. We introduce an associated computational complexity class, bounded-error Lorentz quantum polynomial-time (BLQP), and prove that the complexity class ${\text P}^{\sharp \text{P}}$ is contained within BLQP. We present LQC algorithms that solve in polynomial time the problem of maximum independent set and the problems in the classes of NP, co-NP, PH (polynomial hierarchy), PP (probabilistic polynomial-time), and ${\text P}^{\sharp \text{P}}$. We show that the quantum computing with postselection proposed by Aaronson can be simulated efficiently by LQC, but not vice versa.


title: Implicit Redundancy and Degeneracy in Conic Program

abstract: This paper examines the feasible region of a standard conic program represented as the intersection of a closed convex cone and a set of linear equalities. It is recently shown that when Slater constraint qualification (strict feasibility) fails for the classes of linear and semidefinite programs, two key properties emerge within the feasible region; (a) every point in the feasible region is degenerate; (b) the constraint system inherits implicit redundancies. In this paper we show that degeneracy and implicit redundancies are inherent and universal traits of all conic programs in the absence of strict feasibility.


title: SDPL: Shifting-Dense Partition Learning for UAV-View Geo-Localization

abstract: Cross-view geo-localization aims to match images of the same target from different platforms, e.g., drone and satellite. It is a challenging task due to the changing both appearance of targets and environmental content from different views. Existing methods mainly focus on digging more comprehensive information through feature maps segmentation, while inevitably destroy the image structure and are sensitive to the shifting and scale of the target in the query. To address the above issues, we introduce a simple yet effective part-based representation learning, called shifting-dense partition learning (SDPL). Specifically, we propose the dense partition strategy (DPS), which divides the image into multiple parts to explore contextual-information while explicitly maintain the global structure. To handle scenarios with non-centered targets, we further propose the shifting-fusion strategy, which generates multiple sets of parts in parallel based on various segmentation centers and then adaptively fuses all features to select the best partitions. Extensive experiments show that our SDPL is robust to position shifting and scale variations, and achieves competitive performance on two prevailing benchmarks, i.e., University-1652 and SUES-200.


title: Image Coding for Machines with Edge Information Learning Using Segment Anything

abstract: Image Coding for Machines (ICM) is an image compression technique for image recognition. This technique is essential due to the growing demand for image recognition AI. In this paper, we propose a method for ICM that focuses on encoding and decoding only the edge information of object parts in an image, which we call SA-ICM. This is an Learned Image Compression (LIC) model trained using edge information created by Segment Anything. Our method can be used for image recognition models with various tasks. SA-ICM is also robust to changes in input data, making it effective for a variety of use cases. Additionally, our method provides benefits from a privacy point of view, as it removes human facial information on the encoder's side, thus protecting one's privacy. Furthermore, this LIC model training method can be used to train Neural Representations for Videos (NeRV), which is a video compression model. By training NeRV using edge information created by Segment Anything, it is possible to create a NeRV that is effective for image recognition (SA-NeRV). Experimental results confirm the advantages of SA-ICM, presenting the best performance in image compression for image recognition. We also show that SA-NeRV is superior to ordinary NeRV in video compression for machines. Code is available at https://github.com/final-0/SA-ICM.


title: Investigation of nanophotonic lithium niobate waveguides for on-chip evanescent wave sensing

abstract: Thin-film lithium niobate is a promising photonic platform for on-chip optical sensing because both nonlinear and linear components can be fabricated within one integrated device. To date, waveguided sample interactions for thin-film lithium niobate are not well explored. Compared to other integrated platforms, lithium niobate's high refractive index, birefringence, and angled sidewalls present unique design challenges for evanescent wave sensing. Here, we compare the performance of the quasi-transverse-electric (TE) and the quasi-transverse-magnetic (TM) mode for sensing on a thin-film lithium niobate rib waveguide with a 5 mM dye-doped polymer cladding pumped at 406 nm. We determine that both modes have propagation losses dominated by scatter, and that the absorption due to the sample only accounts for 3% of the measured losses for both modes. The TM mode has better overlap with the sample than the TE mode, but the TM mode also has a stronger propagation loss due to sidewall and sample induced scattering (32.5 $\pm$ 0.3 dB/cm) compared to the TE mode (23.0 $\pm$ 0.2 dB/cm). The TE mode is, therefore, more appropriate for sensing. Our findings have important implications for on-chip lithium niobate-based sensor designs.


title: Understanding the PULSAR Effect in Combined Radiotherapy and Immunotherapy through Attention Mechanisms with a Transformer Model

abstract: PULSAR (personalized, ultra-fractionated stereotactic adaptive radiotherapy) is the adaptation of stereotactic ablative radiotherapy towards personalized cancer management. For the first time, we applied a transformer-based attention mechanism to investigate the underlying interactions between combined PULSAR and PD-L1 blockade immunotherapy based on a murine cancer model (Lewis Lung Carcinoma, LLC). The proposed approach is able to predict the trend of tumor volume change semi-quantitatively, and excels in identifying the potential causal relationships through both self-attention and cross-attention scores.


title: Re-investigation of Moment Direction in a Kitaev Material $\alpha$-RuCl$_{3}$

abstract: We report X-ray diffraction and resonant elastic X-ray scattering (REXS) studies on two $\alpha$-RuCl$_{3}$ crystals with distinct magnetic transition temperatures: T$_{N}$=7.3K and 6.5K. We find that the sample with T$_{N}$=6.5K exhibits a high degree of structural twinning at low temperature, whereas the T$_{N}$=7.3K sample primarily comprises a single domain of R$\bar{3}$. Notwithstanding, both samples exhibit an identical zigzag magnetic structure, with magnetic moments pointing away from the honeycomb plane by $\alpha=31(2)^{\circ}$. We argue that the identical ordered moment directions in these samples suggest that the intralayer magnetic Hamiltonian remains mostly unchanged regardless of T$_{N}$.


title: Moduli of K3 surfaces of degree 2 with four rational double points of type $D_4$

abstract: We show that the Satake-Baily-Borel compactification of the moduli space of lattice polarized K3 surfaces parametrizing K3 surfaces of degree 2 with four rational double points of type $D_4$ is the projective 3-space. We also show that the corresponding graded ring of automorphic forms is generated by four elements of weight 2 and one element of weight 11 with one relation of weight 22.


title: Attempt Towards Stress Transfer in Speech-to-Speech Machine Translation

abstract: The language diversity in India's education sector poses a significant challenge, hindering inclusivity. Despite the democratization of knowledge through online educational content, the dominance of English, as the internet's lingua franca, limits accessibility, emphasizing the crucial need for translation into Indian languages. Despite existing Speech-to-Speech Machine Translation (SSMT) technologies, the lack of intonation in these systems gives monotonous translations, leading to a loss of audience interest and disengagement from the content. To address this, our paper introduces a dataset with stress annotations in Indian English and also a Text-to-Speech (TTS) architecture capable of incorporating stress into synthesized speech. This dataset is used for training a stress detection model, which is then used in the SSMT system for detecting stress in the source speech and transferring it into the target language speech. The TTS architecture is based on FastPitch and can modify the variances based on stressed words given. We present an Indian English-to-Hindi SSMT system that can transfer stress and aim to enhance the overall quality and engagement of educational content.


title: Mining Transactional Data To Produce Extended Association Rules Using Collaborative Apriori, Fsa-Red And M5p Predictive Algorithm As A Basis Of Business Actions

abstract: There are large amounts of transactional data which showed consumer shopping cart at a store that sells more than 150 types of products. In this case, the company is utilizing these data in making business action. In previous studies, the data that has a lot of attributes and record data reduction algorithms handled by the FSA Red (Feature Selection for Association Rules)are then mined using Apriori algorithm. The resulting association rules have high levels of accuracy and excellent test results, which rely more than 90%. In this study, the association rules generated in previous research will be updated by using prediction algorithms M5P, so that the association rules can be used within a period of several months in the future. Furthermore, some data mining technique such as: clustering and time series pattern will be implemented to examine the truth and extend the validity of association rules which were built. It can be concluded that the association rules were established after will generate strong association rules with confidence equal or higher than 70% and the rules established truth can be seen from the time series pattern on each group of goods which are then used as the basis of business actions.


title: RATSF: Empowering Customer Service Volume Management through Retrieval-Augmented Time-Series Forecasting

abstract: An efficient customer service management system hinges on precise forecasting of service volume. In this scenario, where data non-stationarity is pronounced, successful forecasting heavily relies on identifying and leveraging similar historical data rather than merely summarizing periodic patterns. Existing models based on RNN or Transformer architectures may struggle with this flexible and effective utilization. To tackle this challenge, we initially developed the Time Series Knowledge Base (TSKB) with an advanced indexing system for efficient historical data retrieval. We also developed the Retrieval Augmented Cross-Attention (RACA) module, a variant of the cross-attention mechanism within Transformer's decoder layers, designed to be seamlessly integrated into the vanilla Transformer architecture to assimilate key historical data segments. The synergy between TSKB and RACA forms the backbone of our Retrieval-Augmented Time Series Forecasting (RATSF) framework. Based on the above two components, RATSF not only significantly enhances performance in the context of Fliggy hotel service volume forecasting but also adapts flexibly to various scenarios and integrates with a multitude of Transformer variants for time-series forecasting. Extensive experimentation has validated the effectiveness and generalizability of this system design across multiple diverse contexts.


title: Estimating the production of dark photons with $\eta$ decay in Ultra-peripheral Collisions

abstract: We propose that the signal of dark photons can be found in the decay channel of $\eta$, and that a certain number of events of dark photon leptonic decay can be observed in the double-photon collision process of heavy-ion ultra-peripheral collisions (UPC). We estimate the total cross-section for producing dark photons in ultra-peripheral $PbPb$ collisions at existing and planned future hadron colliders, as well as the number of signal events. Our results support the search for dark photon signals in ultra-peripheral $PbPb$ collisions. We consider the recent signals of $\eta$ decays produced in LHC $pp$ collisions and estimate the number of dark photon events from the same number of $\eta$ decays from CMS. Based on CMS results, we estimate that there will be at least 1000 signal events of dark photons observed for the mass $m_{A^\prime}$ less than 500 MeV. In this study, we propose a method using $\eta$ meson decay to search for signs of dark photons at heavy-ion colliders, such as LHC and RHIC.


title: Metric-aware LLM inference for regression and scoring

abstract: Large language models (LLMs) have demonstrated strong results on a range of NLP tasks. Typically, outputs are obtained via autoregressive sampling from the LLM's underlying distribution. Building on prior work on Minimum Bayes Risk Decoding, we show that this inference strategy can be suboptimal for a range of regression and scoring tasks, and associated evaluation metrics. As a remedy, we propose metric aware LLM inference: a decision theoretic approach optimizing for custom regression and scoring metrics at inference time. We report improvements over baselines on academic benchmarks and publicly available models.