title: Prioritized-MVBA: A New Approach to Design an Optimal Asynchronous Byzantine Agreement Protocol

abstract: The multi-valued byzantine agreement protocol (MVBA) in the authenticated setting has been widely used as a core to design atomic broadcast and fault-tolerant state machine replication protocols in asynchronous networks. Originating from the seminal work of Cachin et al. \cite{CACHIN01}, subsequent research endeavors have sought to optimize protocol efficiency in terms of communication complexity. Notable advancements following Cachin's contributions include: i) VABA \cite{BYZ17}, requiring multiple protocol instances to achieve agreement on a party's request, and ii) Dumbo-MVBA \cite{LU20}, employing a cryptographic asynchronous dispersal and recovery methods to manage communication complexity alongside additional computational and communication rounds overheads. Our objective is to devise an MVBA protocol that achieves agreement in each instance without extra computation and communication rounds while maintaining the optimal metrics. Central to our design approach is the introduction of the committee in the classic MVBA protocol, wherein a randomly selected subset of ($f+1$, where $n=3f+1$) parties get selected and simultaneously broadcast their requests (transactions) to gather verifiable proofs. Successive distributions of these proofs afford us the necessary properties to employ the asynchronous binary Byzantine agreement (ABBA) protocol for reaching an agreement on a selected party's requests. By integrating the committee and ABBA protocols, we devise the optimal MVBA protocol, termed pMVBA (Prioritized-MVBA). This protocol exhibits resilience to tolerate up to $\lfloor \frac{n}{3}\rfloor$ Byzantine failures, with an expected runtime of $O(1)$, optimal message complexity of $O(n^2)$, and optimal communication complexity $O((l+\lambda)n^2)$ .


title: Correlated Electronic Structure and Incipient Flat Bands of the Kagome Superconductor CsCr3Sb5

abstract: Kagome materials exhibit many novel phenomena emerging from the interplay between lattice geometry, electronic structure, and topology. A prime example is the vanadium-based kagome materials AV3Sb5 (A = K, Rb, and Cs) with superconductivity and unconventional charge-density wave (CDW). More interestingly, the substitution of vanadium by chromium further introduces magnetism and enhances the correlation effect in CsCr3Sb5 which likewise exhibits superconductivity under pressure and competing density-wave state. Here we systematically investigate the electronic structure of CsCr3Sb5 using high-resolution angle-resolved photoemission spectroscopy (APRES) and ab-initio calculations. Overall, the measured electronic structure agrees with the theoretical calculation. Remarkably, Cr 3d orbitals exhibit incoherent electronic states and contribute to incipient flat bands close to the Fermi level. The electronic structure shows a minor change across the magnetic transition at 55 K, suggesting a weak interplay between the local magnetic moment and itinerant electrons. Furthermore, we reveal a drastic enhancement of the electron scattering rate across the magnetic transition, which is relevant to the semiconducting-like transport property of the system at high temperatures. Our results suggest that CsCr3Sb5 is a strongly correlated Hund's metal with incipient flat bands near the Fermi level, which provides an electronic basis for understanding its novel properties in comparison to the non-magnetic and weakly correlated AV3Sb5.


title: Weighted decoupling estimates and the Bochner-Riesz means

abstract: We prove new weighted decoupling estimates. As an application, we give an improved sufficient condition for almost everywhere convergence of the Bochner-Riesz means of arbitrary $L^p$ functions for $1<p<2$ in dimensions 2 and 3.


title: Evaluating Feature Selection Methods for Macro-Economic Forecasting, Applied for Inflation Indicator of Iran

abstract: This study explores various feature selection techniques applied to macro-economic forecasting, using Iran's World Bank Development Indicators. Employing a comprehensive evaluation framework that includes Root Mean Square Error (RMSE) and Mean Absolute Error (MAE) within a 10-fold cross-validation setup, this research systematically analyzes and ranks different feature selection methodologies. The study distinctly highlights the efficiency of Stepwise Selection, Tree-based methods, Hausdorff distance, Euclidean distance, and Mutual Information (MI) Score, noting their superior performance in reducing predictive errors. In contrast, methods like Recursive Feature Elimination with Cross-Validation (RFECV) and Variance Thresholding showed relatively lower effectiveness. The results underline the robustness of similarity-based approaches, particularly Hausdorff and Euclidean distances, which consistently performed well across various datasets, achieving an average rank of 9.125 out of a range of tested methods. This paper provides crucial insights into the effectiveness of different feature selection methods, offering significant implications for enhancing the predictive accuracy of models used in economic analysis and planning. The findings advocate for the prioritization of stepwise and tree-based methods alongside similarity-based techniques for researchers and practitioners working with complex economic datasets.


title: Monte-Carlo Integration Based Multiple-Scattering Channel Modeling for Ultraviolet Communications in Turbulent Atmosphere

abstract: Modeling of multiple-scattering channels in atmospheric turbulence is essential for the performance analysis of long-distance non-line-of-sight (NLOS) ultraviolet (UV) communications. Existing works on the turbulent channel modeling for NLOS UV communications either ignored the turbulence-induced scattering effect or erroneously estimated the turbulent fluctuation effect, resulting in a contradiction with reported experiments. In this paper, we establish a comprehensive multiple-scattering turbulent channel model for NLOS UV communications considering both the turbulence-induced scattering effect and the turbulent fluctuation effect. We first derive the turbulent scattering coefficient and turbulent phase scattering function based on the Booker-Gordon turbulent power spectral density model. Then an improved estimation method is proposed for both the turbulent fluctuation and the turbulent fading coefficient based on the Monte-Carlo integration approach. Numerical results demonstrate that the turbulence-induced scattering effect can always be ignored for typical UV communication scenarios. Besides, the turbulent fluctuation will increase as either the communication distance, the elevation angle, or the divergence angle increases, which is compatible with existing experimental results. Moreover, we find that the probability density of the equivalent turbulent fading for multiple-scattering turbulent channels can be approximated as a Gaussian distribution.


title: ReDistill: Residual Encoded Distillation for Peak Memory Reduction

abstract: The expansion of neural network sizes and the enhancement of image resolution through modern camera sensors result in heightened memory and power demands for neural networks. Reducing peak memory, which is the maximum memory consumed during the execution of a neural network, is critical to deploy neural networks on edge devices with limited memory budget. A naive approach to reducing peak memory is aggressive down-sampling of feature maps via pooling with large stride, which often results in unacceptable degradation in network performance. To mitigate this problem, we propose residual encoded distillation (ReDistill) for peak memory reduction in a teacher-student framework, in which a student network with less memory is derived from the teacher network using aggressive pooling. We apply our distillation method to multiple problems in computer vision including image classification and diffusion based image generation. For image classification, our method yields 2x-3.2x measured peak memory on an edge GPU with negligible degradation in accuracy for most CNN based architectures. Additionally, our method yields improved test accuracy for tiny vision transformer (ViT) based models distilled from large CNN based teacher architectures. For diffusion-based image generation, our proposed distillation method yields a denoising network with 4x lower theoretical peak memory while maintaining decent diversity and fidelity for image generation. Experiments demonstrate our method's superior performance compared to other feature-based and response-based distillation methods.


title: Estimate for the neutrino magnetic moment from pulsar kick velocities induced at the birth of strange quark matter neutron stars

abstract: We estimate the magnetic moment of electron neutrinos by computing the neutrino chirality flip rate that can occur in the core of a strange quark matter neutron star at birth. We show that this process allows neutrinos to anisotropically escape thus inducing the star kick velocity. The process is not subject to the no-go theorem since, although the flip from left- to right-handed neutrinos happens at equilibrium, the reverse process does not take place, given that right-handed neutrinos do not interact with matter and therefore detailed balance is lost. For simplicity, we model the star core as consisting of strange quark matter. We find that even when the energy released in right-handed neutrinos is a small fraction of the total energy released in left-handed neutrinos, the process describes kick velocities for natal conditions which are consistent with the observed ones and span the correct range of radii, temperatures and chemical potentials for typical magnetic field intensities. The neutrino magnetic moment is estimated to be $\mu_\nu \sim 3.6 \times 10^{-18}\mu_B$, where $\mu_B$ is the Bohr magneton. This value is more stringent than the bound found for massive neutrinos in a minimal extension of the standard model.


title: Efficient Knowledge Infusion via KG-LLM Alignment

abstract: To tackle the problem of domain-specific knowledge scarcity within large language models (LLMs), knowledge graph-retrievalaugmented method has been proven to be an effective and efficient technique for knowledge infusion. However, existing approaches face two primary challenges: knowledge mismatch between public available knowledge graphs and the specific domain of the task at hand, and poor information compliance of LLMs with knowledge graphs. In this paper, we leverage a small set of labeled samples and a large-scale corpus to efficiently construct domain-specific knowledge graphs by an LLM, addressing the issue of knowledge mismatch. Additionally, we propose a three-stage KG-LLM alignment strategyto enhance the LLM's capability to utilize information from knowledge graphs. We conduct experiments with a limited-sample setting on two biomedical question-answering datasets, and the results demonstrate that our approach outperforms existing baselines.


title: Instance Segmentation and Teeth Classification in Panoramic X-rays

abstract: Teeth segmentation and recognition are critical in various dental applications and dental diagnosis. Automatic and accurate segmentation approaches have been made possible by integrating deep learning models. Although teeth segmentation has been studied in the past, only some techniques were able to effectively classify and segment teeth simultaneously. This article offers a pipeline of two deep learning models, U-Net and YOLOv8, which results in BB-UNet, a new architecture for the classification and segmentation of teeth on panoramic X-rays that is efficient and reliable. We have improved the quality and reliability of teeth segmentation by utilising the YOLOv8 and U-Net capabilities. The proposed networks have been evaluated using the mean average precision (mAP) and dice coefficient for YOLOv8 and BB-UNet, respectively. We have achieved a 3\% increase in mAP score for teeth classification compared to existing methods, and a 10-15\% increase in dice coefficient for teeth segmentation compared to U-Net across different categories of teeth. A new Dental dataset was created based on UFBA-UESC dataset with Bounding-Box and Polygon annotations of 425 dental panoramic X-rays. The findings of this research pave the way for a wider adoption of object detection models in the field of dental diagnosis.


title: Avoiding Barren Plateaus with Entanglement

abstract: In the search for quantum advantage with near-term quantum devices, navigating the optimization landscape is significantly hampered by the barren plateaus phenomenon. This study presents a strategy to overcome this obstacle without changing the quantum circuit architecture. We propose incorporating auxiliary control qubits to shift the circuit from a unitary $2$-design to a unitary $1$-design, mitigating the prevalence of barren plateaus. We then remove these auxiliary qubits to return to the original circuit structure while preserving the unitary $1$-design properties. Our experiment suggests that the proposed structure effectively mitigates the barren plateaus phenomenon. A significant experimental finding is that the gradient of $\theta_{1,1}$, the first parameter in the quantum circuit, displays a broader distribution as the number of qubits and layers increases. This suggests a higher probability of obtaining effective gradients. This stability is critical for the efficient training of quantum circuits, especially for larger and more complex systems. The results of this study represent a significant advance in the optimization of quantum circuits and offer a promising avenue for the scalable and practical implementation of quantum computing technologies. This approach opens up new opportunities in quantum learning and other applications that require robust quantum computing power.


title: NAP^2: A Benchmark for Naturalness and Privacy-Preserving Text Rewriting by Learning from Human

abstract: Increasing concerns about privacy leakage issues in academia and industry arise when employing NLP models from third-party providers to process sensitive texts. To protect privacy before sending sensitive data to those models, we suggest sanitizing sensitive text using two common strategies used by humans: i) deleting sensitive expressions, and ii) obscuring sensitive details by abstracting them. To explore the issues and develop a tool for text rewriting, we curate the first corpus, coined NAP^2, through both crowdsourcing and the use of large language models (LLMs). Compared to the prior works based on differential privacy, which lead to a sharp drop in information utility and unnatural texts, the human-inspired approaches result in more natural rewrites and offer an improved balance between privacy protection and data utility, as demonstrated by our extensive experiments.


title: Stochastic Dynamic Network Utility Maximization with Application to Disaster Response

abstract: In this paper, we are interested in solving Network Utility Maximization (NUM) problems whose underlying local utilities and constraints depend on a complex stochastic dynamic environment. While the general model applies broadly, this work is motivated by resource sharing during disasters concurrently occurring in multiple areas. In such situations, hierarchical layers of Incident Command Systems (ICS) are engaged; specifically, a central entity (e.g., the federal government) typically coordinates the incident response allocating resources to different sites, which then get distributed to the affected by local entities. The benefits of an allocation decision to the different sites are generally not expressed explicitly as a closed-form utility function because of the complexity of the response and the random nature of the underlying phenomenon we try to contain. We use the classic approach of decomposing the NUM formulation and applying a primal-dual algorithm to achieve optimal higher-level decisions under coupled constraints while modeling the optimized response to the local dynamics with deep reinforcement learning algorithms. The decomposition we propose has several benefits: 1) the entities respond to their local utilities based on a congestion signal conveyed by the ICS upper layers; 2) the complexity of capturing the utility of local responses and their diversity is addressed effectively without sharing local parameters and priorities with the ICS layers above; 3) utilities, known as explicit functions, are approximated as convex functions of the resources allocated; 4) decisions rely on up-to-date data from the ground along with future forecasts.


title: Adaptive Multi-Scale Decomposition Framework for Time Series Forecasting

abstract: Transformer-based and MLP-based methods have emerged as leading approaches in time series forecasting (TSF). While Transformer-based methods excel in capturing long-range dependencies, they suffer from high computational complexities and tend to overfit. Conversely, MLP-based methods offer computational efficiency and adeptness in modeling temporal dynamics, but they struggle with capturing complex temporal patterns effectively. To address these challenges, we propose a novel MLP-based Adaptive Multi-Scale Decomposition (AMD) framework for TSF. Our framework decomposes time series into distinct temporal patterns at multiple scales, leveraging the Multi-Scale Decomposable Mixing (MDM) block to dissect and aggregate these patterns in a residual manner. Complemented by the Dual Dependency Interaction (DDI) block and the Adaptive Multi-predictor Synthesis (AMS) block, our approach effectively models both temporal and channel dependencies and utilizes autocorrelation to refine multi-scale data integration. Comprehensive experiments demonstrate that our AMD framework not only overcomes the limitations of existing methods but also consistently achieves state-of-the-art performance in both long-term and short-term forecasting tasks across various datasets, showcasing superior efficiency. Code is available at \url{https://github.com/TROUBADOUR000/AMD}


title: Model fusion for efficient learning of nonlinear dynamical systems

abstract: In the context of model-based control of industrial processes, it is a common practice to develop a data-driven linear dynamical model around a specified operating point. However, in applications involving wider operating conditions, representation of the dynamics using a single linear dynamic model is often inadequate, requiring either a nonlinear model or multiple linear models to accommodate the nonlinear behaviour. While the development of the former suffers from the requirements of extensive experiments spanning multiple levels, significant compromise in the nominal product quality and dealing with unmeasured disturbances over wider operating conditions, the latter faces the challenge of model switch scheduling and inadequate description of dynamics for the operating regions in-between. To overcome these challenges, we propose an efficient approach to obtain a parsimonious nonlinear dynamic model by developing multiple linear models from data at multiple operating points, lifting the data features obtained from individual model simulations to adequately accommodate the underlying nonlinear behaviour and finally, sparse optimization techniques to obtain a parsimonious model. The performance and effectiveness of the proposed algorithm is demonstrated through simulation case studies.


title: VisLTR: Visualization-in-the-Loop Table Reasoning

abstract: Table reasoning transforms user requirements into corresponding answers according to the provided table, which is often integrated with natural language interfaces for lay users to explore tabular data effortlessly. Recent research exploits large language models to facilitate table reasoning, by transforming vague user requirements into structured query languages (SQLs). However, these SQL-based approaches often overlook changes in data patterns, suffer from LLM drift, and limit exploration to only text queries. To this end, VisLTR is designed as a visualization-in-the-loop table reasoning framework that leverages visualizations as a proxy to provide concise data representations, capture interesting data patterns, and support cross-modal analysis. We describe VisLTR as a process consisting of four major modules: 1) visualization alignment that utilizes large vision-language models to align visualizations across various modalities, including chart, text, and sketch; 2) visualization referencing that decomposes a table into multifaceted visualization references that comprehensively represent the table; 3) visualization pruning that incorporates data and retrieval pruning to excise visualization references with poor information and enhance retrieval efficiency; and 4) visualization interaction that offers an interactive visual interface with multi-modal interactions for user-friendly table reasoning. Quantitative evaluation demonstrates the effectiveness of the alignment model in cross-modal visualization pairings. We further demonstrate applications of the framework on various table reasoning tasks such as table summarization and pattern detection.


title: Classification of generalized torsion elements of order two in 3-manifold groups

abstract: Let $G$ be a group and $g$ a non-trivial element in $G$. If some non-empty finite product of conjugates of $g$ equals to the identity, then $g$ is called a generalized torsion element. The minimum number of conjugates in such a product is called the order of $g$. We will classify $3$-manifolds $M$, each of whose fundamental group has a generalized torsion element of order two. Furthermore, we will classify such elements in $\pi_1(M)$. We also prove that $R$-group and $\overline{R}$-group coincide for $3$-manifold groups, and classify $3$-manifold groups which are $R$-groups (and hence $\overline{R}$-groups).


title: Flavor-independent yield of high-$p_T$ hadrons from nuclear collisions

abstract: Data on high-$p_T$ hadron production in heavy ion collisions at Feynman $x_F=0$ indicate at universality of the observed nuclear suppression. Our analysis of the production mechanisms demonstrates important role of the color transparency effects which make the survival probability of a quark-antiquark dipole independent of the quark flavor, provided that the hadron wave function is formed outside the medium. The latter condition imposes restrictions on the range of $p_T$, which should be sufficiently high to make the nuclear suppression universal. We also found that the in-medium broadening rate $\hat q$ (frequently called transport coefficient) significantly depends on the quark flavor, diminishing for heavy quarks.


title: High-Order Continuous Geometrical Validity

abstract: We propose a conservative algorithm to test the geometrical validity of simplicial (triangles, tetrahedra), tensor product (quadrilaterals, hexahedra), and mixed (prisms) elements of arbitrary polynomial order as they deform over a piecewise-linear trajectory. Our algorithm uses a combination of adaptive B\'ezier refinement and bisection search to determine if, when, and where the Jacobian determinant of an element's polynomial geometric map becomes negative in the transition from one configuration to another. Unlike previous approaches, our method preserves its properties also when implemented using floating point arithmetic: This feature comes at a small additional runtime cost compared to existing inexact methods, making it a drop-in replacement for current validity tests, while providing superior robustness and generality. To prove the practical effectiveness of our algorithm, we demonstrate its use in a high-order Incremental Potential Contact (IPC) elastodynamic simulator, and we experimentally show that it prevents invalid, simulation-breaking configurations that would otherwise occur using inexact methods, without the need for manual parameter tuning.


title: RoboCoder: Robotic Learning from Basic Skills to General Tasks with Large Language Models

abstract: The emergence of Large Language Models (LLMs) has improved the prospects for robotic tasks. However, existing benchmarks are still limited to single tasks with limited generalization capabilities. In this work, we introduce a comprehensive benchmark and an autonomous learning framework, RoboCoder aimed at enhancing the generalization capabilities of robots in complex environments. Unlike traditional methods that focus on single-task learning, our research emphasizes the development of a general-purpose robotic coding algorithm that enables robots to leverage basic skills to tackle increasingly complex tasks. The newly proposed benchmark consists of 80 manually designed tasks across 7 distinct entities, testing the models' ability to learn from minimal initial mastery. Initial testing revealed that even advanced models like GPT-4 could only achieve a 47% pass rate in three-shot scenarios with humanoid entities. To address these limitations, the RoboCoder framework integrates Large Language Models (LLMs) with a dynamic learning system that uses real-time environmental feedback to continuously update and refine action codes. This adaptive method showed a remarkable improvement, achieving a 36% relative improvement. Our codes will be released.


title: Phonon heat conduction across slippery interfaces in twisted graphite

abstract: Interlayer rotation in van der Waals (vdW) materials offers great potential for manipulating phonon dynamics and heat flow in advanced electronics with ever higher compactness and power density. However, despite extensive theoretical efforts in recent years, experimental measurements remain scarce especially due to the critical challenges of preparing single-crystalline twisted interfaces and probing interfacial thermal transport with sufficient resolution. Here, we exploited the intrinsic twisted interfaces in highly oriented pyrolytic graphite (HOPG). By developing novel experimental schemes based on microfabricated mesas, we managed to achieve simultaneous mechanical characterizations and thermal measurements. In particular, we pushed the HOPG mesas with a microprobe to identify and rotate single-crystalline intrinsic interfaces owing to their slippery nature as is well known in structural superlubricity. Remarkably, we observed over 30-fold suppression of thermal conductance for the slippery interfaces by using epitaxial graphite as a control. Nonetheless, the interfacial conductance remains around 600 $\mathrm{MWm^{-2}K^{-1}}$ which surpasses the highest values for artificially stacked vdW structures by more than five times. Further, atomic simulations revealed the predominant role of the transverse acoustic phonons. Together, our findings highlight a general physical picture that directly correlates interfacial thermal transport with sliding resistance, and lay the foundation for twist-enabled thermal management which are particularly beneficial to twistronics and slidetronics.


title: On capitulations and pseudo-null submodules in certain ${\Bbb Z}_p^d$-extensions

abstract: Let $p$ be a prime number. By a result of Ozaki, the capitulations of ideals in ${\Bbb Z}_p$-extensions and the finite submodules of Iwasawa modules are closely related. In this article, we discuss this relationship in ${\Bbb Z}_p^d$-extensions.


title: Maximum Likelihood Identification of Uncontrollable Linear Time-Invariant Models for Offset-Free Control

abstract: Maximum likelihood identification of linear time-invariant models is a difficult problem because it is, in general, a nonlinear semidefinite program, with semidefinite covariance matrix arguments and semidefinite filter stability constraints. To enforce filter stability, we establish a general theory of closed constraints on the system eigenvalues using LMI regions. To solve the identification problem, we employ a Cholesky factorization method that reduces the semidefinite program to a standard nonlinear program. Finally, we apply the identification algorithm to a class of linear plant and disturbance models commonly used in offset-free model predictive control applications. Specifically, we consider models that are structured with uncontrollable, integrating disturbance states. We solve this disturbance modeling problem, and validate the resulting controller and estimator performance, in two real-world case studies: first, a low-cost benchmark temperature control laboratory, and second, an industrial-scale chemical reactor at Eastman Chemical's Kingsport plant.


title: A second-order accurate, original energy dissipative numerical scheme for chemotaxis and its convergence analysis

abstract: This paper proposes a second-order accurate numerical scheme for the Patlak-Keller-Segel system with various mobilities for the description of chemotaxis. Formulated in a variational structure, the entropy part is novelly discretized by a modified Crank-Nicolson approach so that the solution to the proposed nonlinear scheme corresponds to a minimizer of a convex functional. A careful theoretical analysis reveals that the unique solvability and positivity-preserving property could be theoretically justified. More importantly, such a second order numerical scheme is able to preserve the dissipative property of the original energy functional, instead of a modified one. To the best of our knowledge, the proposed scheme is the first second-order accurate one in literature that could achieve both the numerical positivity and original energy dissipation. In addition, an optimal rate convergence estimate is provided for the proposed scheme, in which rough and refined error estimate techniques have to be included to accomplish such an analysis. Ample numerical results are presented to demonstrate robust performance of the proposed scheme in preserving positivity and original energy dissipation in blowup simulations.


title: CORTEX: Large-Scale Brain Simulator Utilizing Indegree Sub-Graph Decomposition on Fugaku Supercomputer

abstract: We introduce CORTEX, an algorithmic framework designed for large-scale brain simulation. Leveraging the computational capacity of the Fugaku Supercomputer, CORTEX maximizes available problem size and processing performance. Our primary innovation, Indegree Sub-Graph Decomposition, along with a suite of parallel algorithms, facilitates efficient domain decomposition by segmenting the global graph structure into smaller, identically structured sub-graphs. This segmentation allows for parallel processing of synaptic interactions without inter-process dependencies, effectively eliminating data racing at the thread level without necessitating mutexes or atomic operations. Additionally, this strategy enhances the overlap of communication and computation. Benchmark tests conducted on spiking neural networks, characterized by biological parameters, have demonstrated significant enhancements in both problem size and simulation performance, surpassing the capabilities of the current leading open-source solution, the NEST Simulator. Our work offers a powerful new tool for the field of neuromorphic computing and understanding brain function.


title: The impact of nodes of information dissemination on epidemic spreading in dynamic multiplex networks

abstract: Epidemic spreading processes on dynamic multiplex networks provide a more accurate description of natural spreading processes than those on single layered networks. To describe the influence of different individuals in the awareness layer on epidemic spreading, we propose a two-layer network-based epidemic spreading model, including some individuals who neglect the epidemic, and we explore how individuals with different properties in the awareness layer will affect the spread of epidemics. The two-layer network model is divided into an information transmission layer and a disease spreading layer. Each node in the layer represents an individual with different connections in different layers. Individuals with awareness will be infected with a lower probability compared to unaware individuals, which corresponds to the various epidemic prevention measures in real life. We adopt the micro-Markov chain approach to analytically derive the threshold for the proposed epidemic model, which demonstrates that the awareness layer affects the threshold of disease spreading. We then explore how individuals with different properties would affect the disease spreading process through extensive Monte Carlo numerical simulations. We find that individuals with high centrality in the awareness layer would significantly inhibit the transmission of infectious diseases. Additionally, we propose conjectures and explanations for the approximately linear effect of individuals with low centrality in the awareness layer on the number of infected individuals.


title: More on spin-2 operators in holographic quantum mechanics

abstract: We study the spectrum, unitarity bound and holographic central charge of spin-2 operators in a warped $\text{AdS}_2 \times \text{S}^2 \times \text{T}^4 \times \mathcal{I}_\psi \times \mathcal{I}_\rho$ background in the Type IIB theory. We were able to identify a class of solutions that is completely independent of the functions that define the background solution. We comment on the relation of our results to the previous ones in the literature.


title: The magnetic field of the Radcliffe Wave: starlight polarization at nearest approach to the Sun

abstract: We investigate the geometry of the magnetic field towards the Radcliffe Wave, a coherent 3-kpc-long part of the nearby Local Arm recently discovered via three-dimensional dust mapping. We use archival stellar polarization in the optical and new measurements in the near-infrared to trace the magnetic field as projected on the plane of the sky. Our new observations cover the portion of the structure that is closest to the Sun, between Galactic longitudes of 122$^\circ$ and 188$^\circ$. The polarization angles of stars immediately background to the Radcliffe Wave appear to be aligned with the structure as projected on the plane of the sky. The observed magnetic field configuration is inclined with respect to the Galactic disk at an angle of 18$^\circ$. This departure from a geometry parallel to the plane of the Galaxy is contrary to previous constraints from more distant stars and polarized dust emission. We confirm that the polarization angle of stars at larger distances shows a mean orientation parallel to the Galactic disk. We discuss implications of the observed morphology of the magnetic field for models of the large-scale Galactic magnetic field, as well as formation scenarios for the Radcliffe Wave itself.


title: Privacy Preserving Semi-Decentralized Mean Estimation over Intermittently-Connected Networks

abstract: We consider the problem of privately estimating the mean of vectors distributed across different nodes of an unreliable wireless network, where communications between nodes can fail intermittently. We adopt a semi-decentralized setup, wherein to mitigate the impact of intermittently connected links, nodes can collaborate with their neighbors to compute a local consensus, which they relay to a central server. In such a setting, the communications between any pair of nodes must ensure that the privacy of the nodes is rigorously maintained to prevent unauthorized information leakage. We study the tradeoff between collaborative relaying and privacy leakage due to the data sharing among nodes and, subsequently, propose PriCER: Private Collaborative Estimation via Relaying -- a differentially private collaborative algorithm for mean estimation to optimize this tradeoff. The privacy guarantees of PriCER arise (i) implicitly, by exploiting the inherent stochasticity of the flaky network connections, and (ii) explicitly, by adding Gaussian perturbations to the estimates exchanged by the nodes. Local and central privacy guarantees are provided against eavesdroppers who can observe different signals, such as the communications amongst nodes during local consensus and (possibly multiple) transmissions from the relays to the central server. We substantiate our theoretical findings with numerical simulations. Our implementation is available at https://github.com/rajarshisaha95/private-collaborative-relaying.

categories: eess.SP cs.DC cs.IT cs.LG cs.SY eess.SY math.IT


title: Thermal Conductivity of Double Polymorph Ga2O3 Structures

abstract: Recently discovered double gamma/beta ({\gamma}/\b{eta}) polymorph Ga2O3 structures constitute a class of novel materials providing an option to modulate functional properties across interfaces without changing chemical compositions of materials, in contrast to that in conventional heterostructures. In this work, for the first time, we investigate thermal transport in such homo-interface structures as an example of their physical properties. Specifically, the cross-plane thermal conductivity (k) was measured by femtosecond laser-based time-domain thermoreflectance with MHz modulation rates, effectively obtaining depth profiles of the thermal conductivity across the {\gamma}/\b{eta}-Ga2O3 structures. In this way, the thermal conductivity of {\gamma}-Ga2O3 k=1.84{\div}2.11 W m-1K-1 was found to be independent of the initial \b{eta}-substrates orientations, in accordance with the cubic spinel structure of the {\gamma}-phase and consistently with the molecular dynamics simulation data. In its turn, the thermal conductivity of monoclinic \b{eta}-Ga2O3 showed a distinct anisotropy, with values ranging from 10 W m-1K-1 for [201] to 20 Wm-1K-1 for [010] orientations. Thus, for double {\gamma}/\b{eta} Ga2O3 polymorph structures formed on [010] \b{eta}-substrates, there is an order of magnitude difference in thermal conductivity across the {\gamma}/\b{eta} interface, which potentially can be exploited in thermal energy conversion applications.


title: Enhancing In-Context Learning Performance with just SVD-Based Weight Pruning: A Theoretical Perspective

abstract: Pre-trained large language models (LLMs) based on Transformer have demonstrated striking in-context learning (ICL) abilities. With a few demonstration input-label pairs, they can predict the label for an unseen input without any parameter updates. In this paper, we show an exciting phenomenon that SVD-based weight pruning can enhance ICL performance, and more surprising, pruning weights in deep layers often results in more stable performance improvements in shallow layers. However, the underlying mechanism of those findings still remains an open question. To reveal those findings, we conduct an in-depth theoretical analysis by presenting the implicit gradient descent (GD) trajectories of ICL and giving the mutual information based generalization bounds of ICL via full implicit GD trajectories. This helps us reasonably explain the surprising experimental findings. Besides, based on all our experimental and theoretical insights, we intuitively propose a simple, model-compression and derivative-free algorithm for downstream tasks in enhancing ICL inference. Experiments on benchmark datasets and open source LLMs display the method effectiveness\footnote{The code is available at \url{https://github.com/chen123CtrlS/EnhancingICL_SVDPruning}}.


title: DeepRacer on Physical Track: Parameters Exploration and Performance Evaluation

abstract: This paper focuses on the physical racetrack capabilities of AWS DeepRacer. Two separate experiments were conducted. The first experiment (Experiment I) focused on evaluating the impact of hyperparameters on the physical environment. Hyperparameters such as gradient descent batch size and loss type were changed systematically as well as training time settings. The second experiment (Experiment II) focused on exploring AWS DeepRacer object avoidance in the physical environment. It was uncovered that in the simulated environment, models with a higher gradient descent batch size had better performance than models with a lower gradient descent batch size. Alternatively, in the physical environment, a gradient descent batch size of 128 appears to be preferable. It was found that models using the loss type of Huber outperformed models that used the loss type of MSE in both the simulated and physical environments. Finally, object avoidance in the simulated environment appeared to be effective; however, when bringing these models to the physical environment, there was a pronounced challenge to avoid objects. Therefore, object avoidance in the physical environment remains an open challenge.


title: Wave packet dynamics of entangled q-deformed states

abstract: This paper explores the wave packet dynamics of a math-type q- deformed field interacting with atoms in a Kerr-type nonlinear medium. The primary focus is on the generation and dynamics of entanglement using the q- deformed field, with the quantification of entanglement accomplished through the von Neumann entropy. Two distinct initial q-deformed states, the q-deformed Fock state, and the q-deformed coherent state, are investigated. The entanglement dynamics reveal characteristics of periodic, quasi-periodic, and chaotic behavior. Non-deformed initial states display wave packet near revivals and fractional revivals in entanglement dynamics while introducing q-deformation eliminates these features. The q-deformation significantly influences wave packet revivals and fractional revivals, with even a slight introduction causing their disappearance. For large values of q, the entanglement dynamics exhibit a chaotic nature. In the case of a beam splitter-type interaction applied to the initial deformed Fock state, an optimal deformation parameter q is identified, leading to maximum entanglement exceeding the non-deformed scenario.


title: Global synchronization in generalized multilayer higher-order networks

abstract: Networks incorporating higher-order interactions are increasingly recognized for their ability to introduce novel dynamics into various processes, including synchronization. Previous studies on synchronization within multilayer networks have often been limited to specific models, such as the Kuramoto model, or have focused solely on higher-order interactions within individual layers. Here, we present a comprehensive framework for investigating synchronization, particularly global synchronization, in multilayer networks with higher-order interactions. Our framework considers interactions beyond pairwise connections, both within and across layers. We demonstrate the existence of a stable global synchronous state, with a condition resembling the master stability function, contingent on the choice of coupling functions. Our theoretical findings are supported by simulations using Hindmarsh-Rose neuronal and R\"{o}ssler oscillators. These simulations illustrate how synchronization is facilitated by higher-order interactions, both within and across layers, highlighting the advantages over scenarios involving interactions within single layers.


title: Character-Level Chinese Dependency Parsing via Modeling Latent Intra-Word Structure

abstract: Revealing the syntactic structure of sentences in Chinese poses significant challenges for word-level parsers due to the absence of clear word boundaries. To facilitate a transition from word-level to character-level Chinese dependency parsing, this paper proposes modeling latent internal structures within words. In this way, each word-level dependency tree is interpreted as a forest of character-level trees. A constrained Eisner algorithm is implemented to ensure the compatibility of character-level trees, guaranteeing a single root for intra-word structures and establishing inter-word dependencies between these roots. Experiments on Chinese treebanks demonstrate the superiority of our method over both the pipeline framework and previous joint models. A detailed analysis reveals that a coarse-to-fine parsing strategy empowers the model to predict more linguistically plausible intra-word structures.


title: Optimizing Multi-User Semantic Communication via Transfer Learning and Knowledge Distillation

abstract: Semantic communication, notable for ensuring quality of service by jointly optimizing source and channel coding, effectively extracts data semantics, reduces transmission length, and mitigates channel noise. However, most studies overlook multi-user scenarios and resource availability, limiting real-world application. This paper addresses this gap by focusing on downlink communication from a base station to multiple users with varying computing capacities. Users employ variants of Swin transformer models for source decoding and a simple architecture for channel decoding. We propose a novel training regimen, incorporating transfer learning and knowledge distillation to improve low-computing users' performance. Extensive simulations validate the proposed methods.


title: Total Positivity of Almost-Riordan Arrays

abstract: In this paper we study the total positivity of almost-Riordan arrays $(d(t)|\, g(t), f(t))$ and establish its necessary conditions and sufficient conditions, particularly, for some well used formal power series $d(t)$. We present a semidirect product of an almost-array and use it to transfer a total positivity problem for an almost-Riordan array to the total positivity problem for a quasi-Riordan array. We find the sequence characterization of total positivity of the almost-Riordan arrays. The production matrix $J$ of an almost-Riordan array $(d|\, g,f)$ is presented so that $J$ is totally positive implies the total positivity of both the almost-Riordan array $(d|\, g,f)$ and the Riordan array $(g,f)$. We also present a counterexample to illustrate that this sufficient condition is not necessary. If the production matrix $J$ is tridiagonal, then the expressions of its principal minors are given. By using expressions, we find a sufficient and necessary condition of the total positivity of almost-Riordan arrays with tridiagonal production matrices. A numerous examples are given to demonstrate our results.


title: Nonstandard derivation of the Gorini-Kossakowski-Sudarshan-Lindblad master equation of a quantum dynamical semigroup from the Kraus representation

abstract: We give a new nonstandard proof of the well-known theorem that the generator $L$ of a quantum dynamical semigroup $\exp(tL)$ on a finite-dimensional quantum system has a specific form called a Gorini-Kossakowski-Sudarshan-Lindblad (GKSL) generator (also known as a Lindbladian) and vice versa. The proof starts from the Kraus representation of the quantum channel $\exp (\delta t L)$ for an infinitesimal hyperreal number $\delta t>0$ and then estimates the orders of the traceless components of the Kraus operators. The jump operators naturally arise as the standard parts of the traceless components of the Kraus operators divided by $\sqrt{\delta t}$. We also give a nonstandard proof of a related fact that close completely positive maps have close Kraus operators.


title: XL-HeadTags: Leveraging Multimodal Retrieval Augmentation for the Multilingual Generation of News Headlines and Tags

abstract: Millions of news articles published online daily can overwhelm readers. Headlines and entity (topic) tags are essential for guiding readers to decide if the content is worth their time. While headline generation has been extensively studied, tag generation remains largely unexplored, yet it offers readers better access to topics of interest. The need for conciseness in capturing readers' attention necessitates improved content selection strategies for identifying salient and relevant segments within lengthy articles, thereby guiding language models effectively. To address this, we propose to leverage auxiliary information such as images and captions embedded in the articles to retrieve relevant sentences and utilize instruction tuning with variations to generate both headlines and tags for news articles in a multilingual context. To make use of the auxiliary information, we have compiled a dataset named XL-HeadTags, which includes 20 languages across 6 diverse language families. Through extensive evaluation, we demonstrate the effectiveness of our plug-and-play multimodal-multilingual retrievers for both tasks. Additionally, we have developed a suite of tools for processing and evaluating multilingual texts, significantly contributing to the research community by enabling more accurate and efficient analysis across languages.


title: Empirical Guidelines for Deploying LLMs onto Resource-constrained Edge Devices

abstract: The scaling laws have become the de facto guidelines for designing large language models (LLMs), but they were studied under the assumption of unlimited computing resources for both training and inference. As LLMs are increasingly used as personalized intelligent assistants, their customization (i.e., learning through fine-tuning) and deployment onto resource-constrained edge devices will become more and more prevalent. An urging but open question is how a resource-constrained computing environment would affect the design choices for a personalized LLM. We study this problem empirically in this work. In particular, we consider the tradeoffs among a number of key design factors and their intertwined impacts on learning efficiency and accuracy. The factors include the learning methods for LLM customization, the amount of personalized data used for learning customization, the types and sizes of LLMs, the compression methods of LLMs, the amount of time afforded to learn, and the difficulty levels of the target use cases. Through extensive experimentation and benchmarking, we draw a number of surprisingly insightful guidelines for deploying LLMs onto resource-constrained devices. For example, an optimal choice between parameter learning and RAG may vary depending on the difficulty of the downstream task, the longer fine-tuning time does not necessarily help the model, and a compressed LLM may be a better choice than an uncompressed LLM to learn from limited personalized data.


title: A Nearly Optimal Deterministic Algorithm for Online Transportation Problem

abstract: We propose a new deterministic algorithm called Subtree-Decomposition for the online transportation problem and show that the algorithm is $(8m-5)$-competitive, where $m$ is the number of server sites. It has long been known that the competitive ratio of any deterministic algorithm is lower bounded by $2m-1$ for this problem. On the other hand, the conjecture proposed by Kalyanasundaram and Pruhs in 1998 asking whether a deterministic $(2m-1)$-competitive algorithm exists for the online transportation problem has remained open for over two decades. The upper bound on the competitive ratio, $8m-5$, which is the result of this paper, is the first to come close to this conjecture, and is the best possible within a constant factor.


title: Iterative Sparse Identification of Nonlinear Dynamics

abstract: In order to extract governing equations from time-series data, various approaches are proposed. Among those, sparse identification of nonlinear dynamics (SINDy) stands out as a successful method capable of modeling governing equations with a minimal number of terms, utilizing the principles of compressive sensing. This feature, which relies on a small number of terms, is crucial for interpretability. The effectiveness of SINDy hinges on the choice of candidate functions within its dictionary to extract governing equations of dynamical systems. A larger dictionary allows for more terms, enhancing the quality of approximations. However, the computational complexity scales with dictionary size, rendering SINDy less suitable for high-dimensional datasets, even though it has been successfully applied to low-dimensional datasets. To address this challenge, we introduce iterative SINDy in this paper, where the dictionary undergoes expansion and compression through iterations. We also conduct an analysis of the convergence properties of iterative SINDy. Simulation results validate that iterative SINDy can achieve nearly identical performance to SINDy, while significantly reducing computational complexity. Notably, iterative SINDy demonstrates effectiveness with high-dimensional time-series data without incurring the prohibitively high computational cost associated with SINDy.


title: Closures of permutation groups with restricted nonabelian composition factors

abstract: Given a permutation group $G$ on a finite set $\Omega$, let $G^{(k)}$ denote the $k$-closure of $G$, that is, the largest permutation group on $\Omega$ having the same orbits in the induced action on $\Omega^k$ as $G$. Recall that a group is $\mathrm{Alt}(d)$-free if it does not contain a section isomorphic to the alternating group of degree $d$. Motivated by some problems in computational group theory, we prove that the $k$-closure of an $\mathrm{Alt}(d)$-free group is again $\mathrm{Alt}(d)$-free for $k \geq 4$ and $d \geq 25$.


title: Operator dynamics and entanglement in space-time dual Hadamard lattices

abstract: Many-body quantum dynamics defined on a spatial lattice and in discrete time -- either as stroboscopic Floquet systems or quantum circuits -- has been an active area of research for several years. Being discrete in space and time, a natural question arises: when can such a model be viewed as evolving unitarily in space as well as in time? Models with this property, which sometimes goes by the name space-time duality, have been shown to have a number of interesting features related to entanglement growth and correlations. One natural way in which the property arises in the context of (brickwork) quantum circuits is by choosing dual unitary gates: two site operators that are unitary in both the space and time directions. We introduce a class of models with $q$ states per site, defined on the square lattice by a complex partition function and paremeterized in terms of $q\times q$ Hadamard matrices, that have the property of space-time duality. These may interpreted as particular dual unitary circuits or stroboscopically evolving systems, and generalize the well studied self-dual kicked Ising model. We explore the operator dynamics in the case of Clifford circuits, making connections to Clifford cellular automata [J. Math. Phys. 49, 112104 (2008)] and in the $q\to\infty$ limit to the classical spatiotemporal cat model of many body chaos [Nonlinearity 34, 2800 (2021)]. We establish integrability and the corresponding conserved charges for a large subfamily and show how the long-range entanglement protocol discussed in the recent paper [Phys. Rev. B 105, 144306 (2022)] can be reinterpreted in purely graphical terms and directly applied here.


title: Gamma Ray AGNs: Estimating Redshifts and Blazar Classification using traditional Neural Networks with smart initialization and self-supervised learning

abstract: Redshift estimation and the classification of gamma-ray AGNs represent crucial challenges in the field of gamma-ray astronomy. Recent efforts have been made to tackle these problems using traditional machine learning methods. However, the simplicity of existing algorithms, combined with their basic implementations, underscores an opportunity and a need for further advancement in this area. Our approach begins by implementing a Bayesian model for redshift estimation, which can account for uncertainty while providing predictions with the desired confidence level. Subsequently, we address the classification problem by leveraging intelligent initialization techniques and employing soft voting. Additionally, we explore several potential self-supervised algorithms in their conventional form. Lastly, in addition to generating predictions for data with missing outputs, we ensure that the theoretical assertions put forth by both algorithms mutually reinforce each other.


title: Flips in colorful triangulations

abstract: The associahedron is the graph $\mathcal{G}_N$ that has as nodes all triangulations of a convex $N$-gon, and an edge between any two triangulations that differ in a flip operation, which consists of removing an edge shared by two triangles and replacing it by the other diagonal of the resulting 4-gon. In this paper, we consider a large collection of induced subgraphs of $\mathcal{G}_N$ obtained by Ramsey-type colorability properties. Specifically, coloring the points of the $N$-gon red and blue alternatingly, we consider only colorful triangulations, namely triangulations in which every triangle has points in both colors, i.e., monochromatic triangles are forbidden. The resulting induced subgraph of $\mathcal{G}_N$ on colorful triangulations is denoted by $\mathcal{F}_N$. We prove that $\mathcal{F}_N$ has a Hamilton cycle for all $N\geq 8$, resolving a problem raised by Sagan, i.e., all colorful triangulations on $N$ points can be listed so that any two cyclically consecutive triangulations differ in a flip. In fact, we prove that for an arbitrary fixed coloring pattern of the $N$ points with at least 10 changes of color, the resulting subgraph of $\mathcal{G}_N$ on colorful triangulations (for that coloring pattern) admits a Hamilton cycle. We also provide an efficient algorithm for computing a Hamilton path in $\mathcal{F}_N$ that runs in time $\mathcal{O}(1)$ on average per generated node. This algorithm is based on a new and algorithmic construction of a tree rotation Gray code for listing all $n$-vertex $k$-ary trees that runs in time $\mathcal{O}(k)$ on average per generated tree.


title: Constructing tree amplitudes of scalar EFT from double soft theorem

abstract: The well known Adler zero can fully determine tree amplitudes of non-linear sigma model (NLSM), but fails to fix tree pion amplitudes with higher-derivative interactions. To fill this gap, in this paper we propose a new method based on exploiting the double soft theorem for scalars, which can be applied to a wider range. A remarkable feature of this method is, we only assume the universality of soft behavior at the beginning, and determine the explicit form of double soft factor in the process of constructing amplitudes. To test the applicability, we use this method to construct tree NLSM amplitudes and tree amplitudes those pions in NLSM couple to bi-adjoint scalars. We also construct the simplest pion amplitudes which receive leading higher-derivative correction, with arbitrary number of external legs. All resulted amplitudes are formulated as universal expansions to appropriate basis.


title: Count-mean Sketch as an Optimized Framework for Frequency Estimation with Local Differential Privacy

abstract: This paper identifies that a group of state-of-the-art locally-differentially-private (LDP) algorithms for frequency estimation are equivalent to the private Count-Mean Sketch (CMS) algorithm with different parameters. Therefore, we revisit the private CMS, correct errors in the original CMS paper regarding expectation and variance, modify the CMS implementation to eliminate existing bias, and explore optimized parameters for CMS to achieve optimality in reducing the worst-case mean squared error (MSE), $l_1$ loss, and $l_2$ loss. Additionally, we prove that pairwise-independent hashing is sufficient for CMS, reducing its communication cost to the logarithm of the cardinality of all possible values (i.e., a dictionary). As a result, the aforementioned optimized CMS is proven theoretically and empirically to be the only algorithm optimized for reducing the worst-case MSE, $l_1$ loss, and $l_2$ loss when dealing with a very large dictionary. Furthermore, we demonstrate that randomness is necessary to ensure the correctness of CMS, and the communication cost of CMS, though low, is unavoidable despite the randomness being public or private.


title: Adaptive Lightweight Security for Performance Efficiency in Critical Healthcare Monitoring

abstract: The healthcare infrastructure requires robust security procedures, technologies, and policies due to its critical nature. Since the Internet of Things (IoT) with its diverse technologies has become an integral component of future healthcare systems, its security requires a thorough analysis due to its inherent security limitations that arise from resource constraints. Existing communication technologies used for IoT connectivity, such as 5G, provide communications security with the underlying communication infrastructure to a certain level. However, the evolving healthcare paradigm requires adaptive security procedures and technologies that can adapt to the varying resource constraints of IoT devices. This need for adaptive security is particularly pronounced when considering components outside the security sandbox of 5G, such as IoT nodes and M2M connections, which introduce additional security challenges. This article brings forth the unique healthcare monitoring requirements and studies the existing encryption-based security approaches to provide the necessary security. Furthermore, this research introduces a novel approach to optimizing security and performance in IoT in healthcare, particularly in critical use cases such as remote patient monitoring. Finally, the results from the practical implementation demonstrate a marked improvement in the system performance.


title: Projection-Free Variance Reduction Methods for Stochastic Constrained Multi-Level Compositional Optimization

abstract: This paper investigates projection-free algorithms for stochastic constrained multi-level optimization. In this context, the objective function is a nested composition of several smooth functions, and the decision set is closed and convex. Existing projection-free algorithms for solving this problem suffer from two limitations: 1) they solely focus on the gradient mapping criterion and fail to match the optimal sample complexities in unconstrained settings; 2) their analysis is exclusively applicable to non-convex functions, without considering convex and strongly convex objectives. To address these issues, we introduce novel projection-free variance reduction algorithms and analyze their complexities under different criteria. For gradient mapping, our complexities improve existing results and match the optimal rates for unconstrained problems. For the widely-used Frank-Wolfe gap criterion, we provide theoretical guarantees that align with those for single-level problems. Additionally, by using a stage-wise adaptation, we further obtain complexities for convex and strongly convex functions. Finally, numerical experiments on different tasks demonstrate the effectiveness of our methods.


title: A graph without zero in its spectra

abstract: In this paper we consider the discrete Laplacian acting on 1-forms and we study its spectrum relative to the spectrum of the 0-form Laplacian. We show that the non zero spectrum can coincide for these Laplacians with the same nature. We examine the characteristics of 0-spectrum of the 1-form Laplacian compared to the cycles of graphs.


title: Enhancing Graph U-Nets for Mesh-Agnostic Spatio-Temporal Flow Prediction

abstract: This study aims to overcome the conventional deep-learning approaches based on convolutional neural networks, whose applicability to complex geometries and unstructured meshes is limited due to their inherent mesh dependency. We propose novel approaches to improve mesh-agnostic spatio-temporal prediction of transient flow fields using graph U-Nets, enabling accurate prediction on diverse mesh configurations. Key enhancements to the graph U-Net architecture, including the Gaussian mixture model convolutional operator and noise injection approaches, provide increased flexibility in modeling node dynamics: the former reduces prediction error by 95\% compared to conventional convolutional operators, while the latter improves long-term prediction robustness, resulting in an error reduction of 86\%. We also investigate transductive and inductive-learning perspectives of graph U-Nets with proposed improvements. In the transductive setting, they effectively predict quantities for unseen nodes within the trained graph. In the inductive setting, they successfully perform in mesh scenarios with different vortex-shedding periods, showing 98\% improvement in predicting the future flow fields compared to a model trained without the inductive settings. It is found that graph U-Nets without pooling operations, i.e. without reducing and restoring the node dimensionality of the graph data, perform better in inductive settings due to their ability to learn from the detailed structure of each graph. Meanwhile, we also discover that the choice of normalization technique significantly impacts graph U-Net performance.


title: End-to-End Trainable Soft Retriever for Low-resource Relation Extraction

abstract: This study addresses a crucial challenge in instance-based relation extraction using text generation models: end-to-end training in target relation extraction task is not applicable to retrievers due to the non-differentiable nature of instance selection. We propose a novel End-to-end TRAinable Soft K-nearest neighbor retriever (ETRASK) by the neural prompting method that utilizes a soft, differentiable selection of the $k$ nearest instances. This approach enables the end-to-end training of retrievers in target tasks. On the TACRED benchmark dataset with a low-resource setting where the training data was reduced to 10\%, our method achieved a state-of-the-art F1 score of 71.5\%. Moreover, ETRASK consistently improved the baseline model by adding instances for all settings. These results highlight the efficacy of our approach in enhancing relation extraction performance, especially in resource-constrained environments. Our findings offer a promising direction for future research with extraction and the broader application of text generation in natural language processing.


title: Speed of Light Exact Greedy Decoding for RNN-T Speech Recognition Models on GPU

abstract: The vast majority of inference time for RNN Transducer (RNN-T) models today is spent on decoding. Current state-of-the-art RNN-T decoding implementations leave the GPU idle ~80% of the time. Leveraging a new CUDA 12.4 feature, CUDA graph conditional nodes, we present an exact GPU-based implementation of greedy decoding for RNN-T models that eliminates this idle time. Our optimizations speed up a 1.1 billion parameter RNN-T model end-to-end by a factor of 2.5x. This technique can applied to the "label looping" alternative greedy decoding algorithm as well, achieving 1.7x and 1.4x end-to-end speedups when applied to 1.1 billion parameter RNN-T and Token and Duration Transducer models respectively. This work enables a 1.1 billion parameter RNN-T model to run only 16% slower than a similarly sized CTC model, contradicting the common belief that RNN-T models are not suitable for high throughput inference. The implementation is available in NVIDIA NeMo.


title: Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning

abstract: Parameter-efficient fine-tuning (PEFT) has emerged as the predominant technique for fine-tuning in the era of large language models. However, existing PEFT methods still have inadequate training efficiency. Firstly, the utilization of large-scale foundation models during the training process is excessively redundant for certain fine-tuning tasks. Secondly, as the model size increases, the growth in trainable parameters of empirically added PEFT modules becomes non-negligible and redundant, leading to inefficiency. To achieve task-specific efficient fine-tuning, we propose the Light-PEFT framework, which includes two methods: Masked Early Pruning of the Foundation Model and Multi-Granularity Early Pruning of PEFT. The Light-PEFT framework allows for the simultaneous estimation of redundant parameters in both the foundation model and PEFT modules during the early stage of training. These parameters can then be pruned for more efficient fine-tuning. We validate our approach on GLUE, SuperGLUE, QA tasks, and various models. With Light-PEFT, parameters of the foundation model can be pruned by up to over 40%, while still controlling trainable parameters to be only 25% of the original PEFT method. Compared to utilizing the PEFT method directly, Light-PEFT achieves training and inference speedup, reduces memory usage, and maintains comparable performance and the plug-and-play feature of PEFT.


title: Low-Rank Similarity Mining for Multimodal Dataset Distillation

abstract: Though dataset distillation has witnessed rapid development in recent years, the distillation of multimodal data, e.g., image-text pairs, poses unique and under-explored challenges. Unlike unimodal data, image-text contrastive learning (ITC) data lack inherent categorization and should instead place greater emphasis on modality correspondence. In this work, we propose Low-Rank Similarity Mining (LoRS) for multimodal dataset distillation, that concurrently distills a ground truth similarity matrix with image-text pairs, and leverages low-rank factorization for efficiency and scalability. The proposed approach brings significant improvement to the existing algorithms, marking a significant contribution to the field of visual-language dataset distillation. We advocate adopting LoRS as a foundational synthetic data setup for image-text dataset distillation. Our code is available at https://github.com/silicx/LoRS_Distill.


title: Infusing Self-Consistency into Density Functional Theory Hamiltonian Prediction via Deep Equilibrium Models

abstract: In this study, we introduce a unified neural network architecture, the Deep Equilibrium Density Functional Theory Hamiltonian (DEQH) model, which incorporates Deep Equilibrium Models (DEQs) for predicting Density Functional Theory (DFT) Hamiltonians. The DEQH model inherently captures the self-consistency nature of Hamiltonian, a critical aspect often overlooked by traditional machine learning approaches for Hamiltonian prediction. By employing DEQ within our model architecture, we circumvent the need for DFT calculations during the training phase to introduce the Hamiltonian's self-consistency, thus addressing computational bottlenecks associated with large or complex systems. We propose a versatile framework that combines DEQ with off-the-shelf machine learning models for predicting Hamiltonians. When benchmarked on the MD17 and QH9 datasets, DEQHNet, an instantiation of the DEQH framework, has demonstrated a significant improvement in prediction accuracy. Beyond a predictor, the DEQH model is a Hamiltonian solver, in the sense that it uses the fixed-point solving capability of the deep equilibrium model to iteratively solve for the Hamiltonian. Ablation studies of DEQHNet further elucidate the network's effectiveness, offering insights into the potential of DEQ-integrated networks for Hamiltonian learning.


title: Cooperative CO$_2$ capture via oxalate formation on metal-decorated graphene

abstract: CO$_2$ capture using carbon-based materials, particularly graphene and graphene-like materials, is a promising strategy to deal with CO$_2$ emissions. However, significant gaps remain in our understanding of the molecular-level interaction between CO$_2$ molecules and graphene, particularly, in terms of chemical bonding and electron transfer. In this work, we employ random structure search and density functional theory to understand the adsorption of CO$_2$ molecules on Ca, Sr, Na, K, and Ti decorated graphene surfaces. Compared to the pristine material, we observe enhanced CO$_2$ adsorption on the decorated graphene surfaces. Particularly on group 2 metals and titanium decorated graphene, CO$_2$ can be strongly chemisorbed as a bent CO$_2$ anion or as an oxalate, depending on the number of CO$_2$ molecules. Electronic structure analysis reveals the adsorption mechanism to involve an ionic charge transfer from the metal adatom to the adsorbed CO$_2$. Overall, this study suggests that reducing CO$_2$ to oxalate on group 2 metals and titanium metal-decorated graphene surfaces is a potential strategy for CO$_2$ storage.


title: Beyond a binary theorizing of prosociality

abstract: A stylized experiment, the public goods game, has taught us the peculiar reproducible fact that humans tend to contribute more to shared resources than expected from economically rational assumptions. There have been two competing explanations for this phenomenon: either contributing to the public good is an innate human trait (the prosocial preference hypothesis) or a transitory effect while learning the game (the confused learner hypothesis). We use large-scale experimental data from a novel experimental design to distinguish between these two hypotheses. By monitoring the effects of zealots (persistently cooperating bots) and varying the participants' awareness of them, we find a considerably more complex scenario than previously reported. People indeed have a prosocial bias, but not to the degree that they always forego taking action to increase their profit. While our findings end the simplistic theorizing of prosociality in the public goods game, an observed positive, cooperative response to zealots has actionable policy implications.


title: Morpho-Photometric Classification of KiDS DR5 Sources Based on Neural Networks: A Comprehensive Star-Quasar-Galaxy Catalog

abstract: We present a novel multimodal neural network for classifying astronomical sources in multiband ground-based observations, from optical to near infrared, to separate sources in stars, galaxies and quasars. Our approach combines a convolutional neural network branch for learning morphological features from $r$-band images with an artificial neural network branch for extracting spectral energy distribution (SED) information. Specifically, we have used 9-band optical ($ugri$) and NIR ($ZYHJK_s$) data from the Kilo-Degree Survey (KiDS) Data Release 5. The two branches of the network are concatenated and feed into fully-connected layers for final classification. We train the network on a spectroscopically confirmed sample from the Sloan Digital Sky Survey cross-matched with KiDS. The trained model achieves 98.76\% overall accuracy on an independent testing dataset, with F1 scores exceeding 95\% for each class. Raising the output probability threshold, we obtain higher purity at the cost of a lower completeness. We have also validated the network using external catalogs cross-matched with KiDS, correctly classifying 99.74\% of a pure star sample selected from Gaia parallaxes and proper motions, and 99.74\% of an external galaxy sample from the Galaxy and Mass Assembly survey, adjusted for low-redshift contamination. We apply the trained network to 27,334,751 KiDS DR5 sources with $r \leqslant 23$ mag to generate a new classification catalog. This multimodal neural network successfully leverages both morphological and SED information to enable efficient and robust classification of stars, quasars, and galaxies in large photometric surveys.


title: Optical biomarker of metabolism for breast tumor diagnosis: Insights from subcellular dynamics

abstract: Label-free metabolic dynamics contrast is highly appealing but difficult to achieve in biomedical imaging. Interference offers a highly sensitive mechanism for capturing the metabolic dynamics of the subcellular scatterers. However, traditional interference detection methods fail to isolate pure metabolic dynamics, as the dynamic signals are coupled with scatterer reflectivity and other uncontrollable imaging factors. Here, we demonstrate active phase modulation-assisted dynamic full-field optical coherence tomography (APMD-FFOCT) that decouples and quantifies the metabolic dynamics by adding a reference movement for all interferential scatterers. This novel technique enables imaging and dynamic analysis of subcellular structures along with their changes during the apoptotic process in tumor tissues. Furthermore, the nucleus-to-cytoplasm dynamic intensity ratio could serve as an optical biomarker for breast tumor grading, enhancing intraoperative diagnosis.


title: Enhanced Semantic Segmentation Pipeline for WeatherProof Dataset Challenge

abstract: This report describes the winning solution to the WeatherProof Dataset Challenge (CVPR 2024 UG2+ Track 3). Details regarding the challenge are available at https://cvpr2024ug2challenge.github.io/track3.html. We propose an enhanced semantic segmentation pipeline for this challenge. Firstly, we improve semantic segmentation models, using backbone pretrained with Depth Anything to improve UperNet model and SETRMLA model, and adding language guidance based on both weather and category information to InternImage model. Secondly, we introduce a new dataset WeatherProofExtra with wider viewing angle and employ data augmentation methods, including adverse weather and super-resolution. Finally, effective training strategies and ensemble method are applied to improve final performance further. Our solution is ranked 1st on the final leaderboard. Code will be available at https://github.com/KaneiGi/WeatherProofChallenge.


title: Constructing embedded surfaces for cellular embeddings of leveled spatial graphs

abstract: Finding a closed orientable surface $\mathcal{S}$ embedded in $\mathbb{R}^3$ where a given spatial graph $\mathcal{G} \subset \mathbb{R}^3$ cellular embeds is in general not possible. We therefore restrict our interest to the special class of spatial graphs that are leveled. We show that for leveled spatial graphs with a small number of levels, a surface $\mathcal{S}$ can always be found. The argument is based on the idea of decomposing $\mathcal{G}$ into subgraphs that can be placed on a sphere and on handles that are attached to the sphere, together forming an embedding of $\mathcal{G}$ in $\mathcal{S}$. We generalize the procedure to an algorithm that, if successful, constructs $\mathcal{S}$ for leveled spatial graphs with any number of levels. We conjecture that all connected leveled embeddings can be cellular embedded with the presented algorithm.


title: The behavior of higher proof theory I: Case $\Sigma^1_2$

abstract: The current ordinal analysis provides the proof-theoretic ordinal of a theory, which calibrates the robustness of the $\Pi^1_1$-consequences of the theory. We can ask whether there is an ordinal characteristic capturing more complex consequences, and it turns out that we can define the $\Sigma^1_2$-proof-theoretic ordinal capturing the robustness of the $\Sigma^1_2$-consequences of a theory. In this paper, we study the behavior of $\Sigma^1_2$-proof-theoretic ordinal, and it turns out that $\Sigma^1_2$-proof-theoretic ordinal also follows an analogue of Walsh's characterization of proof-theoretic ordinal.


title: Continual Counting with Gradual Privacy Expiration

abstract: Differential privacy with gradual expiration models the setting where data items arrive in a stream and at a given time $t$ the privacy loss guaranteed for a data item seen at time $(t-d)$ is $\epsilon g(d)$, where $g$ is a monotonically non-decreasing function. We study the fundamental $\textit{continual (binary) counting}$ problem where each data item consists of a bit, and the algorithm needs to output at each time step the sum of all the bits streamed so far. For a stream of length $T$ and privacy $\textit{without}$ expiration continual counting is possible with maximum (over all time steps) additive error $O(\log^2(T)/\varepsilon)$ and the best known lower bound is $\Omega(\log(T)/\varepsilon)$; closing this gap is a challenging open problem. We show that the situation is very different for privacy with gradual expiration by giving upper and lower bounds for a large set of expiration functions $g$. Specifically, our algorithm achieves an additive error of $ O(\log(T)/\epsilon)$ for a large set of privacy expiration functions. We also give a lower bound that shows that if $C$ is the additive error of any $\epsilon$-DP algorithm for this problem, then the product of $C$ and the privacy expiration function after $2C$ steps must be $\Omega(\log(T)/\epsilon)$. Our algorithm matches this lower bound as its additive error is $O(\log(T)/\epsilon)$, even when $g(2C) = O(1)$. Our empirical evaluation shows that we achieve a slowly growing privacy loss with significantly smaller empirical privacy loss for large values of $d$ than a natural baseline algorithm.


title: Determining the Weight Spectrum of the Reed--Muller Codes RM(m-6,m)

abstract: The weight spectra of the Reed-Muller codes $RM(r,m)$ were unknown for $r=3,...,m-5$. In IEEE Trans. Inform. Theory 2024, Carlet determined the weight spectrum of $RM(m-5,m)$ for $m\ge10$ using the Maiorana-McFarland construction, where the result was tried to be extended to $RM(m-6,m)$, but many problems occurred and much work needed to be done. In this paper, we propose a novel way of constructing Reed--Muller codewords and determine the weight spectrum of $RM(m-6,m)$ for $m\ge12$, which gives a positive answer to an open question on the weight spectrum of $RM(m-c,m)$ for $c=6$. Moreover, we put forward a conjecture and verify it for some cases. If the conjecture is true, then that open question can be completely solved.


title: Exploring the interplay between mass-energy equivalence, interactions and entanglement in an optical lattice clock

abstract: We propose protocols that probe manifestations of the mass-energy equivalence in an optical lattice clock (OLC) interrogated with spin coherent and entangled quantum states. To tune and uniquely distinguish the mass-energy equivalence effects (gravitational redshift and second order Doppler shift) in such setting, we devise a dressing protocol using an additional nuclear spin state. We then analyze the interplay between photon-mediated interactions and gravitational redshift and show that such interplay can lead to entanglement generation and frequency synchronization. In the regime where all atomic spins synchronize, we show the synchronization time depends on the initial entanglement of the state and can be used as a proxy of its metrological gain compared to a classical state. Our work opens new possibilities for exploring the effects of general relativity on quantum coherence and entanglement in OLC experiments.

categories: quant-ph cond-mat.quant-gas gr-qc physics.atom-ph


title: AutoJailbreak: Exploring Jailbreak Attacks and Defenses through a Dependency Lens

abstract: Jailbreak attacks in large language models (LLMs) entail inducing the models to generate content that breaches ethical and legal norm through the use of malicious prompts, posing a substantial threat to LLM security. Current strategies for jailbreak attack and defense often focus on optimizing locally within specific algorithmic frameworks, resulting in ineffective optimization and limited scalability. In this paper, we present a systematic analysis of the dependency relationships in jailbreak attack and defense techniques, generalizing them to all possible attack surfaces. We employ directed acyclic graphs (DAGs) to position and analyze existing jailbreak attacks, defenses, and evaluation methodologies, and propose three comprehensive, automated, and logical frameworks. \texttt{AutoAttack} investigates dependencies in two lines of jailbreak optimization strategies: genetic algorithm (GA)-based attacks and adversarial-generation-based attacks, respectively. We then introduce an ensemble jailbreak attack to exploit these dependencies. \texttt{AutoDefense} offers a mixture-of-defenders approach by leveraging the dependency relationships in pre-generative and post-generative defense strategies. \texttt{AutoEvaluation} introduces a novel evaluation method that distinguishes hallucinations, which are often overlooked, from jailbreak attack and defense responses. Through extensive experiments, we demonstrate that the proposed ensemble jailbreak attack and defense framework significantly outperforms existing research.


title: Increasing the detectability of long-period and nulling pulsars in next-generation pulsar surveys

abstract: Recent discoveries of multiple long-period pulsars (periods ${\sim}10\,$s or larger) are starting to challenge the conventional notion that coherent radio emission cannot be produced by objects that are below the many theorised death lines. Many of the past pulsar surveys and software have been prone to selection effects that restricted their sensitivities towards long-period and sporadically-emitting objects. Pulsar surveys using new-generation low-frequency facilities are starting to employ longer dwell times, which makes them significantly more sensitive in detecting long-period or nulling pulsars. There have also been software advancements to aid more sensitive searches towards long-period objects. Furthermore, recent discoveries suggest that nulling may be a key aspect of the long-period pulsar population. We simulate both long-period and nulling pulsar signals, using the Southern-sky MWA Rapid Two-meter (SMART) survey data as reference, and explore the detection efficacy of popular search methods such as the fast Fourier transform (FFT), fast-folding algorithm (FFA) and single pulse search (SPS). For FFT-based search and SPS, we make use of the PRESTO implementation, and for FFA we use RIPTIDE. We find RIPTIDE's FFA to be more sensitive; however, it is also the slowest algorithm. PRESTO's FFT, although faster than others, also shows some unexpected inaccuracies in detection properties. SPS is highly sensitive to long-period and nulling signals, but only for pulses with high intrinsic signal-to-noise ratios. We use these findings to inform current and future pulsar surveys that aim to uncover a large population of long-period or nulling objects and comment on how to make optimal use of these methods in unison.


title: Tool-Planner: Dynamic Solution Tree Planning for Large Language Model with Tool Clustering

abstract: Large language models (LLMs) have demonstrated exceptional reasoning capabilities, enabling them to solve various complex problems. Recently, this ability has been applied to the paradigm of tool learning. Tool learning involves providing examples of tool usage and their corresponding functions, allowing LLMs to formulate plans and demonstrate the process of invoking and executing each tool. LLMs can address tasks that they cannot complete independently, thereby enhancing their potential across different tasks. However, this approach faces two key challenges. First, redundant error correction leads to unstable planning and long execution time. Additionally, designing a correct plan among multiple tools is also a challenge in tool learning. To address these issues, we propose Tool-Planner, a task-processing framework based on toolkits. Tool-Planner groups tools based on the API functions with the same function into a toolkit and allows LLMs to implement planning across the various toolkits. When a tool error occurs, the language model can reselect and adjust tools based on the toolkit. Experiments show that our approach demonstrates a high pass and win rate across different datasets and optimizes the planning scheme for tool learning in models such as GPT-4 and Claude 3, showcasing the potential of our method.


abstract: Photovoltaic (PV) power forecasting plays a crucial role in optimizing the operation and planning of PV systems, thereby enabling efficient energy management and grid integration. However, un certainties caused by fluctuating weather conditions and complex interactions between different variables pose significant challenges to accurate PV power forecasting. In this study, we propose PV-Client (Cross-variable Linear Integrated ENhanced Transformer for Photovoltaic power forecasting) to address these challenges and enhance PV power forecasting accuracy. PV-Client employs an ENhanced Transformer module to capture complex interactions of various features in PV systems, and utilizes a linear module to learn trend information in PV power. Diverging from conventional time series-based Transformer models that use cross-time Attention to learn dependencies between different time steps, the Enhanced Transformer module integrates cross-variable Attention to capture dependencies between PV power and weather factors. Furthermore, PV-Client streamlines the embedding and position encoding layers by replacing the Decoder module with a projection layer. Experimental results on three real-world PV power datasets affirm PV-Client's state-of-the-art (SOTA) performance in PV power forecasting. Specifically, PV-Client surpasses the second-best model GRU by 5.3% in MSE metrics and 0.9% in accuracy metrics at the Jingang Station. Similarly, PV-Client outperforms the second-best model SVR by 10.1% in MSE metrics and 0.2% in accuracy metrics at the Xinqingnian Station, and PV-Client exhibits superior performance compared to the second-best model SVR with enhancements of 3.4% in MSE metrics and 0.9% in accuracy metrics at the Hongxing Station.


title: Time delay of fast radio burst population with respect to the star formation history

abstract: In spite of significant progress in the research of fast radio bursts (FRBs) in recent decade, their origin is still under extensive debate. Investigation on the population of FRBs can provide new insight into this interesting problem. In this paper, based on the first CHIME/FRB catalog, we construct a Bayesian framework to analyze the FRB population, with the selection effect of the CHIME telescope being properly taken into account. The energy function is modeled as the power-law with an exponential cutoff. Four redshift distribution models are considered, i.e., the star formation history (SFH) model, and three time-delayed models (Gaussian delay, log-normal delay, and power-law delay). The free parameters are simultaneously constrained using Bayesian inference method, and the Bayesian information criterion (BIC) is used in model comparison. According to BIC, the log-normal delay model fits the data best. The power-law delay model and Gaussian delay model can also give reasonable fits, although they are not as good as the log-normal delay model. However, the SFH model is strongly disfavored compared with the three time-delayed models. The energy function is tightly constrained and is almost independent of the redshift models, with the best-fitting power-law index $\alpha\approx 1.8$, and cut-off energy $\log(E_c/{\rm erg})\approx 42$. The FRB population shows on average $3\sim 5$ billion years time delay with respect to the SFH. Therefore, the hypothesis that the FRB population traces the SFH is conclusively ruled out.


title: Spherinator and HiPSter: Representation Learning for Unbiased Knowledge Discovery from Simulations

abstract: Simulations are the best approximation to experimental laboratories in astrophysics and cosmology. However, the complexity, richness, and large size of their outputs severely limit the interpretability of their predictions. We describe a new, unbiased, and machine learning based approach to obtaining useful scientific insights from a broad range of simulations. The method can be used on today's largest simulations and will be essential to solve the extreme data exploration and analysis challenges posed by the Exascale era. Furthermore, this concept is so flexible, that it will also enable explorative access to observed data. Our concept is based on applying nonlinear dimensionality reduction to learn compact representations of the data in a low-dimensional space. The simulation data is projected onto this space for interactive inspection, visual interpretation, sample selection, and local analysis. We present a prototype using a rotational invariant hyperspherical variational convolutional autoencoder, utilizing a power distribution in the latent space, and trained on galaxies from IllustrisTNG simulation. Thereby, we obtain a natural Hubble tuning fork like similarity space that can be visualized interactively on the surface of a sphere by exploiting the power of HiPS tilings in Aladin Lite.


title: Effects of Kitaev Interaction on Magnetic Orders and Anisotropy

abstract: We systematically investigate the effects of Kitaev interaction on magnetic orders and anisotropy in both triangular and honeycomb lattices. Our study highlights the critical role of the Kitaev interaction in modulating phase boundaries and predicting new phases, e.g., zigzag phase in triangular lattice and AABB phase in honeycomb lattice, which are absent with pure Heisenberg interactions. Moreover, we reveal the special state-dependent anisotropy of Kitaev interaction, and develop a general method that can determine the presence of Kitaev interaction in different magnets. It is found that the Kitaev interaction does not induce anisotropy in some magnetic orders such as ferromagnetic order, while can cause different anisotropy in other magnetic orders. Furthermore, we emphasize that the off-diagonal $\Gamma$ interaction also contributes to anisotropy, competing with the Kitaev interaction to reorient spin arrangements. Our work establishes a framework for comprehensive understanding the impact of Kitaev interaction on ordered magnetism.


title: How to Scale Inverse RL to Large State Spaces? A Provably Efficient Approach

abstract: In online Inverse Reinforcement Learning (IRL), the learner can collect samples about the dynamics of the environment to improve its estimate of the reward function. Since IRL suffers from identifiability issues, many theoretical works on online IRL focus on estimating the entire set of rewards that explain the demonstrations, named the feasible reward set. However, none of the algorithms available in the literature can scale to problems with large state spaces. In this paper, we focus on the online IRL problem in Linear Markov Decision Processes (MDPs). We show that the structure offered by Linear MDPs is not sufficient for efficiently estimating the feasible set when the state space is large. As a consequence, we introduce the novel framework of rewards compatibility, which generalizes the notion of feasible set, and we develop CATY-IRL, a sample efficient algorithm whose complexity is independent of the cardinality of the state space in Linear MDPs. When restricted to the tabular setting, we demonstrate that CATY-IRL is minimax optimal up to logarithmic factors. As a by-product, we show that Reward-Free Exploration (RFE) enjoys the same worst-case rate, improving over the state-of-the-art lower bound. Finally, we devise a unifying framework for IRL and RFE that may be of independent interest.


title: Touch100k: A Large-Scale Touch-Language-Vision Dataset for Touch-Centric Multimodal Representation

abstract: Touch holds a pivotal position in enhancing the perceptual and interactive capabilities of both humans and robots. Despite its significance, current tactile research mainly focuses on visual and tactile modalities, overlooking the language domain. Inspired by this, we construct Touch100k, a paired touch-language-vision dataset at the scale of 100k, featuring tactile sensation descriptions in multiple granularities (i.e., sentence-level natural expressions with rich semantics, including contextual and dynamic relationships, and phrase-level descriptions capturing the key features of tactile sensations). Based on the dataset, we propose a pre-training method, Touch-Language-Vision Representation Learning through Curriculum Linking (TLV-Link, for short), inspired by the concept of curriculum learning. TLV-Link aims to learn a tactile representation for the GelSight sensor and capture the relationship between tactile, language, and visual modalities. We evaluate our representation's performance across two task categories (namely, material property identification and robot grasping prediction), focusing on tactile representation and zero-shot touch understanding. The experimental evaluation showcases the effectiveness of our representation. By enabling TLV-Link to achieve substantial improvements and establish a new state-of-the-art in touch-centric multimodal representation learning, Touch100k demonstrates its value as a valuable resource for research. Project page: https://cocacola-lab.github.io/Touch100k/.


title: Improving Zero-Shot Chinese-English Code-Switching ASR with kNN-CTC and Gated Monolingual Datastores

abstract: The kNN-CTC model has proven to be effective for monolingual automatic speech recognition (ASR). However, its direct application to multilingual scenarios like code-switching, presents challenges. Although there is potential for performance improvement, a kNN-CTC model utilizing a single bilingual datastore can inadvertently introduce undesirable noise from the alternative language. To address this, we propose a novel kNN-CTC-based code-switching ASR (CS-ASR) framework that employs dual monolingual datastores and a gated datastore selection mechanism to reduce noise interference. Our method selects the appropriate datastore for decoding each frame, ensuring the injection of language-specific information into the ASR process. We apply this framework to cutting-edge CTC-based models, developing an advanced CS-ASR system. Extensive experiments demonstrate the remarkable effectiveness of our gated datastore mechanism in enhancing the performance of zero-shot Chinese-English CS-ASR.


title: Triton and Pluto: same origin but separated at birth

abstract: Assessing the origin of Pluto and Triton has profound implications for the bigger picture of Solar System formation and evolution. In such a context, this chapter reviews our current knowledge of the formation conditions of Pluto and Triton's constitutive building blocks in the protosolar nebula, which can be derived from their known or estimated volatile contents. Assuming that the ultravolatiles carbon monoxide and dinitrogen detected in Pluto and Triton are primordial, the presence of these molecules suggest that the two bodies accreted material originating from the vicinity of the carbon monoxide and dinitrogen icelines. Dinitrogen--rich and water--poor comets such as comet C/2016 R2 (PanSTARRS) obviously present a compositional link with Pluto and Triton, indicating that their building blocks formed in nearby regions of the protosolar nebula, despite of the variation of the water abundance among those bodies. Also, the assumption of Triton's growth in Neptune's circumplanetary disk requires that its building blocks formed at earlier epochs in the protosolar nebula, to remain consistent with its estimated composition.