title: On Earth's habitability over the Sun's main-sequence history: joint influence of space weather and Earth's magnetic field evolution

abstract: The aim of this study is to analyze the Earth habitability with respect to the direct exposition of the Earth atmosphere to the solar wind along the Suns evolution on the main sequence including the realistic evolution of the space weather conditions and the Earth magnetic field. The MHD code PLUTO in spherical coordinates is applied to perform parametric studies with respect to the solar wind dynamic pressure and the interplanetary magnetic field intensity for different Earth magnetic field configurations. Quiet space weather conditions may not impact the Earth habitability. On the other hand, the impact of interplanetary coronal mass ejections (ICME) could lead to the erosion of the primary Earth atmosphere during the Hadean eon. A dipolar field of 30 microT is strong enough to shield the Earth from the Eo-Archean age as well as 15 and 5 microT dipolar fields from the Meso-Archean and Meso-Proterozoic, respectively. Multipolar weak field period during the Meso-Proterozoic age may not be a threat for ICME-like space weather conditions if the field intensity is at least 15 microT and the ratio between the quadrupolar (Q) and dipolar (D) coefficients is Q/D <= 0.5. By contrast, the Earth habitability in the Phanerozoic eon (including the present time) can be hampered during multipolar low field periods with a strength of 5 microT and Q/D >= 0.5 associated to geomagnetic reversals. Consequently, the effect of the solar wind should be considered as a possible driver of Earth's habitability.


title: ClimateSet: A Large-Scale Climate Model Dataset for Machine Learning

abstract: Climate models have been key for assessing the impact of climate change and simulating future climate scenarios. The machine learning (ML) community has taken an increased interest in supporting climate scientists' efforts on various tasks such as climate model emulation, downscaling, and prediction tasks. Many of those tasks have been addressed on datasets created with single climate models. However, both the climate science and ML communities have suggested that to address those tasks at scale, we need large, consistent, and ML-ready climate model datasets. Here, we introduce ClimateSet, a dataset containing the inputs and outputs of 36 climate models from the Input4MIPs and CMIP6 archives. In addition, we provide a modular dataset pipeline for retrieving and preprocessing additional climate models and scenarios. We showcase the potential of our dataset by using it as a benchmark for ML-based climate model emulation. We gain new insights about the performance and generalization capabilities of the different ML models by analyzing their performance across different climate models. Furthermore, the dataset can be used to train an ML emulator on several climate models instead of just one. Such a "super emulator" can quickly project new climate change scenarios, complementing existing scenarios already provided to policymakers. We believe ClimateSet will create the basis needed for the ML community to tackle climate-related tasks at scale.


title: Inertial Guided Uncertainty Estimation of Feature Correspondence in Visual-Inertial Odometry/SLAM

abstract: Visual odometry and Simultaneous Localization And Mapping (SLAM) has been studied as one of the most important tasks in the areas of computer vision and robotics, to contribute to autonomous navigation and augmented reality systems. In case of feature-based odometry/SLAM, a moving visual sensor observes a set of 3D points from different viewpoints, correspondences between the projected 2D points in each image are usually established by feature tracking and matching. However, since the corresponding point could be erroneous and noisy, reliable uncertainty estimation can improve the accuracy of odometry/SLAM methods. In addition, inertial measurement unit is utilized to aid the visual sensor in terms of Visual-Inertial fusion. In this paper, we propose a method to estimate the uncertainty of feature correspondence using an inertial guidance robust to image degradation caused by motion blur, illumination change and occlusion. Modeling a guidance distribution to sample possible correspondence, we fit the distribution to an energy function based on image error, yielding more robust uncertainty than conventional methods. We also demonstrate the feasibility of our approach by incorporating it into one of recent visual-inertial odometry/SLAM algorithms for public datasets.


title: Generalized Hybrid Search and Applications to Blockchain and Hash Function Security

abstract: In this work we first examine the hardness of solving various search problems by hybrid quantum-classical strategies, namely, by algorithms that have both quantum and classical capabilities. We then construct a hybrid quantum-classical search algorithm and analyze its success probability. Regarding the former, for search problems that are allowed to have multiple solutions and in which the input is sampled according to arbitrary distributions we establish their hybrid quantum-classical query complexities -- i.e., given a fixed number of classical and quantum queries, determine what is the probability of solving the search task. At a technical level, our results generalize the framework for hybrid quantum-classical search algorithms proposed by Rosmanis. Namely, for an arbitrary distribution $D$ on Boolean functions, the probability an algorithm equipped with $\tau_c$ classical and $\tau_q$ quantum queries succeeds in finding a preimage of $1$ for a function sampled from $D$ is at most $\nu_D \cdot(2\sqrt{\tau_c} + 2\tau_q + 1)^2$, where $\nu_D$ captures the average (over $D$) fraction of preimages of $1$. As applications of our hardness results, we first revisit and generalize the security of the Bitcoin protocol called the Bitcoin backbone, to a setting where the adversary has both quantum and classical capabilities, presenting a new hybrid honest majority condition necessary for the protocol to properly operate. Secondly, we examine the generic security of hash functions against hybrid adversaries. Regarding our second contribution, we design a hybrid algorithm which first spends all of its classical queries and in the second stage runs a ``modified Grover'' where the initial state depends on the distribution $D$. We show how to analyze its success probability for arbitrary target distributions and, importantly, its optimality for the uniform and the Bernoulli distribution cases.


title: On convergence analysis of feedback control with integral action and discontinuous relay perturbation

abstract: We consider third-order dynamic systems which have integral feedback action and discontinuous relay disturbance. More specifically for applications, our focus is on the integral plus state-feedback control of motion systems with the discontinuous Coulomb-type friction. We resume the attractive stiction region, where the hybrid system has also solutions in Filippov sense, while the motion trajectories remain in an idle state (that we call `stiction') until the sliding-mode condition becomes violated through the integral action. We analyze the conditions for occurrence of the slowly converging stick-slip cycles. We also show that the hybrid system is globally but only asymptotically and almost always not exponentially stable. A particular case of exponential convergence can appear for some initial values, assuming the characteristic equation of the linear subsystem has only the real roots. Illustrative numerical examples are provided alongside with the developed analysis.


title: DeepInspect: An AI-Powered Defect Detection for Manufacturing Industries

abstract: Utilizing Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and Generative Adversarial Networks (GANs), our system introduces an innovative approach to defect detection in manufacturing. This technology excels in precisely identifying faults by extracting intricate details from product photographs, utilizing RNNs to detect evolving errors and generating synthetic defect data to bolster the model's robustness and adaptability across various defect scenarios. The project leverages a deep learning framework to automate real-time flaw detection in the manufacturing process. It harnesses extensive datasets of annotated images to discern complex defect patterns. This integrated system seamlessly fits into production workflows, thereby boosting efficiency and elevating product quality. As a result, it reduces waste and operational costs, ultimately enhancing market competitiveness.


title: Carrier screening controls transport in conjugated polymers at high doping concentrations

abstract: Transport properties of doped conjugated polymers (CPs) have been widely analyzed with the Gaussian Disorder Model (GDM) in conjunction with hopping transport between localized states. These models reveal that even in highly doped CPs, a majority of carriers are still localized because dielectric permittivity of CPs is well below that of inorganic materials, making Coulomb interactions between carriers and dopant counter-ions much more pronounced. However, previous studies within the GDM did not consider the role of screening the dielectric interactions by carriers. Here we implement carrier screening in the Debye-H\"uckel formalism in our calculations of dopant-induced energetic disorder, which modifies the Gaussian density of states (DOS). Then we solve the Pauli Master Equation using Miller-Abrahams hopping rates with states from the resulting screened DOS to obtain conductivity and Seebeck coefficient across a broad range of carrier concentrations and compare them to measurements. Our results show that screening has significant impact on the shape of the DOS and consequently on carrier transport, particularly at high doping. We prove that the slope of Seebeck coefficient vs electric conductivity, which was previously thought to be universal, is impacted by screening and decreases for systems with small dopant-carrier separation, explaining our measurements. We also show that thermoelectric power factor is underestimated by a factor of $\sim10$ at higher doping concentrations if screening is neglected. We conclude that carrier screening plays a crucial role in curtailing dopant-induced energetic disorder, particularly at high carrier concentrations.


title: Floquet second-order topological Anderson insulator hosting corner localized modes

abstract: The presence of random disorder in a metallic system accounts for the localization of extended states in general. On the contrary, the presence of disorder can induce topological phases hosting metallic boundary states out of a non-topological system, giving birth to the topological Anderson insulator phase. In this context, we theoretically investigate the generation of an out of equilibrium higher-order topological Anderson phase in the presence of disorder potential in a time-periodic dynamical background. In particular, the time-dependent drive and the disorder potential concomitantly render the generation of Floquet higher-order topological Anderson insulator~(FHOTAI) phase, while the clean, undriven system is topologically trivial. We showcase the generation of FHOTAI hosting both $0$- and $\pi$-modes. Most importantly, we develop the real space topological invariant -- a winding number based on chiral symmetry to characterize the Floquet $0$ -- and $\pi$-modes distinctly. This chiral winding number serves the purpose of the indicator for the topological phase transition in the presence of drive as well as disorder and appropriately characterizes the FHOTAI.


title: Stable manifolds for periodically perturbed maps

abstract: We prove that if a certain entry in the map of the Hadamard-Perron theorem is $T$-periodic in one of the variables, then the stable manifold guaranteed by the Hadamard-Perron theorem is a graph of a $T$-periodic function. As an application, we extend the classical Levinson's result about the occurrence of an attracting closed invariant curve near a stable cycle of a system of autonomous equations under periodic perturbations to hybrid differential equations.


title: Effect of the neutral beam injector operational regime on the Alfven eigenmode saturation phase in DIII-D plasma

abstract: The aim of this study is to analyze the effect of the neutral beam injector (NBI) operation regime on the saturation phase of the Alfven Eigenmodes (AEs) in DIII-D plasma. The analysis is done using the linear and nonlinear versions of the gyro-fluid code FAR3d. A set of parametric analyses are performed modifying the nonlinear simulation EP \b{eta} (NBI injection power), EP energy (NBI voltage) and the radial location of the EP density profile gradient (NBI radial deposition). The analysis indicates a transition from the soft (local plasma relaxation) to the hard MHD (global plasma relaxation) limit if the simulation EP \b{eta} >= 0.02, leading to bursting MHD activity caused by radial AEs overlapping. MHD bursts cause an enhancement of the EP transport showing ballistic-like features as avalanche-like events. Simulations in the soft MHD limit show an increment of the EP density gradient as the EP \b{eta} increases. On the other hand, there is a gradient upper limit in the hard MHD limit, consistent with the critical-gradient behavior. AEs induce shear flows and zonal current leading to the deformation of the flux surfaces and the safety factor profile, respectively, particularly strong for the simulation in the hard MHD limit. Simulations in the hard MHD regime show a decrease of the AE frequency in the saturation phase; this is caused by the destabilization of a transitional mode between a 9/3-10/3 TAE and a 9/3 RSAE that may explain the AE frequency down-sweeping observed in some DIII-D discharges. Reducing the EP energy in the nonlinear simulations leads to a weakening of the plasma perturbation. On the other hand, increasing the EP energy causes the opposite effect. Nonlinear simulations of off-axis NBI profiles indicate a lower plasma perturbation as the EP density gradient is located further away from the magnetic axis.


title: Graphs and groups with unique geodesics

abstract: A connected graph is called \emph{geodetic} if there is a unique geodesic between each pair of vertices. In this paper we prove that if a finitely generated group admits a Cayley graph which is geodetic, then the group must be virtually free. Before now, it was open whether finitely generated and geodetic implied hyperbolic. In fact we prove something more general: if a quasi-transitive locally finite connected undirected graph is geodetic then it is quasi-isometric to a tree. Our main tool is to define a \emph{boundary} of a graph and understand how the local behaviour influences it when the graph is geodetic. Our results unify, and represent significant progress on, research initiated by Ore, Shapiro, and Madlener and Otto.


title: A Survey of Large Language Models Attribution

abstract: Open-domain generative systems have gained significant attention in the field of conversational AI (e.g., generative search engines). This paper presents a comprehensive review of the attribution mechanisms employed by these systems, particularly large language models. Though attribution or citation improve the factuality and verifiability, issues like ambiguous knowledge reservoirs, inherent biases, and the drawbacks of excessive attribution can hinder the effectiveness of these systems. The aim of this survey is to provide valuable insights for researchers, aiding in the refinement of attribution methodologies to enhance the reliability and veracity of responses generated by open-domain generative systems. We believe that this field is still in its early stages; hence, we maintain a repository to keep track of ongoing studies at https://github.com/HITsz-TMG/awesome-llm-attributions.


title: Learning to Learn for Few-shot Continual Active Learning

abstract: Continual learning strives to ensure stability in solving previously seen tasks while demonstrating plasticity in a novel domain. Recent advances in continual learning are mostly confined to a supervised learning setting, especially in NLP domain. In this work, we consider a few-shot continual active learning setting where labeled data are inadequate, and unlabeled data are abundant but with a limited annotation budget. We exploit meta-learning and propose a method, called Meta-Continual Active Learning. This method sequentially queries the most informative examples from a pool of unlabeled data for annotation to enhance task-specific performance and tackle continual learning problems through meta-objective. Specifically, we employ meta-learning and experience replay to address inter-task confusion and catastrophic forgetting. We further incorporate textual augmentations to avoid memory over-fitting caused by experience replay and sample queries, thereby ensuring generalization. We conduct extensive experiments on benchmark text classification datasets from diverse domains to validate the feasibility and effectiveness of meta-continual active learning. We also analyze the impact of different active learning strategies on various meta continual learning models. The experimental results demonstrate that introducing randomness into sample selection is the best default strategy for maintaining generalization in meta-continual learning framework.


title: Improved weight initialization for deep and narrow feedforward neural network

abstract: Appropriate weight initialization settings, along with the ReLU activation function, have become cornerstones of modern deep learning, enabling the training and deployment of highly effective and efficient neural network models across diverse areas of artificial intelligence. The problem of \textquotedblleft dying ReLU," where ReLU neurons become inactive and yield zero output, presents a significant challenge in the training of deep neural networks with ReLU activation function. Theoretical research and various methods have been introduced to address the problem. However, even with these methods and research, training remains challenging for extremely deep and narrow feedforward networks with ReLU activation function. In this paper, we propose a novel weight initialization method to address this issue. We establish several properties of our initial weight matrix and demonstrate how these properties enable the effective propagation of signal vectors. Through a series of experiments and comparisons with existing methods, we demonstrate the effectiveness of the novel initialization method.


title: Leveraging Structured Information for Explainable Multi-hop Question Answering and Reasoning

abstract: Neural models, including large language models (LLMs), achieve superior performance on multi-hop question-answering. To elicit reasoning capabilities from LLMs, recent works propose using the chain-of-thought (CoT) mechanism to generate both the reasoning chain and the answer, which enhances the model's capabilities in conducting multi-hop reasoning. However, several challenges still remain: such as struggling with inaccurate reasoning, hallucinations, and lack of interpretability. On the other hand, information extraction (IE) identifies entities, relations, and events grounded to the text. The extracted structured information can be easily interpreted by humans and machines (Grishman, 2019). In this work, we investigate constructing and leveraging extracted semantic structures (graphs) for multi-hop question answering, especially the reasoning process. Empirical results and human evaluations show that our framework: generates more faithful reasoning chains and substantially improves the QA performance on two benchmark datasets. Moreover, the extracted structures themselves naturally provide grounded explanations that are preferred by humans, as compared to the generated reasoning chains and saliency-based explanations.


title: Semi-Dirac Fermions in a Topological Metal

abstract: Topological semimetals with massless Dirac and Weyl fermions represent the forefront of quantum materials research. In two dimensions, a peculiar class of fermions that are massless in one direction and massive in the perpendicular direction was predicted fifteen years ago. These highly exotic quasiparticles - the semi-Dirac fermions - ignited intense theoretical interest but remain undetected. Using magneto-optical spectroscopy, we demonstrate the defining feature of semi-Dirac fermions - B^(2/3) scaling of Landau levels - in a prototypical nodal-line metal ZrSiS. In topological metals, including ZrSiS, nodal-lines extend the band degeneracies from isolated points to lines, loops or even chains in the momentum space. With ab initio calculations and theoretical modeling, we pinpoint the observed semi-Dirac spectrum to the crossing points of nodal-lines in ZrSiS. Crossing nodal-lines exhibit a continuum absorption spectrum but with singularities that scale as B^(2/3) at the crossing. Our work sheds light on the hidden quasiparticles emerging from the intricate topology of crossing nodal-lines.


title: Neural MMO 2.0: A Massively Multi-task Addition to Massively Multi-agent Learning

abstract: Neural MMO 2.0 is a massively multi-agent environment for reinforcement learning research. The key feature of this new version is a flexible task system that allows users to define a broad range of objectives and reward signals. We challenge researchers to train agents capable of generalizing to tasks, maps, and opponents never seen during training. Neural MMO features procedurally generated maps with 128 agents in the standard setting and support for up to. Version 2.0 is a complete rewrite of its predecessor with three-fold improved performance and compatibility with CleanRL. We release the platform as free and open-source software with comprehensive documentation available at neuralmmo.github.io and an active community Discord. To spark initial research on this new platform, we are concurrently running a competition at NeurIPS 2023.


title: Lagrangian Modelling and Motion Stability of Synchronous Generator Power Systems

abstract: This paper proposes to analyze the motion stability of synchro-nous generator power systems using a Lagrangian model derived in the configuration space of generalized position and speed. In the first place, a Lagrangian model of synchronous generators is derived based on Lagrangian mechanics. The generalized potential energy of inductors and generalized kinetic energy of capacitors are defined. The mechanical and electrical dynamics can be modelled in a unified manner through constructing a Lagrangian function. Taking the first benchmark model of subsynchronous oscillation as an example, a Lagragian model is construct-ed and numerical solution of the model is obtained to validate the accuracy and effectiveness of the model. Compared with the traditional EMTP model in PSCAD, the obtained Lagrangian model is able to accurately describe the electromagnetic transient process of the system. Moreover, the Lagrangian model is analytical, which enables to analyze the motion stability of the system using Lyapunov motion stability theory. The Lagrangian model can not only be used to discuss the power angle stability, but also used for analyzing the stability of node voltages and frequency. It provides the feasibility for studying the unified stability of power systems.


title: deep-REMAP: Parameterization of Stellar Spectra Using Regularized Multi-Task Learning

abstract: Traditional spectral analysis methods are increasingly challenged by the exploding volumes of data produced by contemporary astronomical surveys. In response, we develop deep-Regularized Ensemble-based Multi-task Learning with Asymmetric Loss for Probabilistic Inference ($\rm{deep-REMAP}$), a novel framework that utilizes the rich synthetic spectra from the PHOENIX library and observational data from the MARVELS survey to accurately predict stellar atmospheric parameters. By harnessing advanced machine learning techniques, including multi-task learning and an innovative asymmetric loss function, $\rm{deep-REMAP}$ demonstrates superior predictive capabilities in determining effective temperature, surface gravity, and metallicity from observed spectra. Our results reveal the framework's effectiveness in extending to other stellar libraries and properties, paving the way for more sophisticated and automated techniques in stellar characterization.

categories: astro-ph.SR astro-ph.GA astro-ph.IM cs.AI


title: Leveraging Large Language Models for Automated Proof Synthesis in Rust

abstract: Formal verification can provably guarantee the correctness of critical system software, but the high proof burden has long hindered its wide adoption. Recently, Large Language Models (LLMs) have shown success in code analysis and synthesis. In this paper, we present a combination of LLMs and static analysis to synthesize invariants, assertions, and other proof structures for a Rust-based formal verification framework called Verus. In a few-shot setting, LLMs demonstrate impressive logical ability in generating postconditions and loop invariants, especially when analyzing short code snippets. However, LLMs lack the ability to retain and propagate context information, a strength of traditional static analysis. Based on these observations, we developed a prototype based on OpenAI's GPT-4 model. Our prototype decomposes the verification task into multiple smaller ones, iteratively queries GPT-4, and combines its output with lightweight static analysis. We evaluated the prototype with a developer in the automation loop on 20 vector-manipulating programs. The results demonstrate that it significantly reduces human effort in writing entry-level proof code.


title: Reductions of semi-stable representations using the Iwahori mod $p$ Local Langlands Correspondence

abstract: We determine the mod $p$ reductions of all two-dimensional semi-stable representations $V_{k,\mathcal{L}}$ of the Galois group of $\mathbb{Q}_p$ of weights $3 \leq k \leq p+1$ and $\mathcal{L}$-invariants $\mathcal{L}$ for primes $p \geq 5$. In particular, we describe the constants appearing in the unramified characters completely. The proof involves computing the reduction of Breuil's $\mathrm{GL}_2(\mathbb{Q}_p)$-Banach space $\tilde{B}(k,\mathcal{L})$, by studying certain logarithmic functions using background material developed by Colmez, and then applying an Iwahori theoretic version of the mod $p$ Local Langlands Correspondence.


title: Beyond Traditional Beamforming: Singular Vector Projection Techniques for MU-MIMO Interference Management

abstract: This paper introduces low-complexity beamforming algorithms for multi-user multiple-input multiple-output (MU-MIMO) systems to minimize inter-user interference and enhance spectral efficiency (SE). A Singular-Vector Beamspace Search (SVBS) algorithm is initially presented, wherein all the singular vectors are assessed to determine the most effective beamforming scheme. We then establish a mathematical proof demonstrating that the total inter-user interference of a MU-MIMO beamforming system can be efficiently calculated from the mutual projections of orthonormal singular vectors. Capitalizing on this, we present an Interference-optimized Singular Vector Beamforming (IOSVB) algorithm for optimal singular vector selection. For further reducing the computational burden, we propose a Dimensionality-reduced IOSVB (DR-IOSVB) algorithm by integrating the principal component analysis (PCA). The numerical results demonstrate the superiority of the SVBS algorithm over the existing algorithms, with the IOSVB offering near-identical SE and the DR-IOSVB balancing the performance and computational efficiency. This work establishes a new benchmark for high-performance and low-complexity beamforming in MU-MIMO wireless communication systems.


title: 3DifFusionDet: Diffusion Model for 3D Object Detection with Robust LiDAR-Camera Fusion

abstract: Good 3D object detection performance from LiDAR-Camera sensors demands seamless feature alignment and fusion strategies. We propose the 3DifFusionDet framework in this paper, which structures 3D object detection as a denoising diffusion process from noisy 3D boxes to target boxes. In this framework, ground truth boxes diffuse in a random distribution for training, and the model learns to reverse the noising process. During inference, the model gradually refines a set of boxes that were generated at random to the outcomes. Under the feature align strategy, the progressive refinement method could make a significant contribution to robust LiDAR-Camera fusion. The iterative refinement process could also demonstrate great adaptability by applying the framework to various detecting circumstances where varying levels of accuracy and speed are required. Extensive experiments on KITTI, a benchmark for real-world traffic object identification, revealed that 3DifFusionDet is able to perform favorably in comparison to earlier, well-respected detectors.


title: A general framework for the analytic Langlands correspondence

abstract: We discuss a general framework for the analytic Langlands correspondence over an arbitrary local field F introduced and studied in our works arXiv:1908.09677, arXiv:2103.01509 and arXiv:2106.05243, in particular including non-split and twisted settings. Then we specialize to the archimedean cases (F=C and F=R) and give a (mostly conjectural) description of the spectrum of the Hecke operators in various cases in terms of opers satisfying suitable reality conditions, as predicted in part in arXiv:2103.01509, arXiv:2106.05243 and arXiv:2107.01732. We also describe an analogue of the Langlands functoriality principle in the analytic Langlands correspondence over C and show that it is compatible with the results and conjectures of arXiv:2103.01509. Finally, we apply the tools of the analytic Langlands correspondence over archimedean fields in genus zero to the Gaudin model and its generalizations, as well as their q-deformations.


title: Einstein metrics on conformal products

abstract: We show that under some natural geometric assumption, Einstein metrics on conformal products of two compact conformal manifolds are warped product metrics.


title: Unsupervised Video Summarization

abstract: This paper introduces a new, unsupervised method for automatic video summarization using ideas from generative adversarial networks but eliminating the discriminator, having a simple loss function, and separating training of different parts of the model. An iterative training strategy is also applied by alternately training the reconstructor and the frame selector for multiple iterations. Furthermore, a trainable mask vector is added to the model in summary generation during training and evaluation. The method also includes an unsupervised model selection algorithm. Results from experiments on two public datasets (SumMe and TVSum) and four datasets we created (Soccer, LoL, MLB, and ShortMLB) demonstrate the effectiveness of each component on the model performance, particularly the iterative training strategy. Evaluations and comparisons with the state-of-the-art methods highlight the advantages of the proposed method in performance, stability, and training efficiency.


title: Enhanced physics-informed neural networks with domain scaling and residual correction methods for multi-frequency elliptic problems

abstract: In this paper, neural network approximation methods are developed for elliptic partial differential equations with multi-frequency solutions. Neural network work approximation methods have advantages over classical approaches in that they can be applied without much concerns on the form of the differential equations or the shape or dimension of the problem domain. When applied to problems with multi-frequency solutions, the performance and accuracy of neural network approximation methods are strongly affected by the contrast of the high- and low-frequency parts in the solutions. To address this issue, domain scaling and residual correction methods are proposed. The efficiency and accuracy of the proposed methods are demonstrated for multi-frequency model problems.


title: SBCFormer: Lightweight Network Capable of Full-size ImageNet Classification at 1 FPS on Single Board Computers

abstract: Computer vision has become increasingly prevalent in solving real-world problems across diverse domains, including smart agriculture, fishery, and livestock management. These applications may not require processing many image frames per second, leading practitioners to use single board computers (SBCs). Although many lightweight networks have been developed for mobile/edge devices, they primarily target smartphones with more powerful processors and not SBCs with the low-end CPUs. This paper introduces a CNN-ViT hybrid network called SBCFormer, which achieves high accuracy and fast computation on such low-end CPUs. The hardware constraints of these CPUs make the Transformer's attention mechanism preferable to convolution. However, using attention on low-end CPUs presents a challenge: high-resolution internal feature maps demand excessive computational resources, but reducing their resolution results in the loss of local image details. SBCFormer introduces an architectural design to address this issue. As a result, SBCFormer achieves the highest trade-off between accuracy and speed on a Raspberry Pi 4 Model B with an ARM-Cortex A72 CPU. For the first time, it achieves an ImageNet-1K top-1 accuracy of around 80% at a speed of 1.0 frame/sec on the SBC. Code is available at https://github.com/xyongLu/SBCFormer.


title: Unified Low-Resource Sequence Labeling by Sample-Aware Dynamic Sparse Finetuning

abstract: Unified Sequence Labeling that articulates different sequence labeling problems such as Named Entity Recognition, Relation Extraction, Semantic Role Labeling, etc. in a generalized sequence-to-sequence format opens up the opportunity to make the maximum utilization of large language model knowledge toward structured prediction. Unfortunately, this requires formatting them into specialized augmented format unknown to the base pretrained language model (PLMs) necessitating finetuning to the target format. This significantly bounds its usefulness in data-limited settings where finetuning large models cannot properly generalize to the target format. To address this challenge and leverage PLM knowledge effectively, we propose FISH-DIP, a sample-aware dynamic sparse finetuning strategy that selectively focuses on a fraction of parameters, informed by feedback from highly regressing examples, during the fine-tuning process. By leveraging the dynamism of sparsity, our approach mitigates the impact of well-learned samples and prioritizes underperforming instances for improvement in generalization. Across five tasks of sequence labeling, we demonstrate that FISH-DIP can smoothly optimize the model in low resource settings offering upto 40% performance improvements over full fine-tuning depending on target evaluation settings. Also, compared to in-context learning and other parameter-efficient fine-tuning approaches, FISH-DIP performs comparably or better, notably in extreme low-resource settings.


title: Multiclass Segmentation using Teeth Attention Modules for Dental X-ray Images

abstract: This paper proposed a cutting-edge multiclass teeth segmentation architecture that integrates an M-Net-like structure with Swin Transformers and a novel component named Teeth Attention Block (TAB). Existing teeth image segmentation methods have issues with less accurate and unreliable segmentation outcomes due to the complex and varying morphology of teeth, although teeth segmentation in dental panoramic images is essential for dental disease diagnosis. We propose a novel teeth segmentation model incorporating an M-Net-like structure with Swin Transformers and TAB. The proposed TAB utilizes a unique attention mechanism that focuses specifically on the complex structures of teeth. The attention mechanism in TAB precisely highlights key elements of teeth features in panoramic images, resulting in more accurate segmentation outcomes. The proposed architecture effectively captures local and global contextual information, accurately defining each tooth and its surrounding structures. Furthermore, we employ a multiscale supervision strategy, which leverages the left and right legs of the U-Net structure, boosting the performance of the segmentation with enhanced feature representation. The squared Dice loss is utilized to tackle the class imbalance issue, ensuring accurate segmentation across all classes. The proposed method was validated on a panoramic teeth X-ray dataset, which was taken in a real-world dental diagnosis. The experimental results demonstrate the efficacy of our proposed architecture for tooth segmentation on multiple benchmark dental image datasets, outperforming existing state-of-the-art methods in objective metrics and visual examinations. This study has the potential to significantly enhance dental image analysis and contribute to advances in dental applications.


title: Control over cavity exciton polaritons in monolayer semiconductors

abstract: Integrating two-dimensional van der Waals materials with optical cavities has revealed a fascinating platform to study exciton-polariton physics. Manipulating exciton polaritons often requires external control over the electrical and optical properties of materials. Here we demonstrate the electrical control of 2D exciton polaritons by strongly coupling a transition metal dichalcogenides (TMD) heterostructure to a photonic crystal nanocavity. Through precise control of the doping level in the TMD monolayers using electrostatic gating, we demonstrate a wide range of tunability in the exciton oscillator strength and hence the exciton photon hybridization. This tunability leads to the demonstration of a continuous transition from weak to strong coupling regime, as manifested by the disappearance and emergence of exciton polaritons, showcasing the versatility of our approach. Our work paves the way to further exploring nonlinear and quantum exciton polaritons in 2D materials and their device applications.


title: Seismic traveltime simulation for variable velocity models using physics-informed Fourier neural operator

abstract: Seismic traveltime is critical information conveyed by seismic waves, widely utilized in various geophysical applications. Conventionally, the simulation of seismic traveltime involves solving the eikonal equation. However, the efficiency of traditional numerical solvers is hindered, as they are typically capable of simulating seismic traveltime for only a single source at a time. Recently, deep learning tools, particularly physics-informed neural networks (PINNs), have proven effective in simulating seismic traveltimes for multiple sources. Nonetheless, PINNs face challenges such as limited generalization capabilities across different models and difficulties in training convergence. To address these issues, we have developed a method for simulating multi-source seismic traveltimes in variable velocity models using a deep-learning technique, known as the physics-informed Fourier neural operator (PIFNO). The PIFNO-based method for seismic traveltime generation takes both velocity and background traveltime as inputs, generating the perturbation traveltime as the output. This method incorporates a factorized eikonal equation as the loss function and relies solely on physical laws, eliminating the need for labeled training data. We demonstrate that our proposed method is not only effective in calculating seismic traveltimes for velocity models used during training but also shows promising prediction capabilities for test velocity models. We validate these features using velocity models from the OpenFWI dataset.


title: Low frequency electrodynamics in the mixed state of superconducting NbN and a-MoGe films using two-coil mutual inductance technique

abstract: We investigate the low-frequency electrodynamics in the vortex state of two type-II superconducting films, namely, a moderate-to-strongly pinned Niobium Nitride (NbN) and a very weakly pinned amorphous Molybdenum Germanium (a-MoGe). We employ a two-coil mutual inductance technique to extract the complex penetration depth, $\tilde{\lambda}$. The sample response is studied through the temperature variation of $\tilde{\lambda}$ in the mixed state, where we employ a model developed by Coffey and Clem (CC model) to extract the different vortex lattice (VL) parameters such as the restoring pinning force constant (Labusch parameter), VL drag coefficient and pinning potential barrier. We observe that a consistent description of the inductive and dissipative part of the response is only possible when we take the viscous drag on the vortices to be several orders of magnitudes larger than viscous drag estimated from the Bardeen-Stephen model.


title: COOL: A Constraint Object-Oriented Logic Programming Language and its Neural-Symbolic Compilation System

abstract: This paper explores the integration of neural networks with logic programming, addressing the longstanding challenges of combining the generalization and learning capabilities of neural networks with the precision of symbolic logic. Traditional attempts at this integration have been hampered by difficulties in initial data acquisition, the reliability of undertrained networks, and the complexity of reusing and augmenting trained models. To overcome these issues, we introduce the COOL (Constraint Object-Oriented Logic) programming language, an innovative approach that seamlessly combines logical reasoning with neural network technologies. COOL is engineered to autonomously handle data collection, mitigating the need for user-supplied initial data. It incorporates user prompts into the coding process to reduce the risks of undertraining and enhances the interaction among models throughout their lifecycle to promote the reuse and augmentation of networks. Furthermore, the foundational principles and algorithms in COOL's design and its compilation system could provide valuable insights for future developments in programming languages and neural network architectures.


title: Which is better? Exploring Prompting Strategy For LLM-based Metrics

abstract: This paper describes the DSBA submissions to the Prompting Large Language Models as Explainable Metrics shared task, where systems were submitted to two tracks: small and large summarization tracks. With advanced Large Language Models (LLMs) such as GPT-4, evaluating the quality of Natural Language Generation (NLG) has become increasingly paramount. Traditional similarity-based metrics such as BLEU and ROUGE have shown to misalign with human evaluation and are ill-suited for open-ended generation tasks. To address this issue, we explore the potential capability of LLM-based metrics, especially leveraging open-source LLMs. In this study, wide range of prompts and prompting techniques are systematically analyzed with three approaches: prompting strategy, score aggregation, and explainability. Our research focuses on formulating effective prompt templates, determining the granularity of NLG quality scores and assessing the impact of in-context examples on LLM-based evaluation. Furthermore, three aggregation strategies are compared to identify the most reliable method for aggregating NLG quality scores. To examine explainability, we devise a strategy that generates rationales for the scores and analyzes the characteristics of the explanation produced by the open-source LLMs. Extensive experiments provide insights regarding evaluation capabilities of open-source LLMs and suggest effective prompting strategies.


title: Multilingual Mathematical Autoformalization

abstract: Autoformalization is the task of translating natural language materials into machine-verifiable formalisations. Progress in autoformalization research is hindered by the lack of a sizeable dataset consisting of informal-formal pairs expressing the same essence. Existing methods tend to circumvent this challenge by manually curating small corpora or using few-shot learning with large language models. But these methods suffer from data scarcity and formal language acquisition difficulty. In this work, we create $\texttt{MMA}$, a large, flexible, multilingual, and multi-domain dataset of informal-formal pairs, by using a language model to translate in the reverse direction, that is, from formal mathematical statements into corresponding informal ones. Experiments show that language models fine-tuned on $\texttt{MMA}$ produce $16-18\%$ of statements acceptable with minimal corrections on the $\texttt{miniF2F}$ and $\texttt{ProofNet}$ benchmarks, up from $0\%$ with the base model. We demonstrate that fine-tuning on multilingual formal data results in more capable autoformalization models even when deployed on monolingual tasks.


title: Learning Decentralized Traffic Signal Controllers with Multi-Agent Graph Reinforcement Learning

abstract: This paper considers optimal traffic signal control in smart cities, which has been taken as a complex networked system control problem. Given the interacting dynamics among traffic lights and road networks, attaining controller adaptivity and scalability stands out as a primary challenge. Capturing the spatial-temporal correlation among traffic lights under the framework of Multi-Agent Reinforcement Learning (MARL) is a promising solution. Nevertheless, existing MARL algorithms ignore effective information aggregation which is fundamental for improving the learning capacity of decentralized agents. In this paper, we design a new decentralized control architecture with improved environmental observability to capture the spatial-temporal correlation. Specifically, we first develop a topology-aware information aggregation strategy to extract correlation-related information from unstructured data gathered in the road network. Particularly, we transfer the road network topology into a graph shift operator by forming a diffusion process on the topology, which subsequently facilitates the construction of graph signals. A diffusion convolution module is developed, forming a new MARL algorithm, which endows agents with the capabilities of graph learning. Extensive experiments based on both synthetic and real-world datasets verify that our proposal outperforms existing decentralized algorithms.


title: Manifold learning: what, how, and why

abstract: Manifold learning (ML), known also as non-linear dimension reduction, is a set of methods to find the low dimensional structure of data. Dimension reduction for large, high dimensional data is not merely a way to reduce the data; the new representations and descriptors obtained by ML reveal the geometric shape of high dimensional point clouds, and allow one to visualize, de-noise and interpret them. This survey presents the principles underlying ML, the representative methods, as well as their statistical foundations from a practicing statistician's perspective. It describes the trade-offs, and what theory tells us about the parameter and algorithmic choices we make in order to obtain reliable conclusions.


title: Large Language Model based Long-tail Query Rewriting in Taobao Search

abstract: In the realm of e-commerce search, the significance of semantic matching cannot be overstated, as it directly impacts both user experience and company revenue. Along this line, query rewriting, serving as an important technique to bridge the semantic gaps inherent in the semantic matching process, has attached wide attention from the industry and academia. However, existing query rewriting methods often struggle to effectively optimize long-tail queries and alleviate the phenomenon of "few-recall" caused by semantic gap. In this paper, we present BEQUE, a comprehensive framework that Bridges the sEmantic gap for long-tail QUEries. In detail, BEQUE comprises three stages: multi-instruction supervised fine tuning (SFT), offline feedback, and objective alignment. We first construct a rewriting dataset based on rejection sampling and auxiliary tasks mixing to fine-tune our large language model (LLM) in a supervised fashion. Subsequently, with the well-trained LLM, we employ beam search to generate multiple candidate rewrites, and feed them into Taobao offline system to obtain the partial order. Leveraging the partial order of rewrites, we introduce a contrastive learning method to highlight the distinctions between rewrites, and align the model with the Taobao online objectives. Offline experiments prove the effectiveness of our method in bridging semantic gap. Online A/B tests reveal that our method can significantly boost gross merchandise volume (GMV), number of transaction (#Trans) and unique visitor (UV) for long-tail queries. BEQUE has been deployed on Taobao, one of most popular online shopping platforms in China, since October 2023.


abstract: In this paper we consider $L^p$ Liouville type theorems for harmonic functions on gradient Ricci solitons. In particular, assume that $(M,g)$ is a gradient shrinking or steady K\"ahler-Ricci soliton, then we prove that any harmonic function $u$ on $M$ with $\nabla u\in L^p(M)$ for some $p>1$ is a constant function.


title: Posterior Sampling-Based Bayesian Optimization with Tighter Bayesian Regret Bounds

abstract: Among various acquisition functions (AFs) in Bayesian optimization (BO), Gaussian process upper confidence bound (GP-UCB) and Thompson sampling (TS) are well-known options with established theoretical properties regarding Bayesian cumulative regret (BCR). Recently, it has been shown that a randomized variant of GP-UCB achieves a tighter BCR bound compared with GP-UCB, which we call the tighter BCR bound for brevity. Inspired by this study, this paper first shows that TS achieves the tighter BCR bound. On the other hand, GP-UCB and TS often practically suffer from manual hyperparameter tuning and over-exploration issues, respectively. Therefore, we analyze yet another AF called a probability of improvement from the maximum of a sample path (PIMS). We show that PIMS achieves the tighter BCR bound and avoids the hyperparameter tuning, unlike GP-UCB. Furthermore, we demonstrate a wide range of experiments, focusing on the effectiveness of PIMS that mitigates the practical issues of GP-UCB and TS.


title: Augmenting Radio Signals with Wavelet Transform for Deep Learning-Based Modulation Recognition

abstract: The use of deep learning for radio modulation recognition has become prevalent in recent years. This approach automatically extracts high-dimensional features from large datasets, facilitating the accurate classification of modulation schemes. However, in real-world scenarios, it may not be feasible to gather sufficient training data in advance. Data augmentation is a method used to increase the diversity and quantity of training dataset and to reduce data sparsity and imbalance. In this paper, we propose data augmentation methods that involve replacing detail coefficients decomposed by discrete wavelet transform for reconstructing to generate new samples and expand the training set. Different generation methods are used to generate replacement sequences. Simulation results indicate that our proposed methods significantly outperform the other augmentation methods.


title: Image change detection with only a few samples

abstract: This paper considers image change detection with only a small number of samples, which is a significant problem in terms of a few annotations available. A major impediment of image change detection task is the lack of large annotated datasets covering a wide variety of scenes. Change detection models trained on insufficient datasets have shown poor generalization capability. To address the poor generalization issue, we propose using simple image processing methods for generating synthetic but informative datasets, and design an early fusion network based on object detection which could outperform the siamese neural network. Our key insight is that the synthetic data enables the trained model to have good generalization ability for various scenarios. We compare the model trained on the synthetic data with that on the real-world data captured from a challenging dataset, CDNet, using six different test sets. The results demonstrate that the synthetic data is informative enough to achieve higher generalization ability than the insufficient real-world data. Besides, the experiment shows that utilizing a few (often tens of) samples to fine-tune the model trained on the synthetic data will achieve excellent results.


title: Thresholding the higher criticism test statistics for optimality in a heterogeneous setting

abstract: Donoho and Kipnis (2022) showed that the the higher criticism (HC) test statistic has a non-Gaussian phase transition but remarked that it is probably not optimal, in the detection of sparse differences between two large frequency tables when the counts are low. The setting can be considered to be heterogeneous, with cells containing larger total counts more able to detect smaller differences. We provide a general study here of sparse detection arising from such heterogeneous settings, and showed that optimality of the HC test statistic requires thresholding, for example in the case of frequency table comparison, to restrict to p-values of cells with total counts exceeding a threshold. The use of thresholding also leads to optimality of the HC test statistic when it is applied on the sparse Poisson means model of Arias-Castro and Wang (2015). The phase transitions we consider here are non-Gaussian, and involve an interplay between the rate functions of the response and sample size distributions. We also showed, both theoretically and in a numerical study, that applying thresholding to the Bonferroni test statistic results in better sparse mixture detection in heterogeneous settings.


title: Neuro-GPT: Towards A Foundation Model for EEG

abstract: To handle the scarcity and heterogeneity of electroencephalography (EEG) data for Brain-Computer Interface (BCI) tasks, and to harness the power of large publicly available data sets, we propose Neuro-GPT, a foundation model consisting of an EEG encoder and a GPT model. The foundation model is pre-trained on a large-scale data set using a self-supervised task that learns how to reconstruct masked EEG segments. We then fine-tune the model on a Motor Imagery Classification task to validate its performance in a low-data regime (9 subjects). Our experiments demonstrate that applying a foundation model can significantly improve classification performance compared to a model trained from scratch, which provides evidence for the generalizability of the foundation model and its ability to address challenges of data scarcity and heterogeneity in EEG. The code is publicly available at github.com/wenhui0206/NeuroGPT.


title: Classification of Various Types of Damages in Honeycomb Composite Sandwich Structures using Guided Wave Structural Health Monitoring

abstract: Classification of damages in honeycomb composite sandwich structure (HCSS) is important to decide remedial actions. However, previous studies have only detected damages using deviations of monitoring signal from healthy (baseline) using a guided wave (GW) based structural health monitoring system. Classification between various types of damages has not been reported for challenging cases. We show that using careful feature engineering and machine learning it is possible to classify between various types of damages such as core crush (CC), high density core (HDC), lost film adhesive (LFA) and teflon release film (TRF). We believe that we are the first to report numerical models for four types of damages in HCSS, which is followed up with experimental validation. We found that two out of four damages affect the GW signal in a particularly similar manner. We extracted and evaluated multiple features from time as well as frequency domains, and also experimented with features relative to as baseline as well as those that were baseline-free. Using Pearson's correlation coefficient based filtering, redundant features were eliminated. Finally, using an optimal feature set determined using feature elimination, high accuracy was achieved with a random forest classifier on held-out signals. For evaluating performance of the proposed method for different damage sizes, we used simulated data obtained from extensive parametric studies and got an accuracy of 77.89%. Interpretability studies to determine importance of various features showed that features computed using the baseline signal prove more effective as compared to baseline-free features.


title: Field-induced rocking curve effects in attosecond electron diffraction

abstract: Recent advances in electron microscopy trigger the question whether attosecond electron diffraction can resolve atomic-scale electron dynamics in crystalline materials in space and time. Here we explore the physics of the relevant electron-lattice scattering process in the time domain. We drive a single-crystalline silicon membrane with the optical cycles of near-infrared laser light and use attosecond electron pulses to produce electron diffraction patterns as a function of delay. For all Bragg spots, we observe time-dependent intensity changes and position shifts that are correlated with a time delay of 0.5-1.2 fs. For single-cycle excitation pulses with strong peak intensity, the correlations become nonlinear. Origin of these effects are local and integrated beam deflections by the optical electric and magnetic fields at the crystal membrane that modify the diffraction intensities in addition to the atomic structure factor dynamics by time-dependent rocking-curve effects. However, the measured time delays and symmetries allow to disentangle both effects. Future attosecond electron diffraction and microscopy experiments need to be based on these results.


title: Gender Inflected or Bias Inflicted: On Using Grammatical Gender Cues for Bias Evaluation in Machine Translation

abstract: Neural Machine Translation (NMT) models are state-of-the-art for machine translation. However, these models are known to have various social biases, especially gender bias. Most of the work on evaluating gender bias in NMT has focused primarily on English as the source language. For source languages different from English, most of the studies use gender-neutral sentences to evaluate gender bias. However, practically, many sentences that we encounter do have gender information. Therefore, it makes more sense to evaluate for bias using such sentences. This allows us to determine if NMT models can identify the correct gender based on the grammatical gender cues in the source sentence rather than relying on biased correlations with, say, occupation terms. To demonstrate our point, in this work, we use Hindi as the source language and construct two sets of gender-specific sentences: OTSC-Hindi and WinoMT-Hindi that we use to evaluate different Hindi-English (HI-EN) NMT systems automatically for gender bias. Our work highlights the importance of considering the nature of language when designing such extrinsic bias evaluation datasets.


title: PT-Tuning: Bridging the Gap between Time Series Masked Reconstruction and Forecasting via Prompt Token Tuning

abstract: Self-supervised learning has been actively studied in time series domain recently, especially for masked reconstruction. Most of these methods follow the "Pre-training + Fine-tuning" paradigm in which a new decoder replaces the pre-trained decoder to fit for a specific downstream task, leading to inconsistency of upstream and downstream tasks. In this paper, we first point out that the unification of task objectives and adaptation for task difficulty are critical for bridging the gap between time series masked reconstruction and forecasting. By reserving the pre-trained mask token during fine-tuning stage, the forecasting task can be taken as a special case of masked reconstruction, where the future values are masked and reconstructed based on history values. It guarantees the consistency of task objectives but there is still a gap in task difficulty. Because masked reconstruction can utilize contextual information while forecasting can only use historical information to reconstruct. To further mitigate the existed gap, we propose a simple yet effective prompt token tuning (PT-Tuning) paradigm, in which all pre-trained parameters are frozen and only a few trainable prompt tokens are added to extended mask tokens in element-wise manner. Extensive experiments on real-world datasets demonstrate the superiority of our proposed paradigm with state-of-the-art performance compared to representation learning and end-to-end supervised forecasting methods.


title: Nonparametric Screening for Additive Quantile Regression in Ultra-high Dimension

abstract: In practical applications, one often does not know the "true" structure of the underlying conditional quantile function, especially in the ultra-high dimensional setting. To deal with ultra-high dimensionality, quantile-adaptive marginal nonparametric screening methods have been recently developed. However, these approaches may miss important covariates that are marginally independent of the response, or may select unimportant covariates due to their high correlations with important covariates. To mitigate such shortcomings, we develop a conditional nonparametric quantile screening procedure (complemented by subsequent selection) for nonparametric additive quantile regression models. Under some mild conditions, we show that the proposed screening method can identify all relevant covariates in a small number of steps with probability approaching one. The subsequent narrowed best subset (via a modified Bayesian information criterion) also contains all the relevant covariates with overwhelming probability. The advantages of our proposed procedure are demonstrated through simulation studies and a real data example.


title: Lightweight Portrait Matting via Regional Attention and Refinement

abstract: We present a lightweight model for high resolution portrait matting. The model does not use any auxiliary inputs such as trimaps or background captures and achieves real time performance for HD videos and near real time for 4K. Our model is built upon a two-stage framework with a low resolution network for coarse alpha estimation followed by a refinement network for local region improvement. However, a naive implementation of the two-stage model suffers from poor matting quality if not utilizing any auxiliary inputs. We address the performance gap by leveraging the vision transformer (ViT) as the backbone of the low resolution network, motivated by the observation that the tokenization step of ViT can reduce spatial resolution while retain as much pixel information as possible. To inform local regions of the context, we propose a novel cross region attention (CRA) module in the refinement network to propagate the contextual information across the neighboring regions. We demonstrate that our method achieves superior results and outperforms other baselines on three benchmark datasets while only uses $1/20$ of the FLOPS compared to the existing state-of-the-art model.


title: Universal kinetics of the stochastic formation of polarization domain structures in a uniaxial single-crystal ferroelectric

abstract: Initial conditions after quenching from a high-temperature paraelectric phase to a low-temperature ferroelectric phase have a substantial impact on the temporal development and formation of stable polarization domain structures which eventually determine physical properties and the functionality of ferroelectrics. Based on the recently advanced exactly solvable model of the stochastic domain structure kinetics in a uniaxial ferroelectric [Phys. Rev. B 107, 144109 (2023)], we study the effect of the magnitude of the initial disorder, its initial correlation length and polarization correlation function on the system evolution. For different shapes of the initial correlation function, the time-dependent correlation length and the two-point polarization correlation coefficient are calculated analytically demonstrating universal features and a good agreement with the available experimental data. Particularly, the magnitude of the charge density correlation function reveals a strong reduction of the bound charges at the nominally charged domain walls which was recently observed experimentally in uniaxial ferroelectrics. Consequently, the integrodifferential equations of evolution for the polarization correlation function and the mean polarization are numerically solved for different initial conditions. The temporal dependence of the polarization mean value and variance are evaluated demonstrating the bifurcation behavior depending on the applied electric field. The impact of the initial state properties on the coercive field deciding between the single- and multi-domain final states of the system is disclosed.


title: Asymptotically Steerable Finite Fourier-Bessel Transforms and Closure under Convolution

abstract: This paper develops a constructive numerical scheme for Fourier-Bessel approximations on disks compatible with convolutions supported on disks. We address accurate finite Fourier-Bessel transforms (FFBT) and inverse finite Fourier-Bessel transforms (iFFBT) of functions on disks using the discrete Fourier Transform (DFT) on Cartesian grids. Whereas the DFT and its fast implementation (FFT) are ubiquitous and are powerful for computing convolutions, they are not exactly steerable under rotations. In contrast, Fourier-Bessel expansions are steerable, but lose both this property and the preservation of band limits under convolution. This work captures the best features of both as the band limit is allowed to increase. The convergence/error analysis and asymptotic steerability of FFBT/ iFFBT are investigated. Conditions are established for the FFBT to converge to the Fourier-Bessel coefficient and for the iFFBT to uniformly approximate the Fourier-Bessel partial sums. The matrix form of the finite transforms is discussed. The implementation of the discrete method to compute numerical approximation of convolutions of compactly supported functions on disks is considered as well.


title: Near horizon linearized gravity and soft theorem

abstract: In this paper, we study the linearized gravity theory in the near horizon region of the Schwarzschild black hole in four dimensional spacetime. Under the Newman-Unti gauge, we derive the most general near horizon symmetry and solution space without any near horizon fall-off condition. There are four towers of surface charges that are generic functions on the horizon associated to the near horizon symmetry. With suitable near horizon fall-off conditions, we reveal a soft graviton theorem from the Ward identity of the near horizon supertranslation in both coordinates space and momentum space.


title: Meta-Adapter: An Online Few-shot Learner for Vision-Language Model

abstract: The contrastive vision-language pre-training, known as CLIP, demonstrates remarkable potential in perceiving open-world visual concepts, enabling effective zero-shot image recognition. Nevertheless, few-shot learning methods based on CLIP typically require offline fine-tuning of the parameters on few-shot samples, resulting in longer inference time and the risk of over-fitting in certain domains. To tackle these challenges, we propose the Meta-Adapter, a lightweight residual-style adapter, to refine the CLIP features guided by the few-shot samples in an online manner. With a few training samples, our method can enable effective few-shot learning capabilities and generalize to unseen data or tasks without additional fine-tuning, achieving competitive performance and high efficiency. Without bells and whistles, our approach outperforms the state-of-the-art online few-shot learning method by an average of 3.6\% on eight image classification datasets with higher inference speed. Furthermore, our model is simple and flexible, serving as a plug-and-play module directly applicable to downstream tasks. Without further fine-tuning, Meta-Adapter obtains notable performance improvements in open-vocabulary object detection and segmentation tasks.


title: Multi-Beam Forming with Movable-Antenna Array

abstract: Conventional multi-beam forming with fixed-position antenna (FPA) arrays needs to trade-off between maximizing the beamforming gain over desired directions and minimizing the interference power over undesired directions. In this letter, we study the enhanced multi-beam forming with a linear movable-antenna (MA) array by exploiting the new degrees of freedom (DoFs) via antennas' position optimization. Specifically, we jointly optimize the antenna position vector (APV) and antenna weight vector (AWV) to maximize the minimum beamforming gain over multiple desired directions, subject to a given constraint on the maximum interference power over undesired directions. We propose an efficient alternating optimization algorithm to find a suboptimal solution by iteratively optimizing one of the APV and AWV with the other being fixed. Numerical results show that the proposed multi-beam forming design with MA arrays can significantly outperform that with the traditional FPA arrays and other benchmark schemes in terms of both beamforming gain and interference suppression.


title: Filtered Partial Differential Equations: a robust surrogate constraint in physics-informed deep learning framework

abstract: Embedding physical knowledge into neural network (NN) training has been a hot topic. However, when facing the complex real-world, most of the existing methods still strongly rely on the quantity and quality of observation data. Furthermore, the neural networks often struggle to converge when the solution to the real equation is very complex. Inspired by large eddy simulation in computational fluid dynamics, we propose an improved method based on filtering. We analyzed the causes of the difficulties in physics informed machine learning, and proposed a surrogate constraint (filtered PDE, FPDE in short) of the original physical equations to reduce the influence of noisy and sparse observation data. In the noise and sparsity experiment, the proposed FPDE models (which are optimized by FPDE constraints) have better robustness than the conventional PDE models. Experiments demonstrate that the FPDE model can obtain the same quality solution with 100% higher noise and 12% quantity of observation data of the baseline. Besides, two groups of real measurement data are used to show the FPDE improvements in real cases. The final results show that FPDE still gives more physically reasonable solutions when facing the incomplete equation problem and the extremely sparse and high-noise conditions. For combining real-world experiment data into physics-informed training, the proposed FPDE constraint is useful and performs well in two real-world experiments: modeling the blood velocity in vessels and cell migration in scratches.


title: Reentrant Non-Hermitian Skin Effect in Coupled Non-Hermitian and Hermitian Chains with Correlated Disorder

abstract: The interplay of non-Hermiticity and disorder dramatically influences system's localization properties, giving rise to intriguing quantum phenomena. Although the intrinsic non-Hermitian skin effect (NHSE) is robust against the weak disorder even in a one-dimensional system, it becomes Anderson localization under strong disorder. Here, we study a localization-delocalization transition by coupling a strongly disordered Hatano-Nelson (HN) chain to a disordered Hermitian chain with its disorder correlated to that of HN chain. Regardless of the disorder strength, as the coupling strength between HN and Hermitian chain increases, a delocalization transition occurs. This leads to a reentrant NHSE due to the interplay of non-Hermiticity and correlated disorder. We reveal the underlying mechanism for the reentrant NHSE under correlated disorder. Moreover, the localization-delocalization transition is well captured by the real-space winding number.


title: Bridging the Information Gap Between Domain-Specific Model and General LLM for Personalized Recommendation

abstract: Generative large language models(LLMs) are proficient in solving general problems but often struggle to handle domain-specific tasks. This is because most of domain-specific tasks, such as personalized recommendation, rely on task-related information for optimal performance. Current methods attempt to supplement task-related information to LLMs by designing appropriate prompts or employing supervised fine-tuning techniques. Nevertheless, these methods encounter the certain issue that information such as community behavior pattern in RS domain is challenging to express in natural language, which limits the capability of LLMs to surpass state-of-the-art domain-specific models. On the other hand, domain-specific models for personalized recommendation which mainly rely on user interactions are susceptible to data sparsity due to their limited common knowledge capabilities. To address these issues, we proposes a method to bridge the information gap between the domain-specific models and the general large language models. Specifically, we propose an information sharing module which serves as an information storage mechanism and also acts as a bridge for collaborative training between the LLMs and domain-specific models. By doing so, we can improve the performance of LLM-based recommendation with the help of user behavior pattern information mined by domain-specific models. On the other hand, the recommendation performance of domain-specific models can also be improved with the help of common knowledge learned by LLMs. Experimental results on three real-world datasets have demonstrated the effectiveness of the proposed method.


title: Dynamics of subgroups of mapping class groups

abstract: Let $\rm{Mod(S)}$ be the mapping class group of a closed orientable surface $S$ of genus $g \geq 2$. Let $G$ be a non-elementary subgroup of $\rm{Mod(S)}$ so that the associated Bowen-Margulis measure is finite. In this paper, we give an asymptotic growth formula for $G$ with respect to the Teichm\"{u}ller metric.


title: Ensembling Textual and Structure-Based Models for Knowledge Graph Completion

abstract: We consider two popular approaches to Knowledge Graph Completion (KGC): textual models that rely on textual entity descriptions, and structure-based models that exploit the connectivity structure of the Knowledge Graph (KG). Preliminary experiments show that these approaches have complementary strengths: structure-based models perform well when the gold answer is easily reachable from the query head in the KG, while textual models exploit descriptions to give good performance even when the gold answer is not reachable. In response, we explore ensembling as a way of combining the best of both approaches. We propose a novel method for learning query-dependent ensemble weights by using the distributions of scores assigned by individual models to all candidate entities. Our ensemble baseline achieves state-of-the-art results on three standard KGC datasets, with up to 6.8 pt MRR and 8.3 pt Hits@1 gains over best individual models.


title: Classical spin models and basic magnetic interactions on 1/1-approximant crystals

abstract: We study classical spin models on the 1/1 Tsai-type approximant lattice using Monte Carlo and mean-field methods. Our aim is to understand whether the phase diagram differences between Gd- and Tb-based approximants can be attributed to anisotropy induced by the crystal-electric field. To address this question, we treat Gd ions as Heisenberg spins and Tb ions as Ising spins. Additionally, we consider the presence of the RKKY interaction to replicate the experimentally observed correlation between magnetic properties and electron concentration. Surprisingly, our findings show that the transition between ferromagnetic and antiferromagnetic order remains unaltered by the anisotropy, even when accounting for the dipole interaction. We conclude that a more comprehensive model, extending beyond the free-electron gas RKKY interaction, is likely required to fully understand the distinctions between Gd- and Tb-based approximants. Our work represents a systematic exploration of the impact of anisotropy on the ground-state properties of classical spin models in quasicrystal approximants.


title: CapST: An Enhanced and Lightweight Model Attribution Approach for Synthetic Videos

abstract: Deepfake videos, generated through AI faceswapping techniques, have garnered considerable attention due to their potential for powerful impersonation attacks. While existing research primarily focuses on binary classification to discern between real and fake videos, however determining the specific generation model for a fake video is crucial for forensic investigation. Addressing this gap, this paper investigates the model attribution problem of Deepfake videos from a recently proposed dataset, Deepfakes from Different Models (DFDM), derived from various Autoencoder models. The dataset comprises 6,450 Deepfake videos generated by five distinct models with variations in encoder, decoder, intermediate layer, input resolution, and compression ratio. This study formulates Deepfakes model attribution as a multiclass classification task, proposing a segment of VGG19 as a feature extraction backbone, known for its effectiveness in imagerelated tasks, while integrated a Capsule Network with a Spatio-Temporal attention mechanism. The Capsule module captures intricate hierarchies among features for robust identification of deepfake attributes. Additionally, the video-level fusion technique leverages temporal attention mechanisms to handle concatenated feature vectors, capitalizing on inherent temporal dependencies in deepfake videos. By aggregating insights across frames, our model gains a comprehensive understanding of video content, resulting in more precise predictions. Experimental results on the deepfake benchmark dataset (DFDM) demonstrate the efficacy of our proposed method, achieving up to a 4% improvement in accurately categorizing deepfake videos compared to baseline models while demanding fewer computational resources.


title: Scene-Driven Multimodal Knowledge Graph Construction for Embodied AI

abstract: Embodied AI is one of the most popular studies in artificial intelligence and robotics, which can effectively improve the intelligence of real-world agents (i.e. robots) serving human beings. Scene knowledge is important for an agent to understand the surroundings and make correct decisions in the varied open world. Currently, knowledge base for embodied tasks is missing and most existing work use general knowledge base or pre-trained models to enhance the intelligence of an agent. For conventional knowledge base, it is sparse, insufficient in capacity and cost in data collection. For pre-trained models, they face the uncertainty of knowledge and hard maintenance. To overcome the challenges of scene knowledge, we propose a scene-driven multimodal knowledge graph (Scene-MMKG) construction method combining conventional knowledge engineering and large language models. A unified scene knowledge injection framework is introduced for knowledge representation. To evaluate the advantages of our proposed method, we instantiate Scene-MMKG considering typical indoor robotic functionalities (Manipulation and Mobility), named ManipMob-MMKG. Comparisons in characteristics indicate our instantiated ManipMob-MMKG has broad superiority in data-collection efficiency and knowledge quality. Experimental results on typical embodied tasks show that knowledge-enhanced methods using our instantiated ManipMob-MMKG can improve the performance obviously without re-designing model structures complexly. Our project can be found at https://sites.google.com/view/manipmob-mmkg


title: UP-NeRF: Unconstrained Pose-Prior-Free Neural Radiance Fields

abstract: Neural Radiance Field (NeRF) has enabled novel view synthesis with high fidelity given images and camera poses. Subsequent works even succeeded in eliminating the necessity of pose priors by jointly optimizing NeRF and camera pose. However, these works are limited to relatively simple settings such as photometrically consistent and occluder-free image collections or a sequence of images from a video. So they have difficulty handling unconstrained images with varying illumination and transient occluders. In this paper, we propose $\textbf{UP-NeRF}$ ($\textbf{U}$nconstrained $\textbf{P}$ose-prior-free $\textbf{Ne}$ural $\textbf{R}$adiance $\textbf{F}$ields) to optimize NeRF with unconstrained image collections without camera pose prior. We tackle these challenges with surrogate tasks that optimize color-insensitive feature fields and a separate module for transient occluders to block their influence on pose estimation. In addition, we introduce a candidate head to enable more robust pose estimation and transient-aware depth supervision to minimize the effect of incorrect prior. Our experiments verify the superior performance of our method compared to the baselines including BARF and its variants in a challenging internet photo collection, $\textit{Phototourism}$ dataset.


title: Self-MI: Efficient Multimodal Fusion via Self-Supervised Multi-Task Learning with Auxiliary Mutual Information Maximization

abstract: Multimodal representation learning poses significant challenges in capturing informative and distinct features from multiple modalities. Existing methods often struggle to exploit the unique characteristics of each modality due to unified multimodal annotations. In this study, we propose Self-MI in the self-supervised learning fashion, which also leverage Contrastive Predictive Coding (CPC) as an auxiliary technique to maximize the Mutual Information (MI) between unimodal input pairs and the multimodal fusion result with unimodal inputs. Moreover, we design a label generation module, $ULG_{MI}$ for short, that enables us to create meaningful and informative labels for each modality in a self-supervised manner. By maximizing the Mutual Information, we encourage better alignment between the multimodal fusion and the individual modalities, facilitating improved multimodal fusion. Extensive experiments on three benchmark datasets including CMU-MOSI, CMU-MOSEI, and SIMS, demonstrate the effectiveness of Self-MI in enhancing the multimodal fusion task.


title: Cluster realisations of $\imath$quantum groups of type AI

abstract: The $\imath$quantum group ${\mathrm{U}^\imath_{n}}$ of type $\textrm{AI}_n$ is a coideal subalgebra of the quantum group $U_q(\mathfrak{sl}_{n+1})$, associated with the symmetric pair $(\mathfrak{sl}_{n+1},\mathfrak{so}_{n+1})$. In this paper, we give a cluster realisation of the algebra ${\mathrm{U}^\imath_{n}}$. Under such a realisation, we give cluster interpretations of some fundamental constructions of ${\mathrm{U}^\imath_{n}}$, including braid group symmetries, the coideal structure, and the action of a Coxeter element. Along the way, we study a (rescaled) integral form of ${\mathrm{U}^\imath_{n}}$, which is compatible with our cluster realisation. We show that this integral form is invariant under braid group symmetries, and construct PBW-bases for the integral form.


title: Textile-based conformable and breathable ultrasound imaging probe

abstract: Daily monitoring of internal tissues with conformable and breathable ultrasound (US) imaging probes is promising for early detection of diseases. In recent years, textile substrates are widely used for wearable devices since they satisfy both conformability and breathability. However, it is not currently possible to use textile substrates for US probes due to the reflection or attenuation of US waves at the air gaps in the textiles. In this paper, we fabricated a conformable and breathable US imaging probe by sandwiching the US elements between two woven polyester textiles on which copper electrodes were formed through electroless plating. The air gaps between the fibers at the electrode parts were filled with copper, allowing for high penetration of US waves. On the other hand, the non-electrode parts retain air gaps, leading to high breathability. The fabricated textile-based probe showed low flexural rigidity ($0.066 \times 10^{-4} N \cdot m^2/m$) and high air permeability ($11.7 cm^3 / cm^2 \cdot s$). Human neck imaging demonstrated the ability of the probe to monitor the pulsation of the common carotid artery and change in the internal jugular vein diameter, which lead to the early detection of health issues such as arteriosclerosis and dehydration.


title: Language Representation Projection: Can We Transfer Factual Knowledge across Languages in Multilingual Language Models?

abstract: Multilingual pretrained language models serve as repositories of multilingual factual knowledge. Nevertheless, a substantial performance gap of factual knowledge probing exists between high-resource languages and low-resource languages, suggesting limited implicit factual knowledge transfer across languages in multilingual pretrained language models. This paper investigates the feasibility of explicitly transferring relatively rich factual knowledge from English to non-English languages. To accomplish this, we propose two parameter-free $\textbf{L}$anguage $\textbf{R}$epresentation $\textbf{P}$rojection modules (LRP2). The first module converts non-English representations into English-like equivalents, while the second module reverts English-like representations back into representations of the corresponding non-English language. Experimental results on the mLAMA dataset demonstrate that LRP2 significantly improves factual knowledge retrieval accuracy and facilitates knowledge transferability across diverse non-English languages. We further investigate the working mechanism of LRP2 from the perspectives of representation space and cross-lingual knowledge neuron.


title: Practical Classical Molecular Dynamics Simulations for Low-Temperature Plasma Processing: A review

abstract: Molecular Dynamics simulations are becoming a powerful tool for examining and predicting atomic and molecular processes in various environment. The present review shows how, in the fields of plasma physics, chemistry and interactions with materials and or liquids, Molecular Dynamics simulations are able to provide significant insights into various processes, among them: gas phase polymerization, deposition, plasma-catalysis, discharge breakdown, vibrational excitation.


title: Back to the present: A general treatment for the tidal field from the wake of dynamical friction

abstract: Dynamical friction can be a valuable tool for inferring dark matter properties that are difficult to constrain by other methods. Most applications of dynamical friction calculations are concerned with the long-term angular momentum loss and orbital decay of the perturber within its host. This, however, assumes knowledge of the unknown initial conditions of the system. We advance an alternative methodology to infer the host properties from the perturber's shape distortions induced by the tides of the wake of dynamical friction, which we refer to as the tidal dynamical friction. As the shape distortions rely on the tidal field that has a predominantly local origin, we present a strategy to find the local wake by integrating the stellar orbits back in time along with the perturber, then removing the perturber's potential and re-integrating them back to the present. This provides perturbed and unperturbed coordinates and hence a change in coordinates, density, and acceleration fields, which yields the back-reaction experienced by the perturber. The method successfully recovers the tidal field of the wake based on a comparison with N-body simulations. We show that similar to the tidal field itself, the noise and randomness of the dynamical friction force due to the finite number of stars is also dominated by regions close to the perturber. Stars near the perturber influence it more but are smaller in number, causing a high variance in the acceleration field. These fluctuations are intrinsic to dynamical friction. We show that a stellar density of $0.0014 {\rm M_\odot\, kpc^{-3}}$ yields an inherent variance of 10% to the dynamical friction. The current method extends the family of dynamical friction methods that allow for the inference of host properties from tidal forces of the wake. It can be applied to specific galaxies, such as Magellanic Clouds, with Gaia data.


title: Accurate estimation of functional brain connectivity via Bayesian ICA with population-derived priors

abstract: Estimation of brain functional connectivity (FC) is essential for understanding the functional organization in the brain and for identifying changes occurring due to neurological disorders, development, treatment, and other phenomena. Independent component analysis (ICA) is a matrix decomposition method that has been used extensively for estimation of brain functional networks and their FC. However, estimation of FC via ICA is often sub-optimal due to the use of ad-hoc methods or need for temporal dimension reduction prior to traditional ICA methods. Bayesian ICA methods can avoid dimension reduction, produce more accurate estimates, and facilitate inference via posterior distributions on the model parameters. In this paper, we propose a novel, computationally efficient Bayesian ICA method with population-derived priors on both the temporal covariance, representing FC, and the spatial components of the model. We propose two algorithms for parameter estimation: a Bayesian Expectation-Maximization algorithm with a Gibbs sampler at the E-step, and a more computationally efficient variational Bayes algorithm. Through extensive simulation studies using realistic fMRI data generation mechanisms, we evaluate the performance of the proposed methods and compare them with existing approaches. Finally, we perform a comprehensive evaluation of the proposed methods using fMRI data from over 400 healthy adults in the Human Connectome Project. Our analyses demonstrate that the proposed Bayesian ICA methods produce highly accurate measures of functional connectivity and spatial brain features. The proposed framework is computationally efficient and applicable to single-subject analysis, making it potentially clinically viable.


title: Character-Level Bangla Text-to-IPA Transcription Using Transformer Architecture with Sequence Alignment

abstract: The International Phonetic Alphabet (IPA) is indispensable in language learning and understanding, aiding users in accurate pronunciation and comprehension. Additionally, it plays a pivotal role in speech therapy, linguistic research, accurate transliteration, and the development of text-to-speech systems, making it an essential tool across diverse fields. Bangla being 7th as one of the widely used languages, gives rise to the need for IPA in its domain. Its IPA mapping is too diverse to be captured manually giving the need for Artificial Intelligence and Machine Learning in this field. In this study, we have utilized a transformer-based sequence-to-sequence model at the letter and symbol level to get the IPA of each Bangla word as the variation of IPA in association of different words is almost null. Our transformer model only consisted of 8.5 million parameters with only a single decoder and encoder layer. Additionally, to handle the punctuation marks and the occurrence of foreign languages in the text, we have utilized manual mapping as the model won't be able to learn to separate them from Bangla words while decreasing our required computational resources. Finally, maintaining the relative position of the sentence component IPAs and generation of the combined IPA has led us to achieve the top position with a word error rate of 0.10582 in the public ranking of DataVerse Challenge - ITVerse 2023 (https://www.kaggle.com/competitions/dataverse_2023/).


title: HaptStarter: Designing Haptic Stimulus Start System for Deaf and Hard of Hearing Sprinters

abstract: In this study, we design and develop HaptStarter -- a haptic stimulus start system -- to improve the starting performance of the deaf and hard of hearing (DHH) sprinters. A DHH person has a physical ability nearly equivalent to hearing; however, the difficulties in perceiving audio information lead to differences in their performance in sports. Furthermore, the visual reaction time is slower than the auditory reaction time (ART), while the haptic reaction time is equivalent to it. However, a light stimulus start system is increasingly being used in sprint races to aid DHH sprinters. In this study, we design a brand-new haptic stimulus start system for DHH sprinters; we also determine and leverage an optimum haptic stimulus interface. The proposed method has the potential to contribute toward the development of prototypes based on the universal design principle for everyone (DHH, blind and low-vision, and other disabled sprinters with wheelchairs or artificial arms or legs, etc.) by focusing on the overlapping area of sports and disability with human-computer interaction.


title: On the Impact of Overparameterization on the Training of a Shallow Neural Network in High Dimensions

abstract: We study the training dynamics of a shallow neural network with quadratic activation functions and quadratic cost in a teacher-student setup. In line with previous works on the same neural architecture, the optimization is performed following the gradient flow on the population risk, where the average over data points is replaced by the expectation over their distribution, assumed to be Gaussian.We first derive convergence properties for the gradient flow and quantify the overparameterization that is necessary to achieve a strong signal recovery. Then, assuming that the teachers and the students at initialization form independent orthonormal families, we derive a high-dimensional limit for the flow and show that the minimal overparameterization is sufficient for strong recovery. We verify by numerical experiments that these results hold for more general initializations.


title: Periodicity of dynamical signatures of chaos in quantum kicked top

abstract: A host of dynamical measures of quantum correlations -- out-of-time ordered correlators, Loschmidt echo, generalized entanglement and observational entropy -- are useful to infer about the underlying classical chaotic dynamics in quantum regime. In this work, these measures are employed to analyse quantum kicked top with kick strength $k$. It is shown that, despite the differences in their definitions, these measures are periodic with $k$, and the periodicity depends on the number of spins represented by the kicked top. The periodic behaviour arises from the structure of the kicked top Floquet operator and spans the regime in which the corresponding classical dynamics is predominantly chaotic. This result can guide experiments towards the right choice of kick strengths to avoid repetitive dynamics.


title: Port-Hamiltonian modeling of multidimensional flexible mechanical structures defined by linear elastic relations $\star$

abstract: This article presents a systematic methodology for modeling a class of flexible multidimensional mechanical structures defined by linear elastic relations that directly allows to obtain their infinite-dimensional port-Hamiltonian representation. The approach is restricted to systems based on a certain class of kinematic assumptions. However this class encompasses a wide range of models currently available in the literature, such as ${\ell}$-dimensional elasticity models (with ${\ell}$ = 1,2,3), vibrating strings, torsion in circular bars, classical beam and plate models, among others. The methodology is based on Hamilton's principle for a continuum medium which allows defining the energy variables of the port-Hamiltonian system, and also on a generalization of the integration by parts theorem, which allows characterizing the skew-adjoint differential operator and boundary inputs and boundary outputs variables. To illustrate this method, the plate modeling process based on Reddy's third-order shear deformation theory is presented as an example. To the best of our knowledge, this is the first time that an infinite-dimensional port-Hamiltonian representation of this system is presented in the literature.


title: User-level Differentially Private Stochastic Convex Optimization: Efficient Algorithms with Optimal Rates

abstract: We study differentially private stochastic convex optimization (DP-SCO) under user-level privacy, where each user may hold multiple data items. Existing work for user-level DP-SCO either requires super-polynomial runtime [Ghazi et al. (2023)] or requires the number of users to grow polynomially with the dimensionality of the problem with additional strict assumptions [Bassily et al. (2023)]. We develop new algorithms for user-level DP-SCO that obtain optimal rates for both convex and strongly convex functions in polynomial time and require the number of users to grow only logarithmically in the dimension. Moreover, our algorithms are the first to obtain optimal rates for non-smooth functions in polynomial time. These algorithms are based on multiple-pass DP-SGD, combined with a novel private mean estimation procedure for concentrated data, which applies an outlier removal step before estimating the mean of the gradients.


title: Noisy Pair Corrector for Dense Retrieval

abstract: Most dense retrieval models contain an implicit assumption: the training query-document pairs are exactly matched. Since it is expensive to annotate the corpus manually, training pairs in real-world applications are usually collected automatically, which inevitably introduces mismatched-pair noise. In this paper, we explore an interesting and challenging problem in dense retrieval, how to train an effective model with mismatched-pair noise. To solve this problem, we propose a novel approach called Noisy Pair Corrector (NPC), which consists of a detection module and a correction module. The detection module estimates noise pairs by calculating the perplexity between annotated positive and easy negative documents. The correction module utilizes an exponential moving average (EMA) model to provide a soft supervised signal, aiding in mitigating the effects of noise. We conduct experiments on text-retrieval benchmarks Natural Question and TriviaQA, code-search benchmarks StaQC and SO-DS. Experimental results show that NPC achieves excellent performance in handling both synthetic and realistic noise.