title: Effect of annealing in eutectic high-entropy alloy superconductor NbScTiZr

abstract: We investigated the impact of annealing on the structural characteristics and superconducting critical temperature ($T_\mathrm{c}$) of the eutectic high-entropy alloy (HEA) superconductor NbScTiZr. The HEA manifests an eutectic microstructure composed of body-centered cubic (bcc) and hexagonal close-packed phases. Both the lattice parameters of the bcc phase and grain size of the eutectic structure exhibited pronounced sensitivity to variations in annealing temperature. The observed dependence of the lattice parameter on annealing temperature supports the possibility that lattice strain occurs at lower annealing temperatures. The as-cast sample demonstrated superconductivity at $T_\mathrm{c}$ of 7.9 K, which increased to 9 K after annealing at 800 $^{\circ}$C. However, when subjected to annealing at 1000 $^{\circ}$C, $T_\mathrm{c}$ diminishes to 8.7 K. The annealing-temperature dependence of $T_\mathrm{c}$ cannot be comprehensively elucidated based solely on the electronic density of states at the Fermi level. It is plausible that the lattice strain may influence the annealing temperature dependence of $T_\mathrm{c}$. Our results for the critical current density $J_{c}$ reveal that the self-field $J_{c}$ of the as-cast NbScTiZr at 2 K exceeds 10$^{6}$ A/cm$^{2}$.


title: Machine learning for accuracy in density functional approximations

abstract: Machine learning techniques have found their way into computational chemistry as indispensable tools to accelerate atomistic simulations and materials design. In addition, machine learning approaches hold the potential to boost the predictive power of computationally efficient electronic structure methods, such as density functional theory, to chemical accuracy and to correct for fundamental errors in density functional approaches. Here, recent progress in applying machine learning to improve the accuracy of density functional and related approximations is reviewed. Promises and challenges in devising machine learning models transferable between different chemistries and materials classes are discussed with the help of examples applying promising models to systems far outside their training sets.


title: Design, Modeling, and Control of a Low-Cost and Rapid Response Soft-Growing Manipulator for Orchard Operations

abstract: Tree fruit growers around the world are facing labor shortages for critical operations, including harvest and pruning. There is a great interest in developing robotic solutions for these labor-intensive tasks, but current efforts have been prohibitively costly, slow, or require a reconfiguration of the orchard in order to function. In this paper, we introduce an alternative approach to robotics using a novel and low-cost soft-growing robotic platform. Our platform features the ability to extend up to 1.2 m linearly at a maximum speed of 0.27 m/s. The soft-growing robotic arm can operate with a terminal payload of up to 1.4 kg (4.4 N), more than sufficient for carrying an apple. This platform decouples linear and steering motions to simplify path planning and the controller design for targeting. We anticipate our platform being relatively simple to maintain compared to rigid robotic arms. Herein we also describe and experimentally verify the platform's kinematic model, including the prediction of the relationship between the steering angle and the angular positions of the three steering motors. Information from the model enables the position controller to guide the end effector to the targeted positions faster and with higher stability than without this information. Overall, our research show promise for using soft-growing robotic platforms in orchard operations.


title: A practical theoretical model for Ge-like epitaxial diodes: I. The I-V characteristics

abstract: A practical quantitative model is presented to account for the I-V characteristics of pin diodes based on epitaxial Ge-like materials. The model can be used to quantify how the different material properties and recombination mechanisms affect the diode performance. The importance of dislocations, non-passivated defects, and residual intrinsic layer doping in determining the qualitative shape of the I-V curves is discussed in detail. Examples are shown covering literature diodes as well as diodes fabricated with the purpose of validating the theoretical effort.


title: On the alternating randomized block Kaczmarz method

abstract: The block Kaczmarz method and its variants are designed for solving the over-determined linear system. They involve iteratively projecting the current point onto the solution space of a subset of constraints. In this work, by alternately dealing with two subproblems (i.e., linear system with multiple right-hand sides) using the block Kaczmarz method, we propose the {\it Alternating Randomized Block Kaczmarz} (ARBK) method to solve the linear matrix equation $AXB=F$, which incorporates a randomized index selection scheme to determine the subset of constraints. The convergence analysis reveals that the ARBK method has a linear convergence rate bounded by an explicit expression. Several numerical studies have been conducted to validate the theoretical findings.


title: An $(\infty,n)$-categorical pasting theorem

abstract: We identify a reasonably large class of pushouts of strict $n$-categories which are preserved by the "inclusion" functor from strict $n$-categories to weak $(\infty,n)$-categories. These include the pushouts used to assemble from its generating cells any object of Joyal's category $\Theta$, any of Street's orientals, any lax Gray cube, and more generally any "regular directed CW complex." More precisely, the theorem applies to any \emph{torsion-free complex} in the sense of Forest -- a corrected version of Street's \emph{parity complexes}. This result may be regarded as partial progress toward Henry's conjecture that the pushouts assembling any non-unital computad are similarly preserved by the "inclusion" into weak $(\infty,n)$-categories. In future work we shall apply this result to give new models of $(\infty,n)$-categories as presheaves on torsion-free complexes, and to construct the Gray tensor product of weak $(\infty,n)$-categories. This result is deduced from an \emph{$(\infty,n)$-categorical pasting theorem}, in the spirit of Power's 2-categorical and $n$-categorical pasting theorems, and the $(\infty,2)$-categorical pasting theorems of Columbus and of Hackney, Ozornova, Riehl, and Rovelli. This says that, when assembling a "pasting diagram" from its generating cells, the space of "composite cells which can be pasted together from all of the generators" is contractible.


title: Federated Natural Policy Gradient Methods for Multi-task Reinforcement Learning

abstract: Federated reinforcement learning (RL) enables collaborative decision making of multiple distributed agents without sharing local data trajectories. In this work, we consider a multi-task setting, in which each agent has its own private reward function corresponding to different tasks, while sharing the same transition kernel of the environment. Focusing on infinite-horizon tabular Markov decision processes, the goal is to learn a globally optimal policy that maximizes the sum of the discounted total rewards of all the agents in a decentralized manner, where each agent only communicates with its neighbors over some prescribed graph topology. We develop federated vanilla and entropy-regularized natural policy gradient (NPG) methods under softmax parameterization, where gradient tracking is applied to the global Q-function to mitigate the impact of imperfect information sharing. We establish non-asymptotic global convergence guarantees under exact policy evaluation, which are nearly independent of the size of the state-action space and illuminate the impacts of network size and connectivity. To the best of our knowledge, this is the first time that global convergence is established for federated multi-task RL using policy optimization. Moreover, the convergence behavior of the proposed algorithms is robust against inexactness of policy evaluation.


title: On the Gaussian product inequality conjecture for disjoint principal minors of Wishart random matrices

abstract: This paper extends various results related to the Gaussian product inequality (GPI) conjecture to the setting of disjoint principal minors of Wishart random matrices. This includes product-type inequalities for matrix-variate analogs of completely monotone functions and Bernstein functions of Wishart disjoint principal minors, respectively. In particular, the product-type inequalities apply to inverse determinant powers. Quantitative versions of the inequalities are also obtained when there is a mix of positive and negative exponents. Furthermore, an extended form of the GPI is shown to hold for the eigenvalues of Wishart random matrices by virtue of their law being multivariate totally positive of order~2 ($\mathrm{MTP}_2$). A new, unexplored avenue of research is presented to study the GPI from the point of view of elliptical distributions.


title: Modeling subjectivity (by Mimicking Annotator Annotation) in toxic comment identification across diverse communities

abstract: The prevalence and impact of toxic discussions online have made content moderation crucial.Automated systems can play a vital role in identifying toxicity, and reducing the reliance on human moderation.Nevertheless, identifying toxic comments for diverse communities continues to present challenges that are addressed in this paper.The two-part goal of this study is to(1)identify intuitive variances from annotator disagreement using quantitative analysis and (2)model the subjectivity of these viewpoints.To achieve our goal, we published a new dataset\footnote{\url{https://github.com/XXX}} with expert annotators' annotations and used two other public datasets to identify the subjectivity of toxicity.Then leveraging the Large Language Model(LLM),we evaluate the model's ability to mimic diverse viewpoints on toxicity by varying size of the training data and utilizing same set of annotators as the test set used during model training and a separate set of annotators as the test set.We conclude that subjectivity is evident across all annotator groups, demonstrating the shortcomings of majority-rule voting. Moving forward, subjective annotations should serve as ground truth labels for training models for domains like toxicity in diverse communities.


title: Continuous Training and Fine-tuning for Domain-Specific Language Models in Medical Question Answering

abstract: Large language models exhibit promising general capabilities but often lack specialized knowledge for domain-specific tasks. Developing domain experts from a base model enables a range of applications without prohibitive training costs. This work demonstrates a method using continuous training and instruction fine-tuning to rapidly adapt Llama 2 base models to the Chinese medical domain. We first conduct continuous training on 1B tokens from Chinese medical references to teach relevant vocabulary and knowledge. The models are then fine-tuned on 54K examples sourced from the Chinese National Medical Licensing Examination. Experiments on Chinese medical data confirm the effectiveness of this approach, producing a model comparable to GPT-3.5-turbo while using way less computational resource. The resulting domain-specific model could be useful for various Chinese medical applications. More broadly, this provides a template for domain-specific training of large language models in areas where pre-trained models lack the required expertise, such as law, science, and engineering.


title: The Gray tensor product of $(\infty,n)$-categories

abstract: In this note, we leverage the author's pasting theorem for $(\infty,n)$-categories to construct new models of $(\infty,n)$-categories for all $n \leq \infty$, as presheaves on certain categories of computads. Among these new models are some which facilitate a construction of the Gray tensor product of $(\infty,n)$-categories Day convolution and reflection, which we carry out here. After constructing this Gray tensor product of $(\infty,n)$-categories, we characterize it via several model-independent universal properties.


title: ChatGPT-Powered Hierarchical Comparisons for Image Classification

abstract: The zero-shot open-vocabulary challenge in image classification is tackled by pretrained vision-language models like CLIP, which benefit from incorporating class-specific knowledge from large language models (LLMs) like ChatGPT. However, biases in CLIP lead to similar descriptions for distinct but related classes, prompting our novel image classification framework via hierarchical comparisons: using LLMs to recursively group classes into hierarchies and classifying images by comparing image-text embeddings at each hierarchy level, resulting in an intuitive, effective, and explainable approach.


title: Magmaw: Modality-Agnostic Adversarial Attacks on Machine Learning-Based Wireless Communication Systems

abstract: Machine Learning (ML) has been instrumental in enabling joint transceiver optimization by merging all physical layer blocks of the end-to-end wireless communication systems. Although there have been a number of adversarial attacks on ML-based wireless systems, the existing methods do not provide a comprehensive view including multi-modality of the source data, common physical layer components, and wireless domain constraints. This paper proposes Magmaw, the first black-box attack methodology capable of generating universal adversarial perturbations for any multimodal signal transmitted over a wireless channel. We further introduce new objectives for adversarial attacks on ML-based downstream applications. The resilience of the attack to the existing widely used defense methods of adversarial training and perturbation signal subtraction is experimentally verified. For proof-of-concept evaluation, we build a real-time wireless attack platform using a software-defined radio system. Experimental results demonstrate that Magmaw causes significant performance degradation even in the presence of the defense mechanisms. Surprisingly, Magmaw is also effective against encrypted communication channels and conventional communications.


title: What Formal Languages Can Transformers Express? A Survey

abstract: As transformers have gained prominence in natural language processing, some researchers have investigated theoretically what problems they can and cannot solve, by treating problems as formal languages. Exploring such questions can help clarify the power of transformers relative to other models of computation, their fundamental capabilities and limits, and the impact of architectural choices. Work in this subarea has made considerable progress in recent years. Here, we undertake a comprehensive survey of this work, documenting the diverse assumptions that underlie different results and providing a unified framework for harmonizing seemingly contradictory findings.


title: Onsager-Machlup functional for $\text{SLE}_{\kappa}$ loop measures

abstract: We relate two ways to renormalize the Brownian loop measure on the Riemann sphere. One by considering the Brownian loop measure on the sphere minus a small disk, known as the normalized Brownian loop measure; the other by taking the measure on simple loops induced by the outer boundary of the Brownian loops, known as Werner's measure. This result allows us to interpret the Loewner energy as an Onsager--Machlup functional for SLE$_\kappa$ loop measure for any fixed $\kappa \in (0, 4]$, and more generally, for any Malliavin--Kontsevich--Suhov loop measure of the same central charge.


title: Broken Adaptive Ridge Method for Variable Selection in Generalized Partly Linear Models with Application to the Coronary Artery Disease Data

abstract: Motivated by the CATHGEN data, we develop a new statistical learning method for simultaneous variable selection and parameter estimation under the context of generalized partly linear models for data with high-dimensional covariates. The method is referred to as the broken adaptive ridge (BAR) estimator, which is an approximation of the $L_0$-penalized regression by iteratively performing reweighted squared $L_2$-penalized regression. The generalized partly linear model extends the generalized linear model by including a non-parametric component to construct a flexible model for modeling various types of covariate effects. We employ the Bernstein polynomials as the sieve space to approximate the non-parametric functions so that our method can be implemented easily using the existing R packages. Extensive simulation studies suggest that the proposed method performs better than other commonly used penalty-based variable selection methods. We apply the method to the CATHGEN data with a binary response from a coronary artery disease study, which motivated our research, and obtained new findings in both high-dimensional genetic and low-dimensional non-genetic covariates.


title: Anachronic Tertiary Studies in Software Engineering: An Exploratory Quaternary Study

abstract: Systematic literature reviews tentativelydescribe the state of the art in a given research area. However, the continuous publication of new primary and secondary studies following the release of a tertiary study can make the communication of results not integrally representative in regards to the advances achieved by that time. Consequently, using such a study as a reference within specific bodies of knowledge may introduce imprecision, both in terms of its subareas and with respect to new methodologies, languages, and tools. Thus, a review of tertiary studies (what could be understood as a quaternary study) could contribute to show the representativeness of the reported findings in comparison to the state of the art and also to compile a set of perceptions that could not be previously achieved. In that direction, the main contribution of this paper is presenting the findings from an analysis of 34 software engineering tertiary studies published between 2009 and 2021. The results indicate that over 60% of the studies demonstrate varying degrees of anachronism due to the publication of primary and secondary studies following the publication of the tertiary study or even due to a time elapse between its conduction and its publication.


title: A Unified Framework to Enforce, Discover, and Promote Symmetry in Machine Learning

abstract: Symmetry is present throughout nature and continues to play an increasingly central role in physics and machine learning. Fundamental symmetries, such as Poincar\'{e} invariance, allow physical laws discovered in laboratories on Earth to be extrapolated to the farthest reaches of the universe. Symmetry is essential to achieving this extrapolatory power in machine learning applications. For example, translation invariance in image classification allows models with fewer parameters, such as convolutional neural networks, to be trained on smaller data sets and achieve state-of-the-art performance. In this paper, we provide a unifying theoretical and methodological framework for incorporating symmetry into machine learning models in three ways: 1. enforcing known symmetry when training a model; 2. discovering unknown symmetries of a given model or data set; and 3. promoting symmetry during training by learning a model that breaks symmetries within a user-specified group of candidates when there is sufficient evidence in the data. We show that these tasks can be cast within a common mathematical framework whose central object is the Lie derivative associated with fiber-linear Lie group actions on vector bundles. We extend and unify several existing results by showing that enforcing and discovering symmetry are linear-algebraic tasks that are dual with respect to the bilinear structure of the Lie derivative. We also propose a novel way to promote symmetry by introducing a class of convex regularization functions based on the Lie derivative and nuclear norm relaxation to penalize symmetry breaking during training of machine learning models. We explain how these ideas can be applied to a wide range of machine learning models including basis function regression, dynamical systems discovery, multilayer perceptrons, and neural networks acting on spatial fields such as images.


title: Consistent Video-to-Video Transfer Using Synthetic Dataset

abstract: We introduce a novel and efficient approach for text-based video-to-video editing that eliminates the need for resource-intensive per-video-per-model finetuning. At the core of our approach is a synthetic paired video dataset tailored for video-to-video transfer tasks. Inspired by Instruct Pix2Pix's image transfer via editing instruction, we adapt this paradigm to the video domain. Extending the Prompt-to-Prompt to videos, we efficiently generate paired samples, each with an input video and its edited counterpart. Alongside this, we introduce the Long Video Sampling Correction during sampling, ensuring consistent long videos across batches. Our method surpasses current methods like Tune-A-Video, heralding substantial progress in text-based video-to-video editing and suggesting exciting avenues for further exploration and deployment.


title: WinNet: Make Only One Convolutional Layer Effective for Time Series Forecasting

abstract: Deep learning models have recently achieved significant performance improvements in time series forecasting. We present a highly accurate and simply structured CNN-based model with only one convolutional layer, called WinNet, including (i) Sub-window Division block to transform the series into 2D tensor, (ii) Dual-Forecasting mechanism to capture the short- and long-term variations, (iii) Two-dimensional Hybrid Decomposition (TDD) block to decompose the 2D tensor into the trend and seasonal terms to eliminate the non-stationarity, and (iv) Decomposition Correlation Block (DCB) to leverage the correlation between the trend and seasonal terms by the convolution layer. Results on eight benchmark datasets demonstrate that WinNet can achieve SOTA performance and lower computational complexity over CNN-, MLP- and Transformer-based methods. The code will be available at: https://github.com/ouwen18/WinNet.


title: An effective description of Laniakea: impact on cosmology and the local determination of the Hubble constant

abstract: We propose an effective model to describe the bias induced on cosmological observables by Laniakea, the gravitational supercluster hosting the Milky Way, which was defined using peculiar velocity data from Cosmicflows-4 (CF4). The structure is well described by an ellipsoidal shape exhibiting triaxial expansion, reasonably approximated by a constant expansion rate along the principal axes. Our best fits suggest that the ellipsoid, after subtracting the background expansion, contracts along the two smaller axes and expands along the longest one, predicting an average expansion of $\sim -1.1 ~\rm{km}/\rm{s}/\rm{Mpc}$. The different expansion rates within the region, relative to the mean cosmological expansion, induce line-of-sight-dependent corrections in the computation of luminosity distances. We apply these corrections to two low-redshift datasets: the Pantheon+ catalog of type Ia Supernovae (SN~Ia), and 63 measurements of Surface Brightness Fluctuations (SBF) of early-type massive galaxies from the MASSIVE survey. We find corrections on the distances of order $\sim 2-3\%$, resulting in a shift in the inferred best-fit values of the Hubble constant $H_0$ of order $\Delta H_0^{\rm{SN~Ia}}\approx 0.5 ~\rm{km}/\rm{s}/\rm{Mpc}$ and $\Delta H_0^{\rm{SBF}}\approx 1.1 ~\rm{km}/\rm{s}/\rm{Mpc}$, seemingly worsening the Hubble tension.


title: FPGA-based residual amplitude modulation suppression and control for compact atomic clocks

abstract: We designed an FPGA fabric to provide phase modulation techniques to lock lasers to optical frequency references. The method incorporates an active residual-amplitude-modulation (RAM) suppression scheme that relies on complex modulation. All the required servos to construct an optical atomic clock are incorporated onto the same low-cost, commercial FPGA chip. We demonstrate a reliable, long-term RAM suppression 60 dB with the remaining RAM level at -100 dBc and an improved stability of three decades when applied on a two-photon rubidium clock.


title: Can Large Language Models Capture Public Opinion about Global Warming? An Empirical Assessment of Algorithmic Fidelity and Bias

abstract: Large language models (LLMs) have demonstrated their potential in social science research by emulating human perceptions and behaviors, a concept referred to as algorithmic fidelity. This study assesses the algorithmic fidelity and bias of LLMs by utilizing two nationally representative climate change surveys. The LLMs were conditioned on demographics and/or psychological covariates to simulate survey responses. The findings indicate that LLMs can effectively capture presidential voting behaviors but encounter challenges in accurately representing global warming perspectives when relevant covariates are not included. GPT-4 exhibits improved performance when conditioned on both demographics and covariates. However, disparities emerge in LLM estimations of the views of certain groups, with LLMs tending to underestimate worry about global warming among Black Americans. While highlighting the potential of LLMs to aid social science research, these results underscore the importance of meticulous conditioning, model selection, survey question format, and bias assessment when employing LLMs for survey simulation. Further investigation into prompt engineering and algorithm auditing is essential to harness the power of LLMs while addressing their inherent limitations.


title: On the solutions of nonlocal 1-Laplacian equation with $L^1$-data

abstract: We study the solutions to a nonlocal 1-Laplacian equation given by $$ 2\text{P.V.}\int_{\mathbb{R}^N}\frac{u(x)-u(y)}{|u(x)-u(y)|} \frac{dy}{|x-y|^{N+s}}=f(x) \quad \textmd{for } x\in \Omega, $$ with Dirichlet boundary condition $u(x)=0$ in $\mathbb R^N\backslash \Omega$ and nonnegative $L^1$-data. By investigating the asymptotic behaviour of renormalized solutions $u_p$ to the nonlocal $p$-Laplacian equations as $p$ goes to $1^+$, we introduce a suitable definition of solutions and prove that the limit function $u$ of $\{u_p\}$ is a solution of the nonlocal $1$-Laplacian equation above.


title: The free boundary for a semilinear non-homogeneous Bernoulli problem

abstract: In the classical homogeneous one-phase Bernoulli-type problem, the free boundary consists of a "regular" part and a "singular" part, as Alt and Caffarelli have shown in their pioneer work (J. Reine Angew. Math., 325, 105-144, 1981) that regular points are $C^{1,\gamma}$ in two-dimensions. Later, Weiss (J. Geom. Anal., 9, 317-326, 1999) first realized that in higher dimensions a critical dimension $d^{*}$ exists so that the singularities of the free boundary can only occur when $d\geqslant d^{*}$. In this paper, we consider a non-homogeneous semilinear one-phase Bernoulli-type problem, and we show that the free boundary is a disjoint union of a regular and a singular set. Moreover, the regular set is locally the graph of a $C^{1,\gamma}$ function for some $\gamma\in(0,1)$. In addition, there exists a critical dimension $d^{*}$ so that the singular set is empty if $d<d^{*}$, discrete if $d=d^{*}$ and of locally finite $\mathcal{H}^{d-d^{*}}$ Hausdorff measure if $d>d^{*}$. As a byproduct, we relate the existence of viscosity solutions of a non-homogeneous problem to the Weiss-boundary adjusted energy, which provides an alternative proof to existence of viscosity solutions for non-homogeneous problems.


title: Generalized trace submodules and centers of endomorphism rings

abstract: Let $R$ be a commutative Noetherian local ring and $M$ a finitely generated $R$-module. We introduce a general form of the classically studied trace map that unifies several notions from the literature. We develop a theory around these objects and use it to provide a broad extension of a result of Lindo calculating the center of $\operatorname{End}_R(M)$. As a consequence, we show under mild hypotheses that in dimension $1$, the canonical module of $Z(\operatorname{End}_R(M))$ may be calculated as the trace submodule of $M$ with respect to the canonical module of $R$.


title: Sobolev inequalities on K\"ahler spaces

abstract: We establish a uniform Sobolev inequality for K\"ahler metrics, which only require an entropy bound and no lower bound on the Ricci curvature. We further extend our Sobolev inequality to singular K\"ahler metrics on K\"ahler spaces with normal singularities. This allows us to build a general theory of global geometric analysis on singular K\"ahler spaces including the spectral theorem, heat kernel estimates, eigenvalue estimates and diameter estimates. Such estimates were only known previously in very special cases such as Bergman metrics. As a consequence, we derive various geometric estimates, such as the diameter estimate and the Sobolev inequality, for K\"ahler-Einstein currents on projective varieties with definite or vanishing first Chern class.


title: Distributed Task Allocation for Self-Interested Agents with Partially Unknown Rewards

abstract: This paper provides a novel solution to a task allocation problem, by which a group of agents decides on the assignment of a discrete set of tasks in a distributed manner. In this setting, heterogeneous agents have individual preferences and associated rewards for doing each task; however, these rewards are only known asymptotically. We start by formulating the assignment problem by means of a combinatorial partition game for known rewards, with no constraints on number of tasks per agent. We relax this into a weight game, which together with the former, are shown to contain the optimal task allocation in the corresponding set of Nash Equilibria (NE). We then propose a projected, best-response, ascending gradient dynamics (PBRAG) that converges to a NE in finite time. This forms the basis of a distributed online version that can deal with a converging sequence of rewards by means of an agreement sub-routine. We present simulations that support our results


title: Is GPT Powerful Enough to Analyze the Emotions of Memes?

abstract: Large Language Models (LLMs), representing a significant achievement in artificial intelligence (AI) research, have demonstrated their ability in a multitude of tasks. This project aims to explore the capabilities of GPT-3.5, a leading example of LLMs, in processing the sentiment analysis of Internet memes. Memes, which include both verbal and visual aspects, act as a powerful yet complex tool for expressing ideas and sentiments, demanding an understanding of societal norms and cultural contexts. Notably, the detection and moderation of hateful memes pose a significant challenge due to their implicit offensive nature. This project investigates GPT's proficiency in such subjective tasks, revealing its strengths and potential limitations. The tasks include the classification of meme sentiment, determination of humor type, and detection of implicit hate in memes. The performance evaluation, using datasets from SemEval-2020 Task 8 and Facebook hateful memes, offers a comparative understanding of GPT responses against human annotations. Despite GPT's remarkable progress, our findings underscore the challenges faced by these models in handling subjective tasks, which are rooted in their inherent limitations including contextual understanding, interpretation of implicit meanings, and data biases. This research contributes to the broader discourse on the applicability of AI in handling complex, context-dependent tasks, and offers valuable insights for future advancements.


title: Domain decomposition-based coupling of physics-informed neural networks via the Schwarz alternating method

abstract: Physics-informed neural networks (PINNs) are appealing data-driven tools for solving and inferring solutions to nonlinear partial differential equations (PDEs). Unlike traditional neural networks (NNs), which train only on solution data, a PINN incorporates a PDE's residual into its loss function and trains to minimize the said residual at a set of collocation points in the solution domain. This paper explores the use of the Schwarz alternating method as a means to couple PINNs with each other and with conventional numerical models (i.e., full order models, or FOMs, obtained via the finite element, finite difference or finite volume methods) following a decomposition of the physical domain. It is well-known that training a PINN can be difficult when the PDE solution has steep gradients. We investigate herein the use of domain decomposition and the Schwarz alternating method as a means to accelerate the PINN training phase. Within this context, we explore different approaches for imposing Dirichlet boundary conditions within each subdomain PINN: weakly through the loss and/or strongly through a solution transformation. As a numerical example, we consider the one-dimensional steady state advection-diffusion equation in the advection-dominated (high Peclet) regime. Our results suggest that the convergence of the Schwarz method is strongly linked to the choice of boundary condition implementation within the PINNs being coupled. Surprisingly, strong enforcement of the Schwarz boundary conditions does not always lead to a faster convergence of the method. While it is not clear from our preliminary study that the PINN-PINN coupling via the Schwarz alternating method accelerates PINN convergence in the advection-dominated regime, it reveals that PINN training can be improved substantially for Peclet numbers as high as 1e6 by performing a PINN-FOM coupling.


title: Improving MIMO channel estimation via receive power feedback

abstract: Estimating the channel state is known to be an important problem in wireless networks. To this end, it matters to exploit all the available information to improve channel estimation accuracy as much as possible. It turns out that the problem of exploiting the information associated with the receive power feedback (e.g., the received signal strength indicator -RSSI-) has not been identified and solved; in this setup, the transmitter is assumed to receive feedback from all the receivers in presence. As shown in this paper, to solve this problem, classical estimation tools can be used. Using the corresponding MMSE is shown to be always beneficial, whereas the relevance of using the MAP estimator would depend on the operating SNR.


title: Transformers are Provably Optimal In-context Estimators for Wireless Communications

abstract: Pre-trained transformers exhibit the capability of adapting to new tasks through in-context learning (ICL), where they efficiently utilize a limited set of prompts without explicit model optimization. The canonical communication problem of estimating transmitted symbols from received observations can be modelled as an in-context learning problem: Received observations are essentially a noisy function of transmitted symbols, and this function can be represented by an unknown parameter whose statistics depend on an (also unknown) latent context. This problem, which we term in-context estimation (ICE), has significantly greater complexity than the extensively studied linear regression problem. The optimal solution to the ICE problem is a non-linear function of the underlying context. In this paper, we prove that, for a subclass of such problems, a single layer softmax attention transformer (SAT) computes the optimal solution of the above estimation problem in the limit of large prompt length. We also prove that the optimal configuration of such transformer is indeed the minimizer of the corresponding training loss. Further, we empirically demonstrate the proficiency of multi-layer transformers in efficiently solving broader in-context estimation problems. Through extensive simulations, we show that solving ICE problems using transformers significantly outperforms standard approaches. Moreover, just with a few context examples, it achieves the same performance as an estimator with perfect knowledge of the latent context.


title: StableFDG: Style and Attention Based Learning for Federated Domain Generalization

abstract: Traditional federated learning (FL) algorithms operate under the assumption that the data distributions at training (source domains) and testing (target domain) are the same. The fact that domain shifts often occur in practice necessitates equipping FL methods with a domain generalization (DG) capability. However, existing DG algorithms face fundamental challenges in FL setups due to the lack of samples/domains in each client's local dataset. In this paper, we propose StableFDG, a style and attention based learning strategy for accomplishing federated domain generalization, introducing two key contributions. The first is style-based learning, which enables each client to explore novel styles beyond the original source domains in its local dataset, improving domain diversity based on the proposed style sharing, shifting, and exploration strategies. Our second contribution is an attention-based feature highlighter, which captures the similarities between the features of data samples in the same class, and emphasizes the important/common characteristics to better learn the domain-invariant characteristics of each class in data-poor FL scenarios. Experimental results show that StableFDG outperforms existing baselines on various DG benchmark datasets, demonstrating its efficacy.


title: Performance limits due to thermal transport in graphene single-photon bolometers

abstract: In high-sensitivity bolometers and calorimeters, the photon absorption often occurs at a finite distance from the temperature sensor to accommodate antennas or avoid the degradation of superconducting circuitry exposed to radiation. As a result, thermal propagation from the input to the temperature readout can critically affect detector performance. In this report we model the performance of a graphene bolometer, accounting for electronic thermal diffusion and dissipation via electron-phonon coupling at low temperatures in three regimes: clean, supercollision, and resonant scattering. Our results affirm the feasibility of a superconducting readout without Cooper-pair breaking by mid- and near-infrared photons, and provide a recipe for designing graphene absorbers for calorimetric single-photon detectors. We investigate the tradeoff between the input-readout distance and detector efficiency, and predict an intrinsic timing jitter of ~2.7 ps. Based on our result, we propose a spatial-mode-resolving photon detector to increase communication bandwidth.


title: Orientation-preserving homeomorphisms of Euclidean space are commutators

abstract: We prove that every orientation-preserving homeomorphism of Euclidean space can be expressed as a commutator. We establish an analogous result for annuli.


title: DINO-Mix: Enhancing Visual Place Recognition with Foundational Vision Model and Feature Mixing

abstract: Utilizing visual place recognition (VPR) technology to ascertain the geographical location of publicly available images is a pressing issue for real-world VPR applications. Although most current VPR methods achieve favorable results under ideal conditions, their performance in complex environments, characterized by lighting variations, seasonal changes, and occlusions caused by moving objects, is generally unsatisfactory. In this study, we utilize the DINOv2 model as the backbone network for trimming and fine-tuning to extract robust image features. We propose a novel VPR architecture called DINO-Mix, which combines a foundational vision model with feature aggregation. This architecture relies on the powerful image feature extraction capabilities of foundational vision models. We employ an MLP-Mixer-based mix module to aggregate image features, resulting in globally robust and generalizable descriptors that enable high-precision VPR. We experimentally demonstrate that the proposed DINO-Mix architecture significantly outperforms current state-of-the-art (SOTA) methods. In test sets having lighting variations, seasonal changes, and occlusions (Tokyo24/7, Nordland, SF-XL-Testv1), our proposed DINO-Mix architecture achieved Top-1 accuracy rates of 91.75%, 80.18%, and 82%, respectively. Compared with SOTA methods, our architecture exhibited an average accuracy improvement of 5.14%.


title: DistDNAS: Search Efficient Feature Interactions within 2 Hours

abstract: Search efficiency and serving efficiency are two major axes in building feature interactions and expediting the model development process in recommender systems. On large-scale benchmarks, searching for the optimal feature interaction design requires extensive cost due to the sequential workflow on the large volume of data. In addition, fusing interactions of various sources, orders, and mathematical operations introduces potential conflicts and additional redundancy toward recommender models, leading to sub-optimal trade-offs in performance and serving cost. In this paper, we present DistDNAS as a neat solution to brew swift and efficient feature interaction design. DistDNAS proposes a supernet to incorporate interaction modules of varying orders and types as a search space. To optimize search efficiency, DistDNAS distributes the search and aggregates the choice of optimal interaction modules on varying data dates, achieving over 25x speed-up and reducing search cost from 2 days to 2 hours. To optimize serving efficiency, DistDNAS introduces a differentiable cost-aware loss to penalize the selection of redundant interaction modules, enhancing the efficiency of discovered feature interactions in serving. We extensively evaluate the best models crafted by DistDNAS on a 1TB Criteo Terabyte dataset. Experimental evaluations demonstrate 0.001 AUC improvement and 60% FLOPs saving over current state-of-the-art CTR models.


title: Mechanically-Inflatable Bio-Inspired Locomotion for Robotic Pipeline Inspection

abstract: Pipelines, vital for fluid transport, pose an important yet challenging inspection task, particularly in small, flexible biological systems, that robots have yet to master. In this study, we explored the development of an innovative robot inspired by the ovipositor of parasitic wasps to navigate and inspect pipelines. The robot features a flexible locomotion system that adapts to different tube sizes and shapes through a mechanical inflation technique. The flexible locomotion system employs a reciprocating motion, in which groups of three sliders extend and retract in a cyclic fashion. In a proof-of-principle experiment, the robot locomotion efficiency demonstrated positive linear correlation (r=0.6434) with the diameter ratio (ratio of robot diameter to tube diameter). The robot showcased a remarkable ability to traverse tubes of different sizes, shapes and payloads with an average of (70%) locomotion efficiency across all testing conditions, at varying diameter ratios (0.7-1.5). Furthermore, the mechanical inflation mechanism displayed substantial load-carrying capacity, producing considerable holding force of (13 N), equivalent to carrying a payload of approximately (5.8 Kg) inclusive the robot weight. This novel soft robotic system shows promise for inspection and navigation within tubular confined spaces, particularly in scenarios requiring adaptability to different tube shapes, sizes, and load-carrying capacities. This novel design serves as a foundation for a new class of pipeline inspection robots that exhibit versatility across various pipeline environments, potentially including biological systems.


title: Instructive Decoding: Instruction-Tuned Large Language Models are Self-Refiner from Noisy Instructions

abstract: While instruction-tuned language models have demonstrated impressive zero-shot generalization, these models often struggle to generate accurate responses when faced with instructions that fall outside their training set. This paper presents Instructive Decoding (ID), a simple yet effective approach that augments the efficacy of instruction-tuned models. Specifically, ID adjusts the logits for next-token prediction in a contrastive manner, utilizing predictions generated from a manipulated version of the original instruction, referred to as a noisy instruction. This noisy instruction aims to elicit responses that could diverge from the intended instruction yet remain plausible. We conduct experiments across a spectrum of such noisy instructions, ranging from those that insert semantic noise via random words to others like 'opposite' that elicit the deviated responses. Our approach achieves considerable performance gains across various instruction-tuned models and tasks without necessitating any additional parameter updates. Notably, utilizing 'opposite' as the noisy instruction in ID, which exhibits the maximum divergence from the original instruction, consistently produces the most significant performance gains across multiple models and tasks.


title: Pulsar Timing Array Signature from Oscillating Metric Perturbations due to Ultra-light Axion

abstract: A coherently oscillating ultra-light axion can behave as dark matter. In particular, its coherently oscillating pressure perturbations can source an oscillating scalar metric perturbation, with a characteristic oscillation frequency which is twice the axion Compton frequency. A candidate in the mass range $10^{(-24,-21)}{\rm eV}$ can provide a signal in the frequency range tested by current and future Pulsar Timing Array (PTA) programs. Involving the pressure perturbations in a highly nonlinear environment, such an analysis demands a relativistic and nonlinear treatment. Here, we provide a rigorous derivation of the effect assuming weak gravity and slow-motion limit of Einstein's gravity in zero-shear gauge and show that dark matter's velocity potential determines the oscillation phase and frequency change. A monochromatic PTA signal correlated with the velocity field would confirm the prediction, for example, by cross-correlating the PTA results with the future local velocity flow measurements.


title: Implicit biases in multitask and continual learning from a backward error analysis perspective

abstract: Using backward error analysis, we compute implicit training biases in multitask and continual learning settings for neural networks trained with stochastic gradient descent. In particular, we derive modified losses that are implicitly minimized during training. They have three terms: the original loss, accounting for convergence, an implicit flatness regularization term proportional to the learning rate, and a last term, the conflict term, which can theoretically be detrimental to both convergence and implicit regularization. In multitask, the conflict term is a well-known quantity, measuring the gradient alignment between the tasks, while in continual learning the conflict term is a new quantity in deep learning optimization, although a basic tool in differential geometry: The Lie bracket between the task gradients.


title: Objectives and Key Results in Software Teams: Challenges, Opportunities and Impact on Development

abstract: Building software, like building almost anything, requires people to understand a common goal and work together towards it. In large software companies, a VP or Director will have an idea or goal and it is often the job of middle management to distill that lofty, general idea into manageable, finite units of work. How do organizations do this hard work of setting and measuring progress towards goals? To understand this question, we undertook a mixed methods approach to studying goal setting, management dissemination of goals, goal tracking and ultimately software delivery at a large multi-national software company. Semi-structured interviews with 47 participants were analyzed and used to develop a survey which was deployed to a multi-national team of over 4,000 engineers. The 512 responses were analyzed using thematic analysis, linear regressions and hypothesis testing, and found that tracking, measuring and setting goals is hard work, regardless of tools used. Middle management seems to be a critical component of the translation of lofty goals to actionable work items. In addition, attitudes and beliefs of engineers are critical to the success of any goal setting framework. Based on this research, we make recommendations on how to improve the goal setting and OKR process in software organizations: invest in the data pipeline, increase transparency, improve communication, promote learning communities, and a structured roll out of OKRs.


title: The Mystery of In-Context Learning: A Comprehensive Survey on Interpretation and Analysis

abstract: Understanding in-context learning (ICL) capability that enables large language models (LLMs) to excel in proficiency through demonstration examples is of utmost importance. This importance stems not only from the better utilization of this capability across various tasks, but also from the proactive identification and mitigation of potential risks, including concerns regarding truthfulness, bias, and toxicity, that may arise alongside the capability. In this paper, we present a thorough survey on the interpretation and analysis of in-context learning. First, we provide a concise introduction to the background and definition of in-context learning. Then, we give an overview of advancements from two perspectives: 1) a theoretical perspective, emphasizing studies on mechanistic interpretability and delving into the mathematical foundations behind ICL; and 2) an empirical perspective, concerning studies that empirically analyze factors associated with ICL. We conclude by highlighting the challenges encountered and suggesting potential avenues for future research. We believe that our work establishes the basis for further exploration into the interpretation of in-context learning. Additionally, we have created a repository containing the resources referenced in our survey.


title: Updated Catalog of Kepler Planet Candidates: Focus on Accuracy and Orbital Periods

abstract: We present a new catalog of Kepler planet candidates that prioritizes accuracy of planetary dispositions and properties over uniformity. This catalog contains 4376 transiting planet candidates, including 1791 residing within 709 multi-planet systems, and provides the best parameters available for a large sample of Kepler planet candidates. We also provide a second set of stellar and planetary properties for transiting candidates that are uniformly-derived for use in occurrence rates studies. Estimates of orbital periods have been improved, but as in previous catalogs, our tabulated values for period uncertainties do not fully account for transit timing variations (TTVs). We show that many planets are likely to have TTVs with long periodicities caused by various processes, including orbital precession, and that such TTVs imply that ephemerides of Kepler planets are not as accurate on multi-decadal timescales as predicted by the small formal errors (typically 1 part in $10^6$ and rarely $ > 10^{-5}$) in the planets' measured mean orbital periods during the Kepler epoch. Analysis of normalized transit durations implies that eccentricities of planets are anti-correlated with the number of companion transiting planets. Our primary catalog lists all known Kepler planet candidates that orbit and transit only one star; for completeness, we also provide an abbreviated listing of the properties of the two dozen non-transiting planets that have been identified around stars that host transiting planets discovered by Kepler.


title: Gravitational Waves from Preheating in Inflation with Weyl Symmetry

abstract: Inflation with Weyl scaling symmetry provides a viable scenario that can generate both the nearly scaling invariant primordial density fluctuation and a dark matter candidate. Here we point out that, in additional to the primordial gravitational waves (GWs) from quantum fluctuations, the production of high-frequency GWs from preheating in such inflation models can provide an another probe of the inflationary dynamics. We conduct both linear analytical analysis and nonlinear numerical lattice simulation in a typical model. We find that significant stochastic GWs can be produced and the frequency band is located around $10^8$ Hz $\sim$ $10^9$ Hz, which might be probed by future resonance-cavity experiments.


title: Intell-dragonfly: A Cybersecurity Attack Surface Generation Engine Based On Artificial Intelligence-generated Content Technology

abstract: With the rapid development of the Internet, cyber security issues have become increasingly prominent. Traditional cyber security defense methods are limited in the face of ever-changing threats, so it is critical to seek innovative attack surface generation methods. This study proposes Intell-dragonfly, a cyber security attack surface generation engine based on artificial intelligence generation technology, to meet the challenges of cyber security. Based on ChatGPT technology, this paper designs an automated attack surface generation process, which can generate diversified and personalized attack scenarios, targets, elements and schemes. Through experiments in a real network environment, the effect of the engine is verified and compared with traditional methods, which improves the authenticity and applicability of the attack surface. The experimental results show that the ChatGPT-based method has significant advantages in the accuracy, diversity and operability of attack surface generation. Furthermore, we explore the strengths and limitations of the engine and discuss its potential applications in the field of cyber security. This research provides a novel approach to the field of cyber security that is expected to have a positive impact on defense and prevention of cyberthreats.


title: 1DFormer: a Transformer Architecture Learning 1D Landmark Representations for Facial Landmark Tracking

abstract: Recently, heatmap regression methods based on 1D landmark representations have shown prominent performance on locating facial landmarks. However, previous methods ignored to make deep explorations on the good potentials of 1D landmark representations for sequential and structural modeling of multiple landmarks to track facial landmarks. To address this limitation, we propose a Transformer architecture, namely 1DFormer, which learns informative 1D landmark representations by capturing the dynamic and the geometric patterns of landmarks via token communications in both temporal and spatial dimensions for facial landmark tracking. For temporal modeling, we propose a recurrent token mixing mechanism, an axis-landmark-positional embedding mechanism, as well as a confidence-enhanced multi-head attention mechanism to adaptively and robustly embed long-term landmark dynamics into their 1D representations; for structure modeling, we design intra-group and inter-group structure modeling mechanisms to encode the component-level as well as global-level facial structure patterns as a refinement for the 1D representations of landmarks through token communications in the spatial dimension via 1D convolutional layers. Experimental results on the 300VW and the TF databases show that 1DFormer successfully models the long-range sequential patterns as well as the inherent facial structures to learn informative 1D representations of landmark sequences, and achieves state-of-the-art performance on facial landmark tracking.


title: Search for eccentric NSBH and BNS mergers in the third observing run of Advanced LIGO and Virgo

abstract: The possible formation histories of neutron star binaries remain unresolved by current gravitational-wave catalogs. The detection of an eccentric binary system could be vital in constraining compact binary formation models. We present the first search for aligned spin eccentric neutron star-black hole binaries (NSBH) and the most sensitive search for aligned-spin eccentric binary neutron star (BNS) systems using data from the third observing run of the advanced LIGO and advanced Virgo detectors. No new statistically significant candidates are found; we constrain the local merger rate to be less than 150 $\text{Gpc}^{-3}\text{Yr}^{-1}$ for binary neutron stars in the field, and, 50, 100, and 70 $\text{Gpc}^{-3}\text{Yr}^{-1}$ for neutron star-black hole binaries in globular clusters, hierarchical triples and nuclear clusters, respectively, at the 90$\%$ confidence level if we assume that no sources have been observed from these populations. We predict the capabilities of upcoming and next-generation observatory networks; we investigate the ability of three LIGO ($\text{A}^{#}$) detectors and Cosmic Explorer CE (20km) + CE (40km) to use eccentric binary observations for determining the formation history of neutron star binaries. We find that 2 -- 100 years of observation with three $\text{A}^{#}$ observatories are required before we observe clearly eccentric NSBH binaries; this reduces to only 10 days -- 1 year with the CE detector network. CE will observe tens to hundreds of measurably eccentric binaries from each of the formation models we consider.


title: Hodge Classes in the Cohomology of Local Systems

abstract: We study the Hodge conjecture for certain families of varieties over arithmetic quotients of balls and Siegel domain of degree two. As a byproduct, we derive formulas for Hodge numbers in terms of automorphic forms.


title: A short-time drift propagator approach to the Fokker-Planck equation

abstract: The Fokker-Planck equation is a partial differential equation that describes the evolution of a probability distribution over time. It is used to model a wide range of physical and biological phenomena, such as diffusion, chemical reactions, and population dynamics. Solving the Fokker-Planck equation is a difficult task, as it involves solving a system of coupled nonlinear partial differential equations. In general, analytical solutions are not available and numerical methods must be used. In this research, we propose a novel approach to the solution of the Fokker-Planck equation in a short time interval. The numerical solution to the equation can be obtained iteratively using a new technique based on the short-time drift propagator. This new approach is different from the traditional methods, as the state-dependent drift function has been removed from the multivariate Gaussian integral component and is instead presented as a state-shifted element. We evaluated our technique employing a fundamental Wiener process with constant drift components in both one- and two-dimensional space. The results of the numerical calculation were found to be consistent with the exact solution. The proposed approach offers a promising new direction for research in this area.


title: Gauge Symmetry Breaking Lattice Regularizations and their Continuum Limit

abstract: Lattice regularizations are pivotal in the non-perturbative quantization of gauge field theories. Wilson's proposal to employ group-valued link fields simplifies the regularization of gauge fields in principal fiber bundles, preserving gauge symmetry within the discretized lattice theory. Maintaining gauge symmetry is desirable as its violation can introduce unwanted degrees of freedom. However, not all theories with gauge symmetries admit gauge-invariant lattice regularizations, as observed in general relativity where the diffeomorphism group serves as the gauge symmetry. In such cases, gauge symmetry-breaking regularizations become necessary. In this paper, we argue that a broken lattice gauge symmetry is acceptable as long as gauge symmetry is restored in the continuum limit. We propose a method to construct the continuum limit for a class of lattice-regularized Hamiltonian field theories, where the regularization breaks the Lie algebra of first-class constraints. Additionally, we offer an approach to represent the exact gauge group on the Hilbert space of the continuum theory. The considered class of theories is limited to those with first-class constraints linear in momenta, excluding the entire gauge group of general relativity but encompassing its subgroup of spatial diffeomorphisms. We discuss potential techniques for extending this quantization to the full gauge group.


title: RAUNE-Net: A Residual and Attention-Driven Underwater Image Enhancement Method

abstract: Underwater image enhancement (UIE) poses challenges due to distinctive properties of the underwater environment, including low contrast, high turbidity, visual blurriness, and color distortion. In recent years, the application of deep learning has quietly revolutionized various areas of scientific research, including UIE. However, existing deep learning-based UIE methods generally suffer from issues of weak robustness and limited adaptability. In this paper, inspired by residual and attention mechanisms, we propose a more reliable and reasonable UIE network called RAUNE-Net by employing residual learning of high-level features at the network's bottle-neck and two aspects of attention manipulations in the down-sampling procedure. Furthermore, we collect and create two datasets specifically designed for evaluating UIE methods, which contains different types of underwater distortions and degradations. The experimental validation demonstrates that our method obtains promising objective performance and consistent visual results across various real-world underwater images compared to other eight UIE methods. Our example code and datasets are publicly available at https://github.com/fansuregrin/RAUNE-Net.


title: Tuning of Berry Curvature Dipole in TaAs slabs: An effective Route to Enhance Nonlinear Hall Response

abstract: In materials without inversion symmetry, Berry curvature dipole (BCD) arises from the uneven distribution of Berry curvature in momentum space. This leads to nonlinear anomalous Hall effects even in systems with preserved time-reversal symmetry. A key goal is to engineer systems with prominent BCD near the Fermi level. Notably, TaAs, a type-I Weyl semimetal, exhibits substantial Berry curvature but a small BCD around the Fermi level. In this study, we employed first-principles methods to comprehensively investigate the BCD in TaAs. Our findings reveal significant cancellation effects not only within individual Weyl points but crucially, among distinct Weyl point pairs in bulk TaAs. We propose a strategic approach to enhance the BCD in TaAs by employing a layer-stacking technique. This greatly amplifies the BCD compared to the bulk material. By tuning the number of slab layers, we can selectively target specific Weyl point pairs near the Fermi level, while quantum confinement effects suppress contributions from other pairs, mitigating cancellation effects. Especially, the BCD of an 8-layer TaAs slab surpasses the bulk value near the Fermi level by orders of magnitude.


title: Complexity of Dynamical Dissipative Cylindrical System in Non-minimally Coupled Theory

abstract: This paper aims to formulate certain scalar factors associated with matter variables for self-gravitating non-static cylindrical geometry by considering a standard model $\mathcal{R}+\zeta\mathcal{Q}$ of $f(\mathcal{R},\mathcal{T},\mathcal{Q})$ gravity, where $\mathcal{Q}=\mathcal{R}_{\varphi\vartheta}\mathcal{T}^{\varphi\vartheta}$ and $\zeta$ is the arbitrary coupling parameter. We split the Riemann tensor orthogonally to calculate four scalars and deduce $\mathcal{Y}_{TF}$ as complexity factor for the fluid configuration. This scalar incorporates the influence of inhomogeneous energy density, heat flux and pressure anisotropy along with correction terms of the modified gravity. We discuss the dynamics of cylinder by considering two simplest modes of structural evolution. We then take $\mathcal{Y}_{TF}=0$ with homologous condition to determine the solution for dissipative as well as non-dissipative scenarios. Finally, we discuss the criterion under which the complexity-free condition shows stable behavior throughout the evolution. It is concluded that complex functional of this theory results in a more complex structure.


title: Vogan's Conjecture on local Arthur packets of $p$-adic $\mathrm{GL}_n$ and a combinatorial Lemma

abstract: For $\mathrm{GL}_n$ over a $p$-adic field, Cunningham and Ray proved Vogan's conjecture, that is, local Arthur packets are the same as ABV packets. They used the endoscopic theory to reduce the general case to a combinatorial lemma for irreducible local Arthur parameters, and their proof implies that one can also prove Vogan's conjecture for $p$-adic $\mathrm{GL}_n$ by proving a generalized version of this combinatorial lemma. Riddlesden recently proved this generalized lemma. In this paper, we give a new proof of it, which has its own interest.


title: Tunable p-n junction barriers in few-electron bilayer graphene quantum dots

abstract: Graphene quantum dots provide promising platforms for hosting spin, valley, or spin-valley qubits. Taking advantage of the electrically generated band gap and the ambipolar nature, high-quality quantum dots can be defined in bilayer graphene using natural p-n junctions as tunnel barriers. In these devices, demonstrating the electrical tunability of the p-n junction barriers and understanding its physical mechanism, especially in the few-electron regime, are essential for further manipulating electron's quantum degrees of freedom to encode qubits. Here, we show the electrostatic confinement of single quantum dots in bilayer graphene using natural p-n junctions. When the device is operated in the few-electron regime, the electron tunneling rate is found to be monotonically tuned by varying gate voltages, which can be well understood from the view of manipulating the p-n junction barriers. Our results provide an insightful understanding of electrostatic confinement using natural p-n junctions in bilayer graphene, which is beneficial for realizing graphene-based qubits.


title: On uniformly quasiconformal Anosov diffeomorphisms with two dimensional distributions

abstract: We prove that a transitive uniformly $u$-quasiconformal Anosov diffeomorphism with a two-dimensional unstable distribution has a globally defined stable holonomy. As a corollary, we are able to remove an additional assumption in a theorem of Kalinin-Sadovskaya, and deduce that all transitive uniformly quasiconformal Anosov diffeomorphisms are $C^{\infty}$-conjugate to affine Anosov diffeomorphisms on infra-torus.


title: Active Neural Topological Mapping for Multi-Agent Exploration

abstract: This paper investigates the multi-agent cooperative exploration problem, which requires multiple agents to explore an unseen environment via sensory signals in a limited time. A popular approach to exploration tasks is to combine active mapping with planning. Metric maps capture the details of the spatial representation, but are with high communication traffic and may vary significantly between scenarios, resulting in inferior generalization. Topological maps are a promising alternative as they consist only of nodes and edges with abstract but essential information and are less influenced by the scene structures. However, most existing topology-based exploration tasks utilize classical methods for planning, which are time-consuming and sub-optimal due to their handcrafted design. Deep reinforcement learning (DRL) has shown great potential for learning (near) optimal policies through fast end-to-end inference. In this paper, we propose Multi-Agent Neural Topological Mapping (MANTM) to improve exploration efficiency and generalization for multi-agent exploration tasks. MANTM mainly comprises a Topological Mapper and a novel RL-based Hierarchical Topological Planner (HTP). The Topological Mapper employs a visual encoder and distance-based heuristics to construct a graph containing main nodes and their corresponding ghost nodes. The HTP leverages graph neural networks to capture correlations between agents and graph nodes in a coarse-to-fine manner for effective global goal selection. Extensive experiments conducted in a physically-realistic simulator, Habitat, demonstrate that MANTM reduces the steps by at least 26.40% over planning-based baselines and by at least 7.63% over RL-based competitors in unseen scenarios.


title: Computational multiphase micro-periporomechanics for dynamic shear banding and fracturing of unsaturated porous media

abstract: Dynamic shearing banding and fracturing in unsaturated porous media is a significant problem in engineering and science. This article proposes a multiphase micro-periporomechanics (uPPM) paradigm for modeling dynamic shear banding and fracturing in unsaturated porous media. Periporomechanics (PPM) is a nonlocal reformulation of classical poromechanics to model continuous and discontinuous deformation/fracture and fluid flow in porous media through a single framework. In PPM, a multiphase porous material is postulated as a collection of a finite number of mixed material points. The length scale in PPM that dictates the nonlocal interaction between material points is a mathematical object that lacks a direct physical meaning. As a novelty, in the coupled uPPM, a microstructure-based material length scale is incorporated by considering micro-rotations of the solid skeleton following the Cosserat continuum theory for solids. As a new contribution, we reformulate the second-order work for detecting material instability and the energy-based crack criterion and J-integral for modeling fracturing in the uPPM paradigm. The stabilized Cosserat PPM correspondence principle that mitigates the multiphase zero-energy mode instability is augmented to include unsaturated fluid flow. We have numerically implemented the novel uPPM paradigm through a dual-way fractional-step algorithm in time and a hybrid Lagrangian-Eulerian meshfree method in space. Numerical examples are presented to demonstrate the robustness and efficacy of the proposed uPPM paradigm for modeling shear banding and fracturing in unsaturated porous media.


title: Low loss metasurfaces based on quantized meta-atom

abstract: Metasurfaces have been proposed as a new paradigm to manipulate light and improve light-matter interactions. Conventional metasurfaces are restricted to the loss of materials, limiting their performance ceiling. Here, the loss of metallic metasurfaces is reduced to the level of dielectric metasurfaces by quantizing the meta-atom, and a coupling model is proposed to interpret the loss reduction. The theoretical results are in excellent agreement with the finite-element method simulation results. This phenomenon is also reproduced in dielectric and second-quantized meta-atom metasurfaces. There is reason to believe that this is something new in the resonance field, and this work will shed new light on the designs and applications of metasurfaces. It will also pave theory support to other resonance fields beyond metasurfaces.


title: Towards Ultimate Memory with Single-Molecule Multiferroics

abstract: The demand for high-density storage is urgent in the current era of data explosion. Recently, several single-molecule (-atom) magnets/ferroelectrics have been reported to be promising candidates for high-density storage. As another promising candidate, single-molecule multiferroics are not only small but also possess ferroelectric and magnetic orderings, which can sometimes be strongly coupled and used as data storages to realize the combination of electric writing and magnetic reading. However, they have been rarely proposed, and never been experimentally reported. Here, by building Hamiltonian models, we propose a new model of single-molecule multiferroic in which electric dipoles and magnetic moments are parallel and can rotate with the rotation of the single molecule. Furthermore, with performing spin-lattice dynamics simulations, we reveal the conditions (e.g., large enough single-ion anisotropy and appropriate electric field) under which the new single-molecule multiferroic can arise. Based on this model, as well as first-principles calculations, a realistic example Co(NH3)4N@SWCNT is constructed and numerically confirmed to demonstrate the feasibility of the new single-molecule multiferroic model. Our work not only sheds light on the discovery of single-molecule multiferroics but also provides a new guideline to design multifunctional materials for ultimate memory devices.


title: How is Software Reuse Discussed in Stack Overflow?

abstract: Software reuse is a crucial external quality attribute targeted by open-source and commercial projects. Despite that software reuse has experienced an increased adoption throughout the years, little is known about what aspects of code reuse developers discuss. In this paper, we present an empirical study of 1,409 posts to better understand the challenges developers face when reusing code. Our findings show that 'visual studio' is the top occurring bigrams for question posts, and there are frequent design patterns utilized by developers for the purpose of reuse. We envision our findings enabling researchers to develop guidelines to be utilized to foster software reuse.


title: AMSP: Reducing Communication Overhead of ZeRO for Efficient LLM Training

abstract: Training large language models (LLMs) encounters challenges in GPU memory consumption due to the high memory requirements of model states. The widely used Zero Redundancy Optimizer (ZeRO) addresses this issue through strategic sharding but introduces communication challenges at scale. To tackle this problem, we propose AMSP, a system designed to optimize ZeRO for scalable LLM training. AMSP incorporates three flexible sharding strategies: Full-Replica, Full-Sharding, and Partial-Sharding, and allows each component within the model states (Parameters, Gradients, Optimizer States) to independently choose a sharding strategy as well as the device mesh. We conduct a thorough analysis of communication costs, formulating an optimization problem to discover the optimal sharding strategy. Additionally, AMSP optimizes distributed LLM training by efficiently overlapping communication with computation. Evaluations demonstrate up to 52\% Model FLOPs Utilization (MFU) when training the LLaMA-based model on 1024 GPUs, resulting in a 1.56 times improvement in training throughput compared to newly proposed systems like MiCS and ZeRO++.


title: Noisy Exemplars Make Large Language Models More Robust: A Domain-Agnostic Behavioral Analysis

abstract: Recent advances in prompt engineering enable large language models (LLMs) to solve multi-hop logical reasoning problems with impressive accuracy. However, there is little existing work investigating the robustness of LLMs with few-shot prompting techniques. Therefore, we introduce a systematic approach to test the robustness of LLMs in multi-hop reasoning tasks via domain-agnostic perturbations. We include perturbations at multiple levels of abstractions (e.g. lexical perturbations such as typos, and semantic perturbations such as the inclusion of intermediate reasoning steps in the questions) to conduct behavioral analysis on the LLMs. Throughout our experiments, we find that models are more sensitive to certain perturbations such as replacing words with their synonyms. We also demonstrate that increasing the proportion of perturbed exemplars in the prompts improves the robustness of few-shot prompting methods.


title: Solutions to Elliptic and Parabolic Problems via Finite Difference Based Unsupervised Small Linear Convolutional Neural Networks

abstract: In recent years, there has been a growing interest in leveraging deep learning and neural networks to address scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods like PINNs rely on auto differentiation and sampling collocation points, leading to a lack of interpretability and lower accuracy than traditional numerical methods. As a result, we propose a fully unsupervised approach, requiring no training data, to estimate finite difference solutions for PDEs directly via small linear convolutional neural networks. Our proposed approach uses substantially fewer parameters than similar finite difference-based approaches while also demonstrating comparable accuracy to the true solution for several selected elliptic and parabolic problems compared to the finite difference method.


title: Incentivized Collaboration in Active Learning

abstract: In collaborative active learning, where multiple agents try to learn labels from a common hypothesis, we introduce an innovative framework for incentivized collaboration. Here, rational agents aim to obtain labels for their data sets while keeping label complexity at a minimum. We focus on designing (strict) individually rational (IR) collaboration protocols, ensuring that agents cannot reduce their expected label complexity by acting individually. We first show that given any optimal active learning algorithm, the collaboration protocol that runs the algorithm as is over the entire data is already IR. However, computing the optimal algorithm is NP-hard. We therefore provide collaboration protocols that achieve (strict) IR and are comparable with the best known tractable approximation algorithm in terms of label complexity.


title: $q$-Fractional Integral Operators With Two Parameters

abstract: We use the Poisson kernel of the continuous $q$-Hermite polynomials to introduces families of integral operators, which are semigroups of linear operators. We describe the eigenvalues and eigenfunctions of one family of operators. The action of the semigroups of operators on the Askey--Wilson polynomials is shown to only change the parameters but preserves the degrees, hence we produce transmutation relation for the Askey--Wilson polynomials. The transmutation relations are then used to derive bilinear generating functions involving the Askey--Wilson polynomials.


title: Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agents

abstract: Proactive dialogues serve as a practical yet challenging dialogue problem in the era of large language models (LLMs), where the dialogue policy planning is the key to improving the proactivity of LLMs. Most existing studies enable the dialogue policy planning of LLMs using various prompting schemes or iteratively enhance this capability in handling the given case with verbal AI feedback. However, these approaches are either bounded by the policy planning capability of the frozen LLMs or hard to be transferred to new cases. In this work, we introduce a new dialogue policy planning paradigm to strategize LLMs for proactive dialogue problems with a tunable language model plug-in as a plug-and-play dialogue policy planner, named PPDPP. Specifically, we develop a novel training framework to facilitate supervised fine-tuning over available human-annotated data as well as reinforcement learning from goal-oriented AI feedback with dynamic interaction data collected by the LLM-based self-play simulation. In this manner, the LLM-powered dialogue agent can not only be generalized to different cases after the training, but also be applicable to different applications by just substituting the learned plug-in. In addition, we propose to evaluate the policy planning capability of dialogue systems under the interactive setting. Experimental results demonstrate that PPDPP consistently and substantially outperforms existing approaches on three different proactive dialogue applications, including negotiation, emotional support, and tutoring dialogues.


title: The bottleneck and ceiling effects in quantized tracking control of heterogeneous multi-agent systems under DoS attacks

abstract: In this paper, we investigate tracking control of heterogeneous multi-agent systems under Denial-of-Service (DoS) attacks and state quantization. Dynamic quantized mechanisms are designed for inter-follower communication and leader-follower communication. Zooming-in and out factors, and data rates of both mechanisms for preventing quantizer saturation are provided. Our results show that by tuning the inter-follower quantized controller, one cannot improve the resilience beyond a level determined by the data rate of leader-follower quantized communication, i.e., the ceiling effect. Otherwise, overflow of followers' state quantizer can occur. On the other hand, if one selects a "large" data rate for leader-follower quantized communication, then the inter-follower quantized communication determines the resilience, and further increasing the data rate for leader-follower quantized communication cannot improve the resilience, i.e., the bottleneck effect. Simulation examples are provided to justify the results of our paper.


title: Splitting Algebraic Singular Fibrations via Perturbation of Branch Covers

abstract: In a previous paper \cite{SV}, the authors studied the isolated singular fibers that can occur in algebraic fibrations of certain genus two fibrations. There the goal was to determine their monodromy factorizations with the goal of determining a dictionary between a set of curve configurations and certain words in the mapping class group. Each such curve configuration was originally cataloged by Namikawa and Ueno \cite{NamikawaUeno-list} in their list of genus two fibrations. We studied four families of polynomials, we restricted to fibrations whose fibers have boundary, considering the isolated affine singularity referenced in \cite{NamikawaUeno-list}. We resolved the singularities and, using carefully chosen perturbations, deformed them into Lefschetz fibrations and determined their monodromy factorizations. In two of those families, we also obtained strong information about how the central fiber compactifies in a fibration with closed fibers. In this paper we work on the other two cases by recreating the singular fibers using a different family of polynomials. In \cite{SV}, all the algebraic curves in the fibrations were given expressly as hyperelliptic equations. We utilized this symmetry both to construct the deformation and to recover the monodromy factorization. In this paper the curves are no longer expressly hyperelliptic--the quotient curve is no longer just $\CC$, the branch curves are no longer embedded in $\CC^2$, and the fibrations utilized in the quotient are now more complicated. We do, though, recover the desired behavior of the compactification of the central fiber, its deformation to a Lefschetz fibration, and the corresponding monodromy factorization.


title: Adaptive Latent Diffusion Model for 3D Medical Image to Image Translation: Multi-modal Magnetic Resonance Imaging Study

abstract: Multi-modal images play a crucial role in comprehensive evaluations in medical image analysis providing complementary information for identifying clinically important biomarkers. However, in clinical practice, acquiring multiple modalities can be challenging due to reasons such as scan cost, limited scan time, and safety considerations. In this paper, we propose a model based on the latent diffusion model (LDM) that leverages switchable blocks for image-to-image translation in 3D medical images without patch cropping. The 3D LDM combined with conditioning using the target modality allows generating high-quality target modality in 3D overcoming the shortcoming of the missing out-of-slice information in 2D generation methods. The switchable block, noted as multiple switchable spatially adaptive normalization (MS-SPADE), dynamically transforms source latents to the desired style of the target latents to help with the diffusion process. The MS-SPADE block allows us to have one single model to tackle many translation tasks of one source modality to various targets removing the need for many translation models for different scenarios. Our model exhibited successful image synthesis across different source-target modality scenarios and surpassed other models in quantitative evaluations tested on multi-modal brain magnetic resonance imaging datasets of four different modalities and an independent IXI dataset. Our model demonstrated successful image synthesis across various modalities even allowing for one-to-many modality translations. Furthermore, it outperformed other one-to-one translation models in quantitative evaluations.


title: Constructing the Fulde-Ferrell-Larkin-Ovchinnikov state in antiferromagnetic insulator CrOCl

abstract: Time reversal symmetry breaking in superconductors, resulting from external magnetic fields or spontaneous magnetization, often leads to unconventional superconducting properties. In this way, a conventional Fulde-Ferrell-Larkin-Ovchinnikov (FFLO) state, characterized by the Cooper pairs with nonzero total momentum, may be realized by the Zeeman effect caused from external magnetic fields. Here, we report the observation of superconductivity in a few-layer antiferromagnetic insulator CrOCl by utilizing superconducting proximity effect with NbSe2 flakes. The superconductivity demonstrates a considerably weak gap of about 0.12 meV and the in-plane upper critical field reveals as behavior of the FFLO state at low temperature. Our first-principles calculations indicate that the proximitized superconductivity may exist in the CrOCl layer with Cr vacancies or line-defects. Moreover, the FFLO state could be induced by the inherent larger spin splitting in the CrOCl layer. Our findings not only demonstrate the fascinating interaction between superconductivity and magnetism, but also provide a possible path to construct FFLO state by intrinsic time reversal symmetry breaking and superconducting proximity effect.


title: Rethinking Decision Transformer via Hierarchical Reinforcement Learning

abstract: Decision Transformer (DT) is an innovative algorithm leveraging recent advances of the transformer architecture in reinforcement learning (RL). However, a notable limitation of DT is its reliance on recalling trajectories from datasets, losing the capability to seamlessly stitch sub-optimal trajectories together. In this work we introduce a general sequence modeling framework for studying sequential decision making through the lens of Hierarchical RL. At the time of making decisions, a high-level policy first proposes an ideal prompt for the current state, a low-level policy subsequently generates an action conditioned on the given prompt. We show DT emerges as a special case of this framework with certain choices of high-level and low-level policies, and discuss the potential failure of these choices. Inspired by these observations, we study how to jointly optimize the high-level and low-level policies to enable the stitching ability, which further leads to the development of new offline RL algorithms. Our empirical results clearly show that the proposed algorithms significantly surpass DT on several control and navigation benchmarks. We hope our contributions can inspire the integration of transformer architectures within the field of RL.


title: Syntactic Inductive Bias in Transformer Language Models: Especially Helpful for Low-Resource Languages?

abstract: A line of work on Transformer-based language models such as BERT has attempted to use syntactic inductive bias to enhance the pretraining process, on the theory that building syntactic structure into the training process should reduce the amount of data needed for training. But such methods are often tested for high-resource languages such as English. In this work, we investigate whether these methods can compensate for data sparseness in low-resource languages, hypothesizing that they ought to be more effective for low-resource languages. We experiment with five low-resource languages: Uyghur, Wolof, Maltese, Coptic, and Ancient Greek. We find that these syntactic inductive bias methods produce uneven results in low-resource settings, and provide surprisingly little benefit in most cases.


title: Evolutionary game with stochastic payoffs in a finite island model

abstract: In this paper, we consider a two-player two-strategy game with random payoffs in a population subdivided into $d$ demes, each containing $N$ individuals at the beginning of any given generation and experiencing local extinction and recolonization with some fixed probability $m$ after reproduction and selection among offspring. Within each deme, offspring engage in random pairwise interactions, and the payoffs are assumed to have means and variances proportional to the inverse of the population size. By verifying the conditions given in Ethier and Nagylaki (1980) to approximate Markov chains with two time scales, we establish that the discrete-time evolutionary dynamics with $Nd$ generations as unit of time converges to a continuous-time diffusion as $d\rightarrow\infty$. The infinitesimal mean and variance of this diffusion are expressed in terms of the population-scaled means and variances of the payoffs besides identity-by-descent measures between offspring in the same deme in a neutral population. We show that the probability for a strategy to fix in the population starting from an initial frequency $(Nd)^{-1}$ generally increases as the payoffs to that strategy exhibit less variability or the payoffs to the other strategy more variability. As a result, differences in variability can make this fixation probability for cooperation larger than the corresponding one for defection. As the deme-scaled extinction rate $\nu=mN$ decreases for $N$ large enough and $m$ small enough, creating a higher level of identity among offspring within demes, the differences between the population-scaled variances of the payoffs for interacting offspring of different types increases this effect to a greater extent than the differences for interacting offspring of the same type.


title: Survey on Quality Assurance of Smart Contracts

abstract: With the increasing adoption of smart contracts, ensuring their security has become a critical concern. Numerous vulnerabilities and attacks have been identified and exploited, resulting in significant financial losses. In response, researchers have developed various tools and techniques to identify and prevent vulnerabilities in smart contracts. In this survey, we present a systematic overview of the quality assurance of smart contracts, covering vulnerabilities, attacks, defenses, and tool support. By classifying vulnerabilities based on known attacks, we can identify patterns and common weaknesses that need to be addressed. Moreover, in order to effectively protect smart contracts, we have created a labeled dataset to evaluate various vulnerability detection tools and compare their effectiveness.


title: EdgeDis: Enabling Fast, Economical, and Reliable Data Dissemination for Mobile Edge Computing

abstract: Mobile edge computing (MEC) enables web data caching in close geographic proximity to end users. Popular data can be cached on edge servers located less than hundreds of meters away from end users. This ensures bounded latency guarantees for various latency-sensitive web applications. However, transmitting a large volume of data out of the cloud onto many geographically-distributed web servers individually can be expensive. In addition, web content dissemination may be interrupted by various intentional and accidental events in the volatile MEC environment, which undermines dissemination efficiency and subsequently incurs extra transmission costs. To tackle the above challenges, we present a novel scheme named EdgeDis that coordinates data dissemination by distributed consensus among those servers. We analyze EdgeDis's validity theoretically and evaluate its performance experimentally. Results demonstrate that compared with baseline and state-of-the-art schemes, EdgeDis: 1) is 5.97x - 7.52x faster; 2) reduces dissemination costs by 48.21% to 91.87%; and 3) reduces performance loss caused by dissemination failures by up to 97.30% in time and 96.35% in costs.


title: ChatCoder: Chat-based Refine Requirement Improves LLMs' Code Generation

abstract: Large language models have shown good performances in generating code to meet human requirements. However, human requirements expressed in natural languages can be vague, incomplete, and ambiguous, leading large language models to misunderstand human requirements and make mistakes. Worse, it is difficult for a human user to refine the requirement. To help human users refine their requirements and improve large language models' code generation performances, we propose ChatCoder: a method to refine the requirements via chatting with large language models. We design a chat scheme in which the large language models will guide the human users to refine their expression of requirements to be more precise, unambiguous, and complete than before. Experiments show that ChatCoder has improved existing large language models' performance by a large margin. Besides, ChatCoder has the advantage over refine-based methods and LLMs fine-tuned via human response.


title: SoulChat: Improving LLMs' Empathy, Listening, and Comfort Abilities through Fine-tuning with Multi-turn Empathy Conversations

abstract: Large language models (LLMs) have been widely applied in various fields due to their excellent capability for memorizing knowledge and chain of thought (CoT). When these language models are applied in the field of psychological counseling, they often rush to provide universal advice. However, when users seek psychological support, they need to gain empathy, trust, understanding and comfort, rather than just reasonable advice. To this end, we constructed a multi-turn empathetic conversation dataset of more than 2 million samples, in which the input is the multi-turn conversation context, and the target is empathetic responses that cover expressions such as questioning, comfort, recognition, listening, trust, emotional support, etc. Experiments have shown that the empathy ability of LLMs can be significantly enhanced when finetuning by using multi-turn dialogue history and responses that are closer to the expression of a psychological consultant.


title: Generalization Bounds for Label Noise Stochastic Gradient Descent

abstract: We develop generalization error bounds for stochastic gradient descent (SGD) with label noise in non-convex settings under uniform dissipativity and smoothness conditions. Under a suitable choice of semimetric, we establish a contraction in Wasserstein distance of the label noise stochastic gradient flow that depends polynomially on the parameter dimension $d$. Using the framework of algorithmic stability, we derive time-independent generalisation error bounds for the discretized algorithm with a constant learning rate. The error bound we achieve scales polynomially with $d$ and with the rate of $n^{-2/3}$, where $n$ is the sample size. This rate is better than the best-known rate of $n^{-1/2}$ established for stochastic gradient Langevin dynamics (SGLD) -- which employs parameter-independent Gaussian noise -- under similar conditions. Our analysis offers quantitative insights into the effect of label noise.


title: Stochastic viability in an island model with partial dispersal : Approximation by a diffusion process in the limit of a large number of islands

abstract: In this paper, we study a finite population undergoing discrete, nonoverlapping generations, that is structured into $D$ demes, each containing $N$ individuals of two possible types, $A$ and $B$, whose viability coefficients, $s_A$ and $s_B$, respectively, vary randomly from one generation to the next. We assume that the means, variances and covariance of the viability coefficients are inversely proportional to the number of demes $D$, while higher-order moments are negligible in comparison to $1/D$. We use a discrete-time Markov chain with two time scales to model the evolutionary process, and we demonstrate that as the number of demes $D$ approaches infinity, the accelerated Markov chain converges to a diffusion process for any deme size $N\geq 2$. This diffusion process allows us to evaluate the fixation probability of type $A$ following its introduction as a single mutant in a population that was fixed for type $B$. We explore the impact of increasing the variability in the viability coefficients on this fixation probability. At least when $N$ is large enough, it is shown that increasing this variability for type $B$ or decreasing it for type $A$ leads to an increase in the fixation probability of a single $A$. The effect of the population-scaled variances, $\sigma^2_A$ and $\sigma^2_B$, can even cancel the effects of the population-scaled means, $\mu_A$ and $\mu_B$. We also show that the fixation probability of a single $A$ increases as the deme-scaled migration rate increases. Moreover, this probability is higher for type $A$ than for type $B$ if the population-scaled geometric mean is higher for type $A$ than for type $B$, which means that $\mu_A-\sigma_A^2/2>\mu_B-\sigma_B^2/2$.


title: LiDAR-based SLAM for robotic mapping: state of the art and new frontiers

abstract: In recent decades, the field of robotic mapping has witnessed widespread research and development in LiDAR (Light Detection And Ranging)-based simultaneous localization and mapping (SLAM) techniques. In this paper, we review the state-of-the-art in LiDAR-based SLAM and explore the remaining challenges that still require attention to satisfy the needs of contemporary applications. A distinctive aspect of this study lies in its literature survey, which specifically investigates the application of various types and configurations of LiDAR, setting it apart from prior reviews. Furthermore, several representative comparisons of LiDAR-based SLAM algorithms are presented, which can serve as a point of reference. Finally, the paper concludes with an insightful discussion on the emergence of new frontiers in the domain of LiDAR-based SLAM.