title: Data efficiency and extrapolation trends in neural network interatomic potentials

abstract: Over the last few years, key architectural advances have been proposed for neural network interatomic potentials (NNIPs), such as incorporating message-passing networks, equivariance, or many-body expansion terms. Although modern NNIP models exhibit small differences in energy/forces errors, improvements in accuracy are still considered the main target when developing new NNIP architectures. In this work, we show how architectural and optimization choices influence the generalization of NNIPs, revealing trends in molecular dynamics (MD) stability, data efficiency, and loss landscapes. Using the 3BPA dataset, we show that test errors in NNIP follow a scaling relation and can be robust to noise, but cannot predict MD stability in the high-accuracy regime. To circumvent this problem, we propose the use of loss landscape visualizations and a metric of loss entropy for predicting the generalization power of NNIPs. With a large-scale study on NequIP and MACE, we show that the loss entropy predicts out-of-distribution error and MD stability despite being computed only on the training set. Using this probe, we demonstrate how the choice of optimizers, loss function weighting, data normalization, and other architectural decisions influence the extrapolation behavior of NNIPs. Finally, we relate loss entropy to data efficiency, demonstrating that flatter landscapes also predict learning curve slopes. Our work provides a deep learning justification for the extrapolation performance of many common NNIPs, and introduces tools beyond accuracy metrics that can be used to inform the development of next-generation models.


title: Pointwise error estimates and local superconvergence of Jacobi expansions

abstract: As one myth of polynomial interpolation and quadrature, Trefethen [30] revealed that the Chebyshev interpolation of $|x-a|$ (with $|a|<1 $) at the Clenshaw-Curtis points exhibited a much smaller error than the best polynomial approximation (in the maximum norm) in about $95\%$ range of $[-1,1]$ except for a small neighbourhood near the singular point $x=a.$ In this paper, we rigorously show that the Jacobi expansion for a more general class of $\Phi$-functions also enjoys such a local convergence behaviour. Our assertion draws on the pointwise error estimate using the reproducing kernel of Jacobi polynomials and the Hilb-type formula on the asymptotic of the Bessel transforms. We also study the local superconvergence and show the gain in order and the subregions it occurs. As a by-product of this new argument, the undesired $\log n$-factor in the pointwise error estimate for the Legendre expansion recently stated in Babu\u{s}ka and Hakula [5] can be removed. Finally, all these estimates are extended to the functions with boundary singularities. We provide ample numerical evidences to demonstrate the optimality and sharpness of the estimates.


title: Koopman-based generalization bound: New aspect for full-rank weights

abstract: We propose a new bound for generalization of neural networks using Koopman operators. Whereas most of existing works focus on low-rank weight matrices, we focus on full-rank weight matrices. Our bound is tighter than existing norm-based bounds when the condition numbers of weight matrices are small. Especially, it is completely independent of the width of the network if the weight matrices are orthogonal. Our bound does not contradict to the existing bounds but is a complement to the existing bounds. As supported by several existing empirical results, low-rankness is not the only reason for generalization. Furthermore, our bound can be combined with the existing bounds to obtain a tighter bound. Our result sheds new light on understanding generalization of neural networks with full-rank weight matrices, and it provides a connection between operator-theoretic analysis and generalization of neural networks.


title: Asymptotically Optimal Coded Distributed Computing via Combinatorial Designs

abstract: Coded distributed computing (CDC) introduced by Li \emph{et al.} can greatly reduce the communication load for MapReduce computing systems. In the general cascaded CDC with $K$ workers, $N$ input files and $Q$ Reduce functions, each input file will be mapped by $r$ workers and each Reduce function will be computed by $s$ workers such that coding techniques can be applied to achieve the maximum multicast gain. The main drawback of most existing CDC schemes is that they require the original data to be split into a large number of input files that grows exponentially with $K$, which can significantly increase the coding complexity and degrade system performance. In this paper, we first use a classic combinatorial structure $t$-design, for any integer $t\geq 2$, to develop a low-complexity and asymptotically optimal CDC with $r=s$. The main advantages of our scheme via $t$-design are two-fold: 1) having much smaller $N$ and $Q$ than the existing schemes under the same parameters $K$, $r$ and $s$; and 2) achieving smaller communication loads compared with the state-of-the-art schemes. Remarkably, unlike the previous schemes that realize on large operation fields, our scheme operates on the minimum binary field $\mathbb{F}_2$. Furthermore, we show that our construction method can incorporate the other combinatorial structures that have a similar property to $t$-design. For instance, we use $t$-GDD to obtain another asymptotically optimal CDC scheme over $\mathbb{F}_2$ that has different parameters from $t$-design. Finally, we show that our construction method can also be used to construct CDC schemes with $r\neq s$ that have small file number and Reduce function number.


title: Cosymplectic geometry, reductions, and energy-momentum methods with applications

abstract: Classical energy-momentum methods study the existence and stability properties of solutions of $t$-dependent Hamilton equations on symplectic manifolds whose evolution is given by their Hamiltonian Lie symmetries. The points of such solutions are called relative equilibrium points. This work devises a new cosymplectic energy-momentum method providing a new and more general framework to study $t$-dependent Hamilton equations. In fact, cosymplectic geometry allows for using more types of distinguished Lie symmetries (given by Hamiltonian, gradient, or evolution vector fields), relative equilibrium points, and reduction methods, than symplectic techniques. To make our work more self-contained and to fill some gaps in the literature, a review of the cosymplectic formalism and the cosymplectic Marsden-Weinstein reduction is included. Known and new types of relative equilibrium points are characterised and studied. Our methods remove technical conditions used in previous energy-momentum methods, like the ${\rm Ad}^*$-equivariance of momentum maps. Eigenfunctions of $t$-dependent Schr\"odinger equations are interpreted in terms of relative equilibrium points in cosymplectic manifolds. A new cosymplectic-to-symplectic reduction is developed and a new associated type of relative equilibrium points, the so-called gradient relative equilibrium points, are introduced and applied to study the Lagrange points and Hill radii of a restricted circular three-body system by means of a not Hamiltonian Lie symmetry of the system.


title: Graph Neural Network-Inspired Kernels for Gaussian Processes in Semi-Supervised Learning

abstract: Gaussian processes (GPs) are an attractive class of machine learning models because of their simplicity and flexibility as building blocks of more complex Bayesian models. Meanwhile, graph neural networks (GNNs) emerged recently as a promising class of models for graph-structured data in semi-supervised learning and beyond. Their competitive performance is often attributed to a proper capturing of the graph inductive bias. In this work, we introduce this inductive bias into GPs to improve their predictive performance for graph-structured data. We show that a prominent example of GNNs, the graph convolutional network, is equivalent to some GP when its layers are infinitely wide; and we analyze the kernel universality and the limiting behavior in depth. We further present a programmable procedure to compose covariance kernels inspired by this equivalence and derive example kernels corresponding to several interesting members of the GNN family. We also propose a computationally efficient approximation of the covariance matrix for scalable posterior inference with large-scale data. We demonstrate that these graph-based kernels lead to competitive classification and regression performance, as well as advantages in computation time, compared with the respective GNNs.


title: Tighter PAC-Bayes Bounds Through Coin-Betting

abstract: We consider the problem of estimating the mean of a sequence of random elements $f(X_1, \theta)$ $, \ldots, $ $f(X_n, \theta)$ where $f$ is a fixed scalar function, $S=(X_1, \ldots, X_n)$ are independent random variables, and $\theta$ is a possibly $S$-dependent parameter. An example of such a problem would be to estimate the generalization error of a neural network trained on $n$ examples where $f$ is a loss function. Classically, this problem is approached through concentration inequalities holding uniformly over compact parameter sets of functions $f$, for example as in Rademacher or VC type analysis. However, in many problems, such inequalities often yield numerically vacuous estimates. Recently, the \emph{PAC-Bayes} framework has been proposed as a better alternative for this class of problems for its ability to often give numerically non-vacuous bounds. In this paper, we show that we can do even better: we show how to refine the proof strategy of the PAC-Bayes bounds and achieve \emph{even tighter} guarantees. Our approach is based on the \emph{coin-betting} framework that derives the numerically tightest known time-uniform concentration inequalities from the regret guarantees of online gambling algorithms. In particular, we derive the first PAC-Bayes concentration inequality based on the coin-betting approach that holds simultaneously for all sample sizes. We demonstrate its tightness showing that by \emph{relaxing} it we obtain a number of previous results in a closed form including Bernoulli-KL and empirical Bernstein inequalities. Finally, we propose an efficient algorithm to numerically calculate confidence sequences from our bound, which often generates nonvacuous confidence bounds even with one sample, unlike the state-of-the-art PAC-Bayes bounds.


title: NephroNet: A Novel Program for Identifying Renal Cell Carcinoma and Generating Synthetic Training Images with Convolutional Neural Networks and Diffusion Models

abstract: Renal cell carcinoma (RCC) is a type of cancer that originates in the kidneys and is the most common type of kidney cancer in adults. It can be classified into several subtypes, including clear cell RCC, papillary RCC, and chromophobe RCC. In this study, an artificial intelligence model was developed and trained for classifying different subtypes of RCC using ResNet-18, a convolutional neural network that has been widely used for image classification tasks. The model was trained on a dataset of RCC histopathology images, which consisted of digital images of RCC surgical resection slides that were annotated with the corresponding subtype labels. The performance of the trained model was evaluated using several metrics, including accuracy, precision, and recall. Additionally, in this research, a novel synthetic image generation tool, NephroNet, is developed on diffusion models that are used to generate original images of RCC surgical resection slides. Diffusion models are a class of generative models capable of synthesizing high-quality images from noise. Several diffusers such as Stable Diffusion, Dreambooth Text-to-Image, and Textual Inversion were trained on a dataset of RCC images and were used to generate a series of original images that resembled RCC surgical resection slides, all within the span of fewer than four seconds. The generated images were visually realistic and could be used for creating new training datasets, testing the performance of image analysis algorithms, and training medical professionals. NephroNet is provided as an open-source software package and contains files for data preprocessing, training, and visualization. Overall, this study demonstrates the potential of artificial intelligence and diffusion models for classifying and generating RCC images, respectively. These methods could be useful for improving the diagnosis and treatment of RCC and more.


title: On the Difficulty of Characterizing Network Formation with Endogenous Behavior

abstract: Bolletta (2021, Math. Soc. Sci. 114:1-10) studies a model in which a network is strategically formed and then agents play a linear best-response investment game in it. The model is motivated by an application in which people choose both their study partners and their levels of educational effort. Agents have different one-dimensional types $\unicode{x2013}$ private returns to effort. A main result claims that pairwise Nash stable networks have a locally complete structure consisting of possibly overlapping cliques: if two agents are linked, they are part of a clique composed of all agents with types between theirs. We offer a counterexample showing that the claimed characterization is incorrect, highlight where the analysis errs, and discuss implications for network formation models.


title: Sparse Mutation Decompositions: Fine Tuning Deep Neural Networks with Subspace Evolution

abstract: Neuroevolution is a promising area of research that combines evolutionary algorithms with neural networks. A popular subclass of neuroevolutionary methods, called evolution strategies, relies on dense noise perturbations to mutate networks, which can be sample inefficient and challenging for large models with millions of parameters. We introduce an approach to alleviating this problem by decomposing dense mutations into low-dimensional subspaces. Restricting mutations in this way can significantly reduce variance as networks can handle stronger perturbations while maintaining performance, which enables a more controlled and targeted evolution of deep networks. This approach is uniquely effective for the task of fine tuning pre-trained models, which is an increasingly valuable area of research as networks continue to scale in size and open source models become more widely available. Furthermore, we show how this work naturally connects to ensemble learning where sparse mutations encourage diversity among children such that their combined predictions can reliably improve performance. We conduct the first large scale exploration of neuroevolutionary fine tuning and ensembling on the notoriously difficult ImageNet dataset, where we see small generalization improvements with only a single evolutionary generation using nearly a dozen different deep neural network architectures.


title: Bregman-Wasserstein divergence: geometry and applications

abstract: Consider the Monge-Kantorovich optimal transport problem where the cost function is given by a Bregman divergence. The associated transport cost, which we call the Bregman-Wasserstein divergence, presents a natural asymmetric extension of the squared $2$-Wasserstein metric and has recently found applications in statistics and machine learning. On the other hand, Bregman divergence is a fundamental object in information geometry and induces a dually flat geometry on the underlying manifold. Using the Bregman-Wasserstein divergence, we lift this dualistic geometry to the space of probability measures, thus extending Otto's weak Riemannian structure of the Wasserstein space to statistical manifolds. We do so by generalizing Lott's formal geometric computations on the Wasserstein space. In particular, we define primal and dual connections on the space of probability measures and show that they are conjugate with respect to Otto's metric. We also define primal and dual displacement interpolations which satisfy the corresponding geodesic equations. As applications, we study displacement convexity and the Bregman-Wasserstein barycenter.


title: Limiting Behavior of Constraint Minimizers for Inhomogeneous Fractional Schr\"{o}dinger Equations

abstract: This paper is devoted to the $L^2$-constraint variational problem \begin{equation*} We study $L^2$-normalized solutions of the following inhomogeneous fractional Schr\"{o}dinger equation \begin{equation*} (-\Delta)^{s} u(x)+V(x)u(x)-a|x|^{-b}|u|^{2\beta^2}u(x)=\mu u(x)\ \ \mbox{in}\ \ \R^{N}. \end{equation*} Here $s\in(\frac{1}{2},1)$, $N>2s$, $a>0$, $0<b<\min\{\frac{N}{2},1\}$, $\beta=\sqrt{\frac{2s-b}{N}}$ and $V(x)\geq 0$ is an external potential. We get $L^2$-normalized solutions of the above equation by solving the associated constrained minimization problem. We prove that there exists a critical value $a^*>0$ such that minimizers exist for $0<a<a^*$, and minimizers do not exist for any $a>a^*$. In the case of $a=a^*$, one can obtain the classification results of the existence and non-existence for constraint minimizers, which are depended strongly on the value of $V(0)$. For $V(0)=0$, the limiting behavior of nonnegative minimizers is also analyzed when $a$ tend to $a^*$ from below.


title: Sharp Ramsey thresholds for large books

abstract: For graphs $G$ and $H$, let $G\to H$ signify that any red/blue edge coloring of $G$ contains a monochromatic $H$. Let $G(N,p)$ be the random graph of order $N$ and edge probability $p$. The sharp thresholds for Ramsey properties seemed out of hand until a general technique was introduced by Friedgut ({\em J. AMS} 12 (1999), 1017--1054). In this paper, we obtain the sharp Ramsey threshold for the book graph $B_n^{(k)}$, which consists of $n$ copies of $K_{k+1}$ all sharing a common $K_k$. In particular, for every fixed integer $k\ge 1$ and for any real $c>1$, let $N=c2^k n$. Then for any real $\gamma>0$, \[ \lim_{n\to \infty} \Pr(G(N,p)\to B_n^{(k)})= \left\{ \begin{array}{cl} 0 & \mbox{if $p\le\frac{1}{c^{1/k}}(1-\gamma)$,} \\ 1 & \mbox{if $p\ge\frac{1}{c^{1/k}}(1+\gamma)$}. \end{array} \right. \] The sharp Ramsey threshold $\frac{1}{c^{1/k}}$ for $B_n^{(k)}$, e.g. a star, is positive although its edge density tends to zero.


title: Theory on Forgetting and Generalization of Continual Learning

abstract: Continual learning (CL), which aims to learn a sequence of tasks, has attracted significant recent attention. However, most work has focused on the experimental performance of CL, and theoretical studies of CL are still limited. In particular, there is a lack of understanding on what factors are important and how they affect "catastrophic forgetting" and generalization performance. To fill this gap, our theoretical analysis, under overparameterized linear models, provides the first-known explicit form of the expected forgetting and generalization error. Further analysis of such a key result yields a number of theoretical explanations about how overparameterization, task similarity, and task ordering affect both forgetting and generalization error of CL. More interestingly, by conducting experiments on real datasets using deep neural networks (DNNs), we show that some of these insights even go beyond the linear models and can be carried over to practical setups. In particular, we use concrete examples to show that our results not only explain some interesting empirical observations in recent studies, but also motivate better practical algorithm designs of CL.


title: Local derivations and local automorphisms on the super Virasoro algebras

abstract: This paper aims to study the local derivations, 2-local automorphisms and local automorphisms on the super-Virasoro algebras. The primary focus is to establish that every local derivation of the super-Virasoro algebras is indeed a derivation, and to demonstrate that every local or 2-local automorphism of the super-Virasoro algebras is an automorphism.


title: Maneuver Decision-Making For Autonomous Air Combat Through Curriculum Learning And Reinforcement Learning With Sparse Rewards

abstract: Reinforcement learning is an effective way to solve the decision-making problems. It is a meaningful and valuable direction to investigate autonomous air combat maneuver decision-making method based on reinforcement learning. However, when using reinforcement learning to solve the decision-making problems with sparse rewards, such as air combat maneuver decision-making, it costs too much time for training and the performance of the trained agent may not be satisfactory. In order to solve these problems, the method based on curriculum learning is proposed. First, three curricula of air combat maneuver decision-making are designed: angle curriculum, distance curriculum and hybrid curriculum. These courses are used to train air combat agents respectively, and compared with the original method without any curriculum. The training results show that angle curriculum can increase the speed and stability of training, and improve the performance of the agent; distance curriculum can increase the speed and stability of agent training; hybrid curriculum has a negative impact on training, because it makes the agent get stuck at local optimum. The simulation results show that after training, the agent can handle the situations where targets come from different directions, and the maneuver decision results are consistent with the characteristics of missile.


title: A Human-Centered Review of Algorithms in Decision-Making in Higher Education

abstract: The use of algorithms for decision-making in higher education is steadily growing, promising cost-savings to institutions and personalized service for students but also raising ethical challenges around surveillance, fairness, and interpretation of data. To address the lack of systematic understanding of how these algorithms are currently designed, we reviewed an extensive corpus of papers proposing algorithms for decision-making in higher education. We categorized them based on input data, computational method, and target outcome, and then investigated the interrelations of these factors with the application of human-centered lenses: theoretical, participatory, or speculative design. We found that the models are trending towards deep learning, and increased use of student personal data and protected attributes, with the target scope expanding towards automated decisions. However, despite the associated decrease in interpretability and explainability, current development predominantly fails to incorporate human-centered lenses. We discuss the challenges with these trends and advocate for a human-centered approach.


title: 60 GHz Wi-Fi As A Tractor-Trailer Wireless Harness

abstract: Reverse driving a truck is a challenging task for human drivers and self-driving software due to the lack for sensors on the trailer. Self-driving and conventional trucks have an increasing need to replace the legacy communication channels between the truck and the trailer to accommodate bandwidth and latency requirements when more sensors and features are added to the trailer to support driver assist features or self-driving functions, in addition to the need of automating the tractor-trailer hitching and unhitching, which is a complex process when using wires and connectors for communication between the truck and the trailer. In this paper, we address using a wireless harness between the tractor and the trailer based on Wi-Fi, in addition to discussing using Named Data networking protocol for communication between the truck and the trailer including handling interest and data packets. A Testbed is used to evaluate communicating different data types from one device to three devices over 802.11ac and it indicated a stable communication performance when Named Data Networking and Data Distribution Service were used. Using a wireless harness will ease the automation of trailer hitching and unhitching process and will eliminate the need for communication wires or connectors between the tractor and the trailers, therefore, reducing the complexity of the process.


title: Randomly Choose an Angle from an Immense Number of Angles to Rotate Qubits, Compute and Reverse

abstract: This paper studies information-theoretically secure quantum homomorphic encryption (QHE) schemes of classical data. Previous works on information-theoretically secure QHE schemes (like Childs'05, Liang'13, and others) are typically based on the Quantum-One-Time-Pad (QOTP) approach of Ambainis et al. [AMTdW'00]. There, the encryption of a bit is a qubit, randomly selected from a set of four possible qubits. This paper takes a different approach and presents the RBE (Random-Basis Encryption) scheme -- a QHE scheme in which the encryption of a bit is a qubit, randomly selected from a set of an immense number of qubits. Second, this paper studies weak measurements (WM) and presents a WM-based attack on legacy QOTP-based Quantum Key Distribution (QKD) protocols. Then, we use the RBE scheme to construct a QKD protocol and argue that this protocol is resilient to such WM-based attacks. Finally, this paper raises the following question. Entanglement is an essential resource in quantum information and quantum computation research. Hence, once generated, how can its owner secure entangled systems of qubits? We inspect possible QOTP-based solutions, suggest an RBE-based solution, and discuss some of the benefits of the latter.


title: Antihelical Edge States in Two-dimensional Photonic Topological Metals

abstract: Topological edge states are the core of topological photonics. Here we introduce the antihelical edge states of time-reversal symmetric topological metals and propose a photonic realization in an anisotropic square lattice of coupled ring resonators, where the clockwise and counterclockwise modes play the role of pseudospins. The antihelical edge states robustly propagate across the corners toward the diagonal of the square lattice: The same (opposite) pseudospins copropagate in the same (opposite) direction on the parallel lattice boundaries; the different pseudospins separate and converge at the opposite corners. The antihelical edge states in the topological metallic phase alter to the helical edge states in the topological insulating phase under a metal-insulator phase transition. The antihelical edge states provide a unique manner of topologically-protected robust light transport applicable for topological purification. Our findings create new opportunities for topological photonics and metamaterials.


title: Solutions and continuum limits to nonlocal discrete modified Korteweg de-Vries equations

abstract: In this paper, we take advantage of the bilinearization reduction method to consider the local and nonlocal reduction of a discrete Ablowitz-Kaup-Newell-Segur equation. Exact solutions in double Casoratian form to the reduced nonlocal discrete modified Korteweg de-Vries equations are constructed. The dynamics of soliton solutions are analyzed and illustrated by asymptotic analysis. Moreover, both semi-continuous limit and full continuous limit, are applied to obtain the local and nonlocal semi-discrete modified Korteweg de-Vries equations, as well as the local and nonlocal continuous modified Korteweg de-Vries equations.


title: Graph Matching Optimization Network for Point Cloud Registration

abstract: Point Cloud Registration is a fundamental and challenging problem in 3D computer vision. Recent works often utilize the geometric structure information in point feature embedding or outlier rejection for registration while neglecting to consider explicitly isometry-preserving constraint ($e.g.,$ point pair linked edge's length preserving after transformation) in training. We claim that the explicit isometry-preserving constraint is also important for improving feature representation abilities in the feature training stage. To this end, we propose a \underline{G}raph \underline{M}atching \underline{O}ptimization based \underline{Net}work (GMONet for short), which utilizes the graph-matching optimizer to explicitly exert the isometry preserving constraints in the point feature training to improve the point feature representation. Specifically, we exploit a partial graph-matching optimizer to optimize the super point ($i.e.,$ down-sampled key points) features and a full graph-matching optimizer to optimize fine-level point features in the overlap region. Meanwhile, we leverage the inexact proximal point method and the mini-batch sampling technique to accelerate these two graph-matching optimizers. Given high discriminative point features in the evaluation stage, we utilize the RANSAC approach to estimate the transformation between the scanned pairs. The proposed method has been evaluated on the 3DMatch/3DLoMatch benchmarks and the KITTI benchmark. The experimental results show that our method performs competitively compared to state-of-the-art baselines.


title: McKean-Vlasov SDEs with Sigularity in Distribution Variable and Distribution Dependent Diffusion

abstract: The well-posedness for SDEs with singularity in both space and distribution variables is derived, where the drift is bounded and Lipschitz continuous under weighted variation distance and the diffusion is allowed to be Lipschitz continuous under $L^\eta$($\eta\in(0,1]$)-Wasserstein distance. Moreover, the regularity estimate is established when the drift is bounded and Lipschitz continuous under total variation distance.


title: OAMatcher: An Overlapping Areas-based Network for Accurate Local Feature Matching

abstract: Local feature matching is an essential component in many visual applications. In this work, we propose OAMatcher, a Tranformer-based detector-free method that imitates humans behavior to generate dense and accurate matches. Firstly, OAMatcher predicts overlapping areas to promote effective and clean global context aggregation, with the key insight that humans focus on the overlapping areas instead of the entire images after multiple observations when matching keypoints in image pairs. Technically, we first perform global information integration across all keypoints to imitate the humans behavior of observing the entire images at the beginning of feature matching. Then, we propose Overlapping Areas Prediction Module (OAPM) to capture the keypoints in co-visible regions and conduct feature enhancement among them to simulate that humans transit the focus regions from the entire images to overlapping regions, hence realizeing effective information exchange without the interference coming from the keypoints in non overlapping areas. Besides, since humans tend to leverage probability to determine whether the match labels are correct or not, we propose a Match Labels Weight Strategy (MLWS) to generate the coefficients used to appraise the reliability of the ground-truth match labels, while alleviating the influence of measurement noise coming from the data. Moreover, we integrate depth-wise convolution into Tranformer encoder layers to ensure OAMatcher extracts local and global feature representation concurrently. Comprehensive experiments demonstrate that OAMatcher outperforms the state-of-the-art methods on several benchmarks, while exhibiting excellent robustness to extreme appearance variants. The source code is available at https://github.com/DK-HU/OAMatcher.


title: 3D Molecular Generation via Virtual Dynamics

abstract: Structure-based drug design, i.e., finding molecules with high affinities to the target protein pocket, is one of the most critical tasks in drug discovery. Traditional solutions, like virtual screening, require exhaustively searching on a large molecular database, which are inefficient and cannot return novel molecules beyond the database. The pocket-based 3D molecular generation model, i.e., directly generating a molecule with a 3D structure and binding position in the pocket, is a new promising way to address this issue. Herein, we propose VD-Gen, a novel pocket-based 3D molecular generation pipeline. VD-Gen consists of several carefully designed stages to generate fine-grained 3D molecules with binding positions in the pocket cavity end-to-end. Rather than directly generating or sampling atoms with 3D positions in the pocket like in early attempts, in VD-Gen, we first randomly initialize many virtual particles in the pocket; then iteratively move these virtual particles, making the distribution of virtual particles approximate the distribution of molecular atoms. After virtual particles are stabilized in 3D space, we extract a 3D molecule from them. Finally, we further refine atoms in the extracted molecule by iterative movement again, to get a high-quality 3D molecule, and predict a confidence score for it. Extensive experiment results on pocket-based molecular generation demonstrate that VD-Gen can generate novel 3D molecules to fill the target pocket cavity with high binding affinities, significantly outperforming previous baselines.


title: Existence and decays of solutions for fractional Schr\"{o}dinger equations with decaying potentials

abstract: We revisit the following fractional Schr\"{o}dinger equation \begin{align}\label{1a} \varepsilon^{2s}(-\Delta)^su +Vu=u^{p-1},\,\,\,u>0,\ \ \ \mathrm{in}\ \R^N, \end{align} where $\varepsilon>0$ is a small parameter, $(-\Delta)^s$ denotes the fractional Laplacian, $s\in(0,1)$, $p\in (2, 2_s^*)$, $2_s^*=\frac {2N}{N-2s}$, $N>2s$, $V\in C\big(\R^N, [0, +\infty)\big)$ is a potential. Under various decay assumptions on $V$, we introduce a uniform penalization argument combined with a comparison principle and iteration process to detect an explicit threshold value $p_*$, such that the above problem admits positive concentration solutions if $p\in (p_*, \,2_s^*)$, while it has no positive weak solutions for $p\in (2,\,p_*)$ if $p_*>2$, where the threshold $p_*\in [2, 2^*_s)$ can be characterized explicitly by \begin{equation*}\label{qdj111} p_*=\left\{\begin{array}{l} 2+\frac {2s}{N-2s} \ \ \ \text { if } \lim\limits_{|x| \to \infty} (1+|x|^{2s})V(x)=0,\vspace{1mm} 2+\frac {\omega}{N+2s-\omega} \text { if } 0<\inf (1+|x|^\omega)V(x)\le \sup (1+|x|^\omega)V(x)< \infty \text { for some } \omega \in [0, 2s],\vspace{1mm} 2 \ \ \ \ \ \ \ \ \ \ \ \ \ \ \text { if } \inf V(x)\log(e+|x|^2)>0. \end{array}\right. \end{equation*} Moreover, corresponding to the various decay assumptions of $V(x)$, we obtain the decay properties of the solutions at infinity.


title: Graph Learning Based Decision Support for Multi-Aircraft Take-Off and Landing at Urban Air Mobility Vertiports

abstract: Majority of aircraft under the Urban Air Mobility (UAM) concept are expected to be of the electric vertical takeoff and landing (eVTOL) vehicle type, which will operate out of vertiports. While this is akin to the relationship between general aviation aircraft and airports, the conceived location of vertiports within dense urban environments presents unique challenges in managing the air traffic served by a vertiport. This challenge becomes pronounced within increasing frequency of scheduled landings and take-offs. This paper assumes a centralized air traffic controller (ATC) to explore the performance of a new AI driven ATC approach to manage the eVTOLs served by the vertiport. Minimum separation-driven safety and delays are the two important considerations in this case. The ATC problem is modeled as a task allocation problem, and uncertainties due to communication disruptions (e.g., poor link quality) and inclement weather (e.g., high gust effects) are added as a small probability of action failures. To learn the vertiport ATC policy, a novel graph-based reinforcement learning (RL) solution called "Urban Air Mobility- Vertiport Schedule Management (UAM-VSM)" is developed. This approach uses graph convolutional networks (GCNs) to abstract the vertiport space and eVTOL space as graphs, and aggregate information for a centralized ATC agent to help generalize the environment. Unreal Engine combined with Airsim is used as the simulation environment over which training and testing occurs. Uncertainties are considered only during testing, due to the high cost of Mc sampling over such realistic simulations. The proposed graph RL method demonstrates significantly better performance on the test scenarios when compared against a feasible random decision-making baseline and a first come first serve (FCFS) baseline, including the ability to generalize to unseen scenarios and with uncertainties.


title: Auslander conditions and tilting-like cotorsion pairs

abstract: We study homological behavior of modules satisfying the Auslander condition. Assume that $\mathcal{AC}$ is the class of left $R$-modules satisfying the Auslander condition. It is proved that each cycle of an exact complex with each term in $\mathcal{AC}$ belongs to $\mathcal{AC}$ for any ring $R$. As a consequence, we show that for any left Noetherian ring $R$, $\mathcal{AC}$ is a resolving subcategory of the category of left $R$-modules if and only if $_RR$ satisfies the Auslander condition if and only if each Gorenstein projective left $R$-module belongs to $\mathcal{AC}$. As an application, we prove that, for an Artinian algebra $R$ satisfying the Auslander condition, $R$ is Gorenstein if and only if $\mathcal{AC}$ coincides with the class of Gorenstein projective left $R$-modules if and only if $({\mathcal{AC}^{< \infty}},(\mathcal{AC}^{<\infty})^\bot)$ is a tilting-like cotorsion pair if and only if (${\mathcal{AC}^{< \infty}},\mathcal{I}$) is a tilting-like cotorsion pair, where $\mathcal{AC}^{<\infty}$ is the class of left $R$-modules with finite $\mathcal{AC}$-dimension and $\mathcal{I}$ is the class of injective left $R$-modules. This leads to some criteria for the validity of the Auslander and Reiten conjecture which says that an Artinian algebra satisfying the Auslander condition is Gorenstein.


title: Deep Neural Networks for Nonparametric Interaction Models with Diverging Dimension

abstract: Deep neural networks have achieved tremendous success due to their representation power and adaptation to low-dimensional structures. Their potential for estimating structured regression functions has been recently established in the literature. However, most of the studies require the input dimension to be fixed and consequently ignore the effect of dimension on the rate of convergence and hamper their applications to modern big data with high dimensionality. In this paper, we bridge this gap by analyzing a $k^{th}$ order nonparametric interaction model in both growing dimension scenarios ($d$ grows with $n$ but at a slower rate) and in high dimension ($d \gtrsim n$). In the latter case, sparsity assumptions and associated regularization are required in order to obtain optimal rates of convergence. A new challenge in diverging dimension setting is in calculation mean-square error, the covariance terms among estimated additive components are an order of magnitude larger than those of the variances and they can deteriorate statistical properties without proper care. We introduce a critical debiasing technique to amend the problem. We show that under certain standard assumptions, debiased deep neural networks achieve a minimax optimal rate both in terms of $(n, d)$. Our proof techniques rely crucially on a novel debiasing technique that makes the covariances of additive components negligible in the mean-square error calculation. In addition, we establish the matching lower bounds.


title: "Why is this misleading?": Detecting News Headline Hallucinations with Explanations

abstract: Automatic headline generation enables users to comprehend ongoing news events promptly and has recently become an important task in web mining and natural language processing. With the growing need for news headline generation, we argue that the hallucination issue, namely the generated headlines being not supported by the original news stories, is a critical challenge for the deployment of this feature in web-scale systems Meanwhile, due to the infrequency of hallucination cases and the requirement of careful reading for raters to reach the correct consensus, it is difficult to acquire a large dataset for training a model to detect such hallucinations through human curation. In this work, we present a new framework named ExHalder to address this challenge for headline hallucination detection. ExHalder adapts the knowledge from public natural language inference datasets into the news domain and learns to generate natural language sentences to explain the hallucination detection results. To evaluate the model performance, we carefully collect a dataset with more than six thousand labeled <article, headline> pairs. Extensive experiments on this dataset and another six public ones demonstrate that ExHalder can identify hallucinated headlines accurately and justifies its predictions with human-readable natural language explanations.


title: Learning to write with the fluid rope trick

abstract: The range and speed of direct ink writing, the workhorse of 3d and 4d printing, is limited by the practice of liquid extrusion from a nozzle just above the surface to prevent instabilities to cause deviations from the required print path. But what if could harness the ``fluid rope trick", whence a thin stream of viscous fluid falling from a height spontaneously folds or coils, to write specified patterns on a substrate? Using Deep Reinforcement Learning we control the motion of the extruding nozzle and thence the fluid patterns that are deposited on the surface. The learner (nozzle) repeatedly interacts with the environment (a viscous filament simulator), and improves its strategy using the results of this experience. We demonstrate the results in an experimental setting where the learned motion control instructions are used to drive a viscous jet to accomplish complex tasks such as cursive writing and Pollockian paintings.


title: An isoperimetric inequality for the harmonic mean of Steklov eigenvalues in rank one symmetric spaces

abstract: In this note, an isoperimetric inequality for the harmonic mean of lower order Steklov eigenvalues is proved on bounded domains in noncompact rank-$1$ symmetric spaces. This work extends result of \cite{BR.01} and \cite{V.21} proved for bounded domains in Euclidean space and Hyperbolic space, respectively.


title: Investigation of Enhanced Inertial Navigation Algorithms by Functional Iteration

abstract: The defects of the traditional strapdown inertial navigation algorithms become well acknowledged and the corresponding enhanced algorithms have been quite recently proposed trying to mitigate both theoretical and algorithmic defects. In this paper, the analytical accuracy evaluation of both the traditional algorithms and the enhanced algorithms is investigated, against the true reference for the first time enabled by the functional iteration approach having provable convergence. The analyses by the help of MATLAB Symbolic Toolbox show that the resultant error orders of all algorithms under investigation are consistent with those in the existing literatures, and the enhanced attitude algorithm notably reduces error orders of the traditional counterpart, while the impact of the enhanced velocity algorithm on error order reduction is insignificant. Simulation results agree with analyses that the superiority of the enhanced algorithm over the traditional one in the body-frame attitude computation scenario diminishes significantly in the entire inertial navigation computation scenario, while the functional iteration approach possesses significant accuracy superiority even under sustained lowly dynamic conditions.


title: Gauge invariance of radiative jet functions in the position-space formulation of SCET

abstract: In subleading powers of soft-collinear effective theory (SCET), the Lagrangian contains couplings between soft quarks and hard-collinear quarks. Matrix elements of the hard-collinear parts of these couplings are radiative jet functions. In the position-space formulation of SCET, the Lagrangians are constructed from operators that appear to be gauge invariant. Nevertheless, we find violations of gauge invariance arise in the hard-collinear sector because gauge transformations can shift the momentum of a hard-collinear quark field from the hard-collinear sector to the soft sector, where the hard-collinear fields, by definition, have no support. The violations of gauge invariance are manifested in perturbation theory in the hard-collinear sector through the absence of certain Feynman diagrams that would be present in full QCD. A consequence of the absence of these diagrams is that the radiative jet functions that follow directly from the position-space Lagrangians are not gauge invariant, and we demonstrate this through explicit calculations in lower-order perturbation theory. We obtain gauge-invariant Lagrangians by adding to existing position-space Lagrangians terms that are proportional to the soft-quark equation of motion. These gauge-invariant Lagrangians are valid for nonzero, as well as zero, quark masses. We also remark briefly on the gauge invariance of certain Lagrangians that have been constructed in the label-momentum formulation of SCET.


title: Sums, series, and products in Diophantine approximation

abstract: There is not much that can be said for all $x$ and for all $n$ about the sum \[ \sum_{k=1}^n \frac{1}{|\sin k\pi x|}. \] However, for this and similar sums, series, and products, we can establish results for almost all $x$ using the tools of continued fractions. We present in detail the appearance of these sums in the singular series for the circle method. One particular interest of the paper is the detailed proof of a striking result of Hardy and Littlewood, whose compact proof, which delicately uses analytic continuation, has not been written freshly anywhere since its original publication. This story includes various parts of late 19th century and early 20th century mathematics.


title: Sensing and Navigation of Aerial Robot for Measuring Tree Location and Size in Forest Environment

abstract: This paper shows the achievement of a sensing and navigation system of aerial robot for measuring location and size of trees in a forest environment autonomously. Although forestry is an important industry in Japan, the working population of forestry is decreasing. Then, as an application of mechanization of forestry, we propose tree data collection system by aerial robots which have high mobility in three-dimensional space. First, we develop tree recognition and measurement method, along with algorithm to generate tree database. Second, we describe aerial robot navigation system based on tree recognition. Finally, we present an experimental result in which an aerial robot flies in a forest and collects tree data.


title: Frequency-resolved microscopic current density analysis of linear and nonlinear optical phenomena in solids

abstract: We perform a frequency-resolved analysis of electron dynamics in solids to obtain microscopic insight into linear and nonlinear optical phenomena. For the analysis, we first compute the electron dynamics under optical electric fields and evaluate the microscopic current density as a function of time and space. Subsequently, we perform the Fourier transformation on the microscopic current density and obtain the corresponding quantity in the frequency domain. The frequency-resolved microscopic current density provides insight into the microscopic electron dynamics in real-space at the frequency of linear and nonlinear optical responses. We apply frequency-resolved microscopic current density analysis to light-induced electron dynamics in aluminum, silicon, and diamond based on the first-principles electron dynamics simulation according to the time-dependent density functional theory. Consequently, the nature of delocalized electrons in metals and bound electrons in semiconductors and insulators is suitably captured by the developed scheme.


title: Abelian varieties are not quotients of low-dimension Jacobians

abstract: We prove that for any two integers $g\geq 4$ and $g'\leq 2g-1$, there exist abelian varieties over $\overline{\mathbb{Q}}$ which are not quotients of a Jacobian of dimension $g'$. Our method in fact proves that most Abelian varieties satisfy this property, when counting by height relative to a fixed finite map to projective space.


title: Quasinormal modes of a scalar perturbation around a rotating BTZ-like black hole in Einstein-bumblebee gravity

abstract: We analytically study the quasinormal modes of a scalar perturbation around a rotating BTZ-like black hole in the Einstein-bumblebee gravity. We observe that the Lorentz symmetry breaking parameter imprints only in the imaginary parts of the quasinormal frequencies for the right-moving and left-moving modes. The perturbational field decays more rapidly for the negative Lorentz symmetry breaking parameter, but more slowly for the positive one. The forms of the real parts are the same as those in the usual BTZ black holes. Moreover, we also discuss the $AdS/CFT$ correspondence from the quasinormal modes and find that the Lorentz symmetry breaking parameter enhances the left and right conformal weights $h_L$ and $h_R$ of the operators dual to the scalar field in the boundary. These results could be helpful to understand the $AdS/CFT$ correspondence and the Einstein-bumblebee gravity with the Lorentz symmetry violation.


title: Denoising and Prompt-Tuning for Multi-Behavior Recommendation

abstract: In practical recommendation scenarios, users often interact with items under multi-typed behaviors (e.g., click, add-to-cart, and purchase). Traditional collaborative filtering techniques typically assume that users only have a single type of behavior with items, making it insufficient to utilize complex collaborative signals to learn informative representations and infer actual user preferences. Consequently, some pioneer studies explore modeling multi-behavior heterogeneity to learn better representations and boost the performance of recommendations for a target behavior. However, a large number of auxiliary behaviors (i.e., click and add-to-cart) could introduce irrelevant information to recommenders, which could mislead the target behavior (i.e., purchase) recommendation, rendering two critical challenges: (i) denoising auxiliary behaviors and (ii) bridging the semantic gap between auxiliary and target behaviors. Motivated by the above observation, we propose a novel framework-Denoising and Prompt-Tuning (DPT) with a three-stage learning paradigm to solve the aforementioned challenges. In particular, DPT is equipped with a pattern-enhanced graph encoder in the first stage to learn complex patterns as prior knowledge in a data-driven manner to guide learning informative representation and pinpointing reliable noise for subsequent stages. Accordingly, we adopt different lightweight tuning approaches with effectiveness and efficiency in the following stages to further attenuate the influence of noise and alleviate the semantic gap among multi-typed behaviors. Extensive experiments on two real-world datasets demonstrate the superiority of DPT over a wide range of state-of-the-art methods. The implementation code is available online at https://github.com/zc-97/DPT.


title: NFTDisk: Visual Detection of Wash Trading in NFT Markets

abstract: With the growing popularity of Non-Fungible Tokens (NFT), a new type of digital assets, various fraudulent activities have appeared in NFT markets. Among them, wash trading has become one of the most common frauds in NFT markets, which attempts to mislead investors by creating fake trading volumes. Due to the sophisticated patterns of wash trading, only a subset of them can be detected by automatic algorithms, and manual inspection is usually required. We propose NFTDisk, a novel visualization for investors to identify wash trading activities in NFT markets, where two linked visualization modules are presented: a radial visualization module with a disk metaphor to overview NFT transactions and a flow-based visualization module to reveal detailed NFT flows at multiple levels. We conduct two case studies and an in-depth user interview with 14 NFT investors to evaluate NFTDisk. The results demonstrate its effectiveness in exploring wash trading activities in NFT markets.


title: Intelligent Reflecting Surface Aided Wireless Sensing: Applications and Design Issues

abstract: Intelligent reflecting surface (IRS) is an emerging technology that is able to significantly improve the performance of wireless communications, by smartly tuning signal reflections at a large number of passive reflecting elements. On the other hand, with ubiquitous wireless devices and ambient radio-frequency signals, wireless sensing has become a promising new application for the next-generation/6G wireless networks. By synergizing low-cost IRS and fertile wireless sensing applications, this article proposes a new IRS-aided sensing paradigm for enhancing the performance of wireless sensing cost-effectively. First, we provide an overview of wireless sensing applications and the new opportunities of utilizing IRS for overcoming their performance limitations in practical scenarios. Next, we discuss IRS-aided sensing schemes based on three approaches, namely, passive sensing, semi-passive sensing, and active sensing. We compare their pros and cons in terms of performance, hardware cost and implementation complexity, and outline their main design issues including IRS deployment, channel acquisition and reflection design, as well as sensing algorithms. Finally, numerical results are presented to demonstrate the great potential of IRS for improving wireless sensing accuracy and the superior performance of IRS active sensing compared to other schemes.


title: Flag Aggregator: Scalable Distributed Training under Failures and Augmented Losses using Convex Optimization

abstract: Modern ML applications increasingly rely on complex deep learning models and large datasets. There has been an exponential growth in the amount of computation needed to train the largest models. Therefore, to scale computation and data, these models are inevitably trained in a distributed manner in clusters of nodes, and their updates are aggregated before being applied to the model. However, a distributed setup is prone to Byzantine failures of individual nodes, components, and software. With data augmentation added to these settings, there is a critical need for robust and efficient aggregation systems. We define the quality of workers as reconstruction ratios $\in (0,1]$, and formulate aggregation as a Maximum Likelihood Estimation procedure using Beta densities. We show that the Regularized form of log-likelihood wrt subspace can be approximately solved using iterative least squares solver, and provide convergence guarantees using recent Convex Optimization landscape results. Our empirical findings demonstrate that our approach significantly enhances the robustness of state-of-the-art Byzantine resilient aggregators. We evaluate our method in a distributed setup with a parameter server, and show simultaneous improvements in communication efficiency and accuracy across various tasks. The code is publicly available at https://github.com/hamidralmasi/FlagAggregator


title: Nonminimally Assisted Inflation: A General Analysis

abstract: The effects of a scalar field, known as the "assistant field," which nonminimally couples to gravity, on single-field inflationary models are studied. The analysis provides analytical expressions for inflationary observables such as the spectral index ($n_s$), the tensor-to-scalar ratio ($r$), and the local-type nonlinearity parameter ($f_{\rm NL}^{(\rm local)}$). The presence of the assistant field leads to a lowering of $n_s$ and $r$ in most of the parameter space, compared to the original predictions. In some cases, $n_s$ may increase due to the assistant field. This revives compatibility between ruled-out single-field models and the latest observations by Planck-BICEP/Keck. The results are demonstrated using three example models: loop inflation, power-law inflation, and hybrid inflation.


title: The amalgamation property and Urysohn structures in continuous logic

abstract: In this paper we consider the classes of all continuous $\mathcal{L}$-(pre-)structures for a continuous first-order signature $\mathcal{L}$. We characterize the moduli of continuity for which the classes of finite, countable, or all continuous $\mathcal{L}$-(pre-)structures have the amalgamation property. We also characterize when Urysohn continuous $\mathcal{L}$-(pre)-structures exist, establish that certain classes of finite continuous $\mathcal{L}$-structures are countable Fra\"iss\'e classes, prove the coherent EPPA for these classes of finite continuous $\mathcal{L}$-structures, and show that actions by automorphisms on finite $\mathcal{L}$-structures also form a Fra\"iss\'e class. As consequences, we have that the automorphism group of the Urysohn continuous $\mathcal{L}$-structure is a universal Polish group and that Hall's universal locally finite group is contained in the automorphism group of the Urysohn continuous $\mathcal{L}$-structure as a dense subgroup.


title: On the intermediate value property of spectra for a class of Moran spectral measures

abstract: We prove that the Beurling dimensions of the spectra for a class of Moran spectral measures are between $0$ and their upper entropy dimensions. Moreover, for such a Moran spectral measure $\mu$, we show that the Beurling dimension for the spectra of $\mu$ has the intermediate value property: let $t$ be any value between $0$ and the upper entropy dimension of $\mu$, then there exists a spectrum whose Beurling dimension is $t.$ In particular, this result settles affirmatively a conjecture involving spectral Bernoulli convolution proposed by Fu, He and Wen in [J. Math. Pures Appl. 116 (2018), 105--131]. Furthermore, we prove that the set of the spectra whose Beurling dimensions are equal to any fixed value between $0$ and $\ue \mu$ has the cardinality of the continuum.


title: Efficient Integer Retrieving from Unordered Compressed Sequences

abstract: The variable-length Reverse Multi-Delimiter (RMD) codes are known to represent sequences of unbounded and unordered integers. When applied to data compression, they combine a good compression ratio with fast decoding. In this paper, we investigate another property of RMD-codes - the ability of direct access to codewords in the encoded bitstream. We present the method allowing us to extract and decode a codeword from an RMD-bitstream in almost constant time with the tiny space overhead, and make experiments on its application to natural language text compression.


title: Three-dimensional exponential sums under constant perturbation

abstract: In this paper, by generalizing Bombieri and Iwaniec's double large sieve inequality, we obtain an estimation on a type of three-dimensional exponential sums with constant perturbation. As an application of our estimation, we obtain an asymptotic formula for a sum involving the Mangoldt function and the integral part function. This type of sum was originally studied by Bordelles-Dai-Heyman-Pan-Shparlinski.


title: Second harmonic and cascaded third harmonic generation in generalized quasi-periodic poled lithium niobate waveguides

abstract: Lithium niobate (LN) thin film has recently emerged as an important platform for nonlinear optical investigations for its large $\chi^{(2)}$ nonlinear coefficients and ability of light localization. In this paper, we report the first fabrication of LN on insulator (LNOI) ridge waveguides with generalized quasi-periodic poled superlattices using the electric field polarization technique and microfabrication techniques. Benefiting from the abundant reciprocal vectors, we observed efficient second-harmonic and cascaded third-harmonic signals in the same device, with the normalized conversion efficiency 1735% W$^{-1}$cm$^{-2}$ and 0.41% W$^{-2}$cm$^{-4}$, respectively. This work opens a new direction of nonlinear integrated photonics based on LN thin film.


title: I$^2$SB: Image-to-Image Schr\"odinger Bridge

abstract: We propose Image-to-Image Schr\"odinger Bridge (I$^2$SB), a new class of conditional diffusion models that directly learn the nonlinear diffusion processes between two given distributions. These diffusion bridges are particularly useful for image restoration, as the degraded images are structurally informative priors for reconstructing the clean images. I$^2$SB belongs to a tractable class of Schr\"odinger bridge, the nonlinear extension to score-based models, whose marginal distributions can be computed analytically given boundary pairs. This results in a simulation-free framework for nonlinear diffusions, where the I$^2$SB training becomes scalable by adopting practical techniques used in standard diffusion models. We validate I$^2$SB in solving various image restoration tasks, including inpainting, super-resolution, deblurring, and JPEG restoration on ImageNet 256x256 and show that I$^2$SB surpasses standard conditional diffusion models with more interpretable generative processes. Moreover, I$^2$SB matches the performance of inverse methods that additionally require the knowledge of the corruption operators. Our work opens up new algorithmic opportunities for developing efficient nonlinear diffusion models on a large scale. scale. Project page and codes: https://i2sb.github.io/


title: Back-Reaction of Long-Wavelength Cosmological Fluctuations as Measured by a Clock Field

abstract: We consider the back-reaction of cosmological fluctuations on the local expansion rate averaged over a space-like hypersurface of constant value of a clock field. We show that in the infrared limit, the fluctuations lead to a decrease in the average expansion rate, measured at a fixed value of the clock field, compared to what would be obtained in a homogeneous universe. We work in the context of Einstein gravity coupled to perfect fluid matter.


title: A note on the top Lyapunov exponent of linear cooperative systems

abstract: In a recent paper [Asymptotic of the largest Floquet multiplier for cooperative matrices Annales de la Facult\'e des Sciences de Toulouse, Tome XXXI, no 4 (2022)] P. Carmona gives an asymptotic formulae for the top Lyapunov exponent of a linear T-periodic cooperative differential equation, in the limit T goes to infinity. This short note discusses and extends this result.


title: A tensor optimization algorithm for computing Lagrangians of hypergraphs

abstract: The Lagrangian of a hypergraph is a crucial tool for studying hypergraph extremal problems. Though Lagrangians of some special structure hypergraphs have closed-form solutions, it is a challenging problem to compute the Lagrangian of a general large scale hypergraph. In this paper, we exploit a fast computational scheme involving the adjacency tensor of a hypergraph. Furthermore, we propose to utilize the gradient projection method on a simplex from nonlinear optimization for solving the Lagrangian of a large scale hypergraph iteratively. Using the Lojasiewicz gradient inequality, we analyze the global and local convergence of the gradient projection method. Numerical experiments illustrate that the proposed numerical method could compute Lagrangians of large scale hypergraphs efficiently.


title: Statistics of paths on graphs with two heavy roots

abstract: The paper considers the behaviour of the number of paths of length $N$ on graphs with two heavy roots. Such vertices can be entropic traps. Numerical analysis is carried out for graphs with different degrees of root vertices. In the symmetric case, a numerical analysis of the number of paths is performed. It is found that localisation is observed with the same ratio of vertex degrees as in the case of a single root. An analysis of the entropy forces of interaction was also carried out for two roots.


title: Physical charges versus conformal invariance in unimodular gravity

abstract: Unimodularity can be implemented in different ways. In this paper we consider only the formulation of Unimodular Gravity in which the unimodular metric is obtained out of an unrestricted one as $\g_{\m\n}=|g|^{-{1\over n}} g_{\m\n}$. This procedure induces an extra Weyl symmetry. Some physical implications of this symmetry on the conserved currents are discussed. Finally the results are illustrated for the Painlev\'e-Gullstrand extension of Schwarzschild spacetime.


title: Ordinary muon capture rates on $^{100}$Mo and $^{\rm nat}$Mo for astro-antineutrinos and double beta decays

abstract: \item[Background] The nuclear responses for antineutrinos associated with double beta decays (DBDs) and astro-antineutrino interactions are studied by measuring ordinary muon capture (OMC) rates. \item[Purpose]The experimental studies of absolute OMC rates and their mass number dependence for $^{100}$Mo and the natural Mo are currently of interest in astro-antineutrinos and DBDs. \item[Method]The OMC rates were obtained experimentally by measuring the time spectrum of the trapped muon's decay into electrons to obtain the half-lives of the trapped muons. \item[Results]The OMC rate for the enriched isotope of $^{100}$Mo is $\Lambda$($^{100}$Mo)=(7.07$\pm$0.32)$\times10^{6}$ s$^{-1}$, while that for the natural Mo is $\Lambda$($^{\rm nat}$Mo)=(9.66$\pm$0.44)$\times10^{6}$ s$^{-1}$, i.e., $\Lambda$($^{100}$Mo) is about 27$\%$ of $\Lambda$($^{\rm nat}$Mo), reflecting the blocking effect of the excess neutrons for the proton-to-neutron transformation in OMC. The present experimental observation is consistent with the predictions using Goulard-Primakoff's (GPs) and Primakoff's (Ps) empirical equations. \item[Conclusions] The absolute OMC rates for $^{100}$Mo and $^{\rm nat}$Mo were measured. The large neutron excess in $^{100}$Mo gives a much lower OMC rate than $^{\rm nat}$Mo. On both $^{100}$Mo and $^{\rm nat}$Mo, consistent OMC rates with the GP and P values are observed.


title: Coexistence-segregation dichotomy in the full cross-diffusion limit of the stationary SKT model

abstract: This paper studies the Lotka-Volterra competition model with cross-diffusion terms under homogeneous Dirichlet boundary conditions. We consider the asymptotic behavior of positive steady-states as equal two cross-diffusion coefficients tend to infinity (so-called the full cross-diffusion limit). The first result shows that, at the full cross-diffusion limit, the set of positive steady-state solutions can be classified into two types: the small coexistence or the complete segregation. The small coexistence can be characterized by the set of positive solutions of a nonlinear elliptic equation, while the complete segregation can be characterized by the set of nodal solutions of another nonlinear elliptic equation. The second result concerns the global bifurcation structure of the 1d model with large cross-diffusion terms to show that the branch of small coexistence bifurcates from the trivial solution and many branches of complete segregation bifurcate from solutions on the branch of small coexistence. Finally, in order to verify the theoretical results, we chase some bifurcation branches numerically via the continuation software pde2path.


title: Higher dimensional integrable deformations of the modified KdV equation

abstract: The derivation of nonlinear integrable evolution partial differential equations in higher dimensions has always been the holy grail in the field of integrability. The well-known modified KdV equation is a prototypical example of integrable evolution equations in one spatial dimension. Do there exist integrable analogs of modified KdV equation in higher spatial dimensions? In what follows, we present a positive answer to this question. In particular, rewriting the (1+1)-dimensional integrable modified KdV equation in conservation forms and adding deformation mappings during the process allow one to construct higher dimensional integrable equations. Further, we illustrate this idea with examples from the modified KdV hierarchy, also present the Lax pairs of these higher dimensional integrable evolution equations.


title: A generalizable framework for low-rank tensor completion with numerical priors

abstract: Low-Rank Tensor Completion, a method which exploits the inherent structure of tensors, has been studied extensively as an effective approach to tensor completion. Whilst such methods attained great success, none have systematically considered exploiting the numerical priors of tensor elements. Ignoring numerical priors causes loss of important information regarding the data, and therefore prevents the algorithms from reaching optimal accuracy. Despite the existence of some individual works which consider ad hoc numerical priors for specific tasks, no generalizable frameworks for incorporating numerical priors have appeared. We present the Generalized CP Decomposition Tensor Completion (GCDTC) framework, the first generalizable framework for low-rank tensor completion that takes numerical priors of the data into account. We test GCDTC by further proposing the Smooth Poisson Tensor Completion (SPTC) algorithm, an instantiation of the GCDTC framework, whose performance exceeds current state-of-the-arts by considerable margins in the task of non-negative tensor completion, exemplifying GCDTC's effectiveness. Our code is open-source.


title: From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks

abstract: This manuscript investigates the one-pass stochastic gradient descent (SGD) dynamics of a two-layer neural network trained on Gaussian data and labels generated by a similar, though not necessarily identical, target function. We rigorously analyse the limiting dynamics via a deterministic and low-dimensional description in terms of the sufficient statistics for the population risk. Our unifying analysis bridges different regimes of interest, such as the classical gradient-flow regime of vanishing learning rate, the high-dimensional regime of large input dimension, and the overparameterised "mean-field" regime of large network width, covering as well the intermediate regimes where the limiting dynamics is determined by the interplay between these behaviours. In particular, in the high-dimensional limit, the infinite-width dynamics is found to remain close to a low-dimensional subspace spanned by the target principal directions. Our results therefore provide a unifying picture of the limiting SGD dynamics with synthetic data.


title: On the accuracy of Prony's method for recovery of exponential sums with closely spaced exponents

abstract: In this paper we establish accuracy bounds of Prony's method (PM) for recovery of sparse measures from incomplete and noisy frequency measurements, or the so-called problem of super-resolution, when the minimal separation between the points in the support of the measure may be much smaller than the Rayleigh limit. In particular, we show that PM is optimal with respect to the previously established min-max bound for the problem, in the setting when the measurement bandwidth is constant, with the minimal separation going to zero. Our main technical contribution is an accurate analysis of the inter-relations between the different errors in each step of PM, resulting in previously unnoticed cancellations. We also prove that PM is numerically stable in finite-precision arithmetic. We believe our analysis will pave the way to providing accurate analysis of known algorithms for the super-resolution problem in full generality.


title: Exploration of carbonate aggregates in road construction using ultrasonic and artificial intelligence approaches

abstract: The COVID-19 pandemic has significantly impacted the construction sector, which is sensitive to economic cycles. In order to boost value and efficiency in this sector, the use of innovative exploration technologies such as ultrasonic and Artificial Intelligence techniques in building material research is becoming increasingly crucial. In this study, we developed two models for predicting the Los Angeles (LA) and Micro Deval (MDE) coefficients, two important geotechnical tests used to determine the quality of rock aggregates. These coefficients describe the resistance of aggregates to fragmentation and abrasion. The ultrasound velocity, porosity, and density of the rocks were determined and used as inputs to develop prediction models using multiple regression and an artificial neural network. These models may be used to assess the quality of rock aggregates at the exploration stage without the need for tedious laboratory analysis.


title: Quantitative and stable limits of high-frequency statistics of L\'evy processes: a Stein's method approach

abstract: We establish inequalities for assessing the distance between the distribution of errors of partially observed high-frequency statistics of multidimensional L\'evy processes and that of a mixed Gaussian random variable. Furthermore, we provide a general result guaranteeing stable functional convergence. Our arguments rely on a suitable adaptation of the Stein's method perspective to the context of mixed Gaussian distributions, specifically tailored to the framework of high-frequency statistics.


title: An unsupervised learning approach for predicting wind farm power and downstream wakes using weather patterns

abstract: Wind energy resource assessment typically requires numerical models, but such models are too computationally intensive to consider multi-year timescales. Increasingly, unsupervised machine learning techniques are used to identify a small number of representative weather patterns to simulate long-term behaviour. Here we develop a novel wind energy workflow that for the first time combines weather patterns derived from unsupervised clustering techniques with numerical weather prediction models (here WRF) to obtain efficient and accurate long-term predictions of power and downstream wakes from an entire wind farm. We use ERA5 reanalysis data clustering not only on low altitude pressure but also, for the first time, on the more relevant variable of wind velocity. We also compare the use of large-scale and local-scale domains for clustering. A WRF simulation is run at each of the cluster centres and the results are aggregated using a novel post-processing technique. By applying our workflow to two different regions, we show that our long-term predictions agree with those from a year of WRF simulations but require less than 2% of the computational time. The most accurate results are obtained when clustering on wind velocity. Moreover, clustering over the Europe-wide domain is sufficient for predicting wind farm power output, but downstream wake predictions benefit from the use of smaller domains. Finally, we show that these downstream wakes can affect the local weather patterns. Our approach facilitates multi-year predictions of power output and downstream farm wakes, by providing a fast, accurate and flexible methodology that is applicable to any global region. Moreover, these accurate long-term predictions of downstream wakes provide the first tool to help mitigate the effects of wind energy loss downstream of wind farms, since they can be used to determine optimum wind farm locations.


title: First discovery of QPOs in the dwarf nova HS 2325+8205 based on TESS photometry

abstract: HS 2325+8205 is a long-period eclipsing dwarf nova with an orbital period above the period gap (Porb>3 h) and is reported to be a Z Cam-type dwarf nova. Based on the photometry of the Transiting Exoplanet Survey Satellite (TESS), the light variation and the quasi-periodic oscillation (QPOs) of HS 2325+8205 are studied. Using Continuous Wavelet Transform (CWT), Lomb-Scargle Periodogram (LSP), and sine fitting methods, we find for the first time that there is a QPOs of ~ 2160s in the long outburst top light curves of HS 2325+8205. Moreover, we find that the oscillation intensity of the QPOs of HS 2325+8205 is related to the orbital phase, and the intensity in orbital phases 0.5-0.9 are stronger than in orbital phases 0.1-0.5. Therefore, the relationship between the oscillation intensity of QPOs and the orbital phase may become a research window for the origin of QPOs. In addition, we use the LSP to correct the orbital period of HS 2325+8205 as 0.19433475(6) d.


title: Position Matters! Empirical Study of Order Effect in Knowledge-grounded Dialogue

abstract: With the power of large pretrained language models, various research works have integrated knowledge into dialogue systems. The traditional techniques treat knowledge as part of the input sequence for the dialogue system, prepending a set of knowledge statements in front of dialogue history. However, such a mechanism forces knowledge sets to be concatenated in an ordered manner, making models implicitly pay imbalanced attention to the sets during training. In this paper, we first investigate how the order of the knowledge set can influence autoregressive dialogue systems' responses. We conduct experiments on two commonly used dialogue datasets with two types of transformer-based models and find that models view the input knowledge unequally. To this end, we propose a simple and novel technique to alleviate the order effect by modifying the position embeddings of knowledge input in these models. With the proposed position embedding method, the experimental results show that each knowledge statement is uniformly considered to generate responses.


title: USER: Unsupervised Structural Entropy-based Robust Graph Neural Network

abstract: Unsupervised/self-supervised graph neural networks (GNN) are vulnerable to inherent randomness in the input graph data which greatly affects the performance of the model in downstream tasks. In this paper, we alleviate the interference of graph randomness and learn appropriate representations of nodes without label information. To this end, we propose USER, an unsupervised robust version of graph neural networks that is based on structural entropy. We analyze the property of intrinsic connectivity and define intrinsic connectivity graph. We also identify the rank of the adjacency matrix as a crucial factor in revealing a graph that provides the same embeddings as the intrinsic connectivity graph. We then introduce structural entropy in the objective function to capture such a graph. Extensive experiments conducted on clustering and link prediction tasks under random-noises and meta-attack over three datasets show USER outperforms benchmarks and is robust to heavier randomness.


title: Digging Deeper: Operator Analysis for Optimizing Nonlinearity of Boolean Functions

abstract: Boolean functions are mathematical objects with numerous applications in domains like coding theory, cryptography, and telecommunications. Finding Boolean functions with specific properties is a complex combinatorial optimization problem where the search space grows super-exponentially with the number of input variables. One common property of interest is the nonlinearity of Boolean functions. Constructing highly nonlinear Boolean functions is difficult as it is not always known what nonlinearity values can be reached in practice. In this paper, we investigate the effects of the genetic operators for bit-string encoding in optimizing nonlinearity. While several mutation and crossover operators have commonly been used, the link between the genotype they operate on and the resulting phenotype changes is mostly obscure. By observing the range of possible changes an operator can provide, as well as relative probabilities of specific transitions in the objective space, one can use this information to design a more effective combination of genetic operators. The analysis reveals interesting insights into operator effectiveness and indicates how algorithm design may improve convergence compared to an operator-agnostic genetic algorithm.


title: Dirac operator associated to a quantum metric

abstract: We construct a canonical geometrically realised Connes spectral triple or `Dirac operator' $D\!\!\!/$ from the data of a quantum metric $g\in \Omega^1\otimes_A\Omega^1$ and quantum Levi-Civita bimodule connection, at the pre-Hilbert space level. Here $A$ is a possibly noncommutative coordinate algebra, $\Omega^1$ a bimodule of 1-forms and the spinor bundle is $S=A\oplus\Omega^1$. When applied to graphs or lattices, we essentially recover a Dirac operator previously proposed by Bianconi but now as a geometrically realised spectral triple. We also apply the construction to the fuzzy sphere and to $2\times 2$ matrices with their standard quantum Riemannian geometries. We also propose how $D\!\!\!/$ can be minimally coupled to an external potential.


title: TextDefense: Adversarial Text Detection based on Word Importance Entropy

abstract: Currently, natural language processing (NLP) models are wildly used in various scenarios. However, NLP models, like all deep models, are vulnerable to adversarially generated text. Numerous works have been working on mitigating the vulnerability from adversarial attacks. Nevertheless, there is no comprehensive defense in existing works where each work targets a specific attack category or suffers from the limitation of computation overhead, irresistible to adaptive attack, etc. In this paper, we exhaustively investigate the adversarial attack algorithms in NLP, and our empirical studies have discovered that the attack algorithms mainly disrupt the importance distribution of words in a text. A well-trained model can distinguish subtle importance distribution differences between clean and adversarial texts. Based on this intuition, we propose TextDefense, a new adversarial example detection framework that utilizes the target model's capability to defend against adversarial attacks while requiring no prior knowledge. TextDefense differs from previous approaches, where it utilizes the target model for detection and thus is attack type agnostic. Our extensive experiments show that TextDefense can be applied to different architectures, datasets, and attack methods and outperforms existing methods. We also discover that the leading factor influencing the performance of TextDefense is the target model's generalizability. By analyzing the property of the target model and the property of the adversarial example, we provide our insights into the adversarial attacks in NLP and the principles of our defense method.


title: Do Central Compact Objects have Carbon Atmospheres?

abstract: Only three of the dozen central compact objects (CCOs) in supernova remnants (SNRs) show thermal X-ray pulsations due to non-uniform surface temperature (hot-spots). The absence of X-ray pulsations from several unpulsed CCOs has motivated suggestions that they have uniform-temperature carbon atmospheres (UTCAs), which adequately fit their spectra with appropriate neutron star (NS) surface areas. This is in contrast to the two-temperature blackbody or hydrogen atmospheres that also fit well. Here we investigate the applicability of UTCAs to CCOs. We show the following: (i) The phase-averaged spectra of the three pulsed CCOs can also be fitted with a UTCA of the appropriate NS area, despite pulsed CCOs manifestly having non-uniform surface temperature. A good spectral fit is therefore not strong support for the UTCA model of unpulsed CCOs. (ii) An improved spectrum of one unpulsed CCO, previously analyzed with a UTCA, does not allow an acceptable fit. (iii) For two unpulsed CCOs, the UTCA does not allow a distance compatible with the SNR distance. These results imply that, in general, CCOs must have hot, localized regions on the NS surface. We derive new X-ray pulse modulation upper limits on the unpulsed CCOs, and constrain their hot spot sizes and locations. We develop an alternative model that accounts for both the pulsed and unpulsed CCOs: a range of angles between hot spot and rotation axes consistent with an exponential distribution with scale factor $\lambda \sim 20^{\circ}$. We discuss physical mechanisms that could produce such small angles and small hot-spots.


title: Neural Architecture Search with Multimodal Fusion Methods for Diagnosing Dementia

abstract: Alzheimer's dementia (AD) affects memory, thinking, and language, deteriorating person's life. An early diagnosis is very important as it enables the person to receive medical help and ensure quality of life. Therefore, leveraging spontaneous speech in conjunction with machine learning methods for recognizing AD patients has emerged into a hot topic. Most of the previous works employ Convolutional Neural Networks (CNNs), to process the input signal. However, finding a CNN architecture is a time-consuming process and requires domain expertise. Moreover, the researchers introduce early and late fusion approaches for fusing different modalities or concatenate the representations of the different modalities during training, thus the inter-modal interactions are not captured. To tackle these limitations, first we exploit a Neural Architecture Search (NAS) method to automatically find a high performing CNN architecture. Next, we exploit several fusion methods, including Multimodal Factorized Bilinear Pooling and Tucker Decomposition, to combine both speech and text modalities. To the best of our knowledge, there is no prior work exploiting a NAS approach and these fusion methods in the task of dementia detection from spontaneous speech. We perform extensive experiments on the ADReSS Challenge dataset and show the effectiveness of our approach over state-of-the-art methods.


title: Discourse Structure Extraction from Pre-Trained and Fine-Tuned Language Models in Dialogues

abstract: Discourse processing suffers from data sparsity, especially for dialogues. As a result, we explore approaches to build discourse structures for dialogues, based on attention matrices from Pre-trained Language Models (PLMs). We investigate multiple tasks for fine-tuning and show that the dialogue-tailored Sentence Ordering task performs best. To locate and exploit discourse information in PLMs, we propose an unsupervised and a semi-supervised method. Our proposals achieve encouraging results on the STAC corpus, with F1 scores of 57.2 and 59.3 for unsupervised and semi-supervised methods, respectively. When restricted to projective trees, our scores improved to 63.3 and 68.1.


title: Scaling relations of X-ray Luminous Clusters in the Hyper Suprime-Cam Subaru Strategic Program Field

abstract: We present the XMM-Newton X-ray analysis of 19 X-ray luminous galaxy clusters of low-to-mid redshift ($< 0.4$) selected from the MCXC cluster catalogue in the Hyper Supri%survey as the first work in our series paper. We derive the hydrostatic equilibrium mass and study scaling relations using i) the whole sample, ii) only relaxed clusters and iii) only disturbed clusters. When considering the whole sample, the $Y_{\rm X}$-$M_{\rm tot}$ and $M_{\rm gas}$-$M_{\rm tot}$ relations agree with self-similarity. In terms of morphology, relaxed clusters show a flatter relation in $L_{\rm X,ce}$-$M_{\rm tot}$, $L_{\rm X,bol}$-$M_{\rm tot}$, $L_{\rm X,ce}$-$T$, $L_{\rm bol,ce}$-$T$, $M_{\rm gas}$-$M_{\rm tot}$ and $Y_{\rm X}$-$M_{\rm tot}$. The $L_{\rm bol,ce}$-$M_{\rm tot}$, $L_{\rm X,ce}$-$M_{\rm tot}$ $L_{\rm bol,ce}$-$T$ and $L_{\rm X,ce}$-$T$ relations show a slope $\sim$3$\sigma$ steeper. The residuals in the $M_{\rm gas}$-$M_{\rm tot}$ and $T$-$M_{\rm tot}$ relations and the intrinsic covariance between $M_{\rm gas}$ and $T$ show hints of positive correlation, casting doubt on whether the $Y_{\rm X}$ parameter is a truly low scatter mass proxy. The $M_{\rm gas}$-$M_{\rm tot}$ and $T$-$M_{\rm tot}$ plots color-coded with the offset of the $L_{\rm X,ce}$-$M_{\rm tot}$ relation show these two relations to be brightness dependent but not the $L_{\rm X,ce}$-$T$ relation, suggesting relations involving $M_{\rm tot}$ are biased due to sample selection based on luminosity. Following the work which studied an optical sample and combining our result with literature studies, we find the $M_{\rm tot}$ derived not using mass proxies deviate from $L_{\rm X}$ $\propto$ $M_{\rm gas}^{2}M_{\rm tot}^{-1}$ and $M_{\rm tot}$ based on hydrostatic equilibrium are more massive than what is expected by their relation using caustic masses. This indicates mass bias plays an important role in scaling relations.


title: Centre vortex structure in the presence of dynamical fermions

abstract: An analysis of the geometry and structure of centre vortices in the presence of dynamical fermions is performed. A variety of metrics are used to measure the matrix structure of the vortex-modified gauge fields. Visualisations of centre vortices are presented and percolating clusters are identified. The size of secondary vortex clusters is analysed, with substantial differences observed between the pure Yang-Mills and dynamical fermion case. Vortex fields are represented as directed graphs, with branching points acting as the vertices. This representation leads to a novel picture of vortex branching as a binomial process. These results elucidate the change in the centre vortex vacuum induced by the introduction of dynamical fermions.


title: Entanglement as a Method to Reduce Uncertainty

abstract: In physics, entanglement 'reduces' the entropy of an entity, because the (von Neumann) entropy of, e.g., a composite bipartite entity in a pure entangled state is systematically lower than the entropy of the component sub-entities. We show here that this 'genuinely non-classical reduction of entropy as a result of composition' also holds whenever two concepts combine in human cognition and, more generally, it is valid in human culture. We exploit these results and make a 'new hypothesis' on the nature of entanglement, namely, the production of entanglement in the preparation of a composite entity can be seen as a 'dynamical process of collaboration between its sub-entities to reduce uncertainty', because the composite entity is in a pure state while its sub-entities are in a non-pure, or density, state, as a result of the preparation. We identify within the nature of this entanglement a mechanism of contextual updating and illustrate the mechanism in the example we analyze. Our hypothesis naturally explains the 'non-classical nature' of some quantum logical connectives, as due to Bell-type correlations.


title: Bl0ck: Paralyzing 802.11 connections through Block Ack frames

abstract: Despite Wi-Fi is at the eve of its seventh generation, security concerns regarding this omnipresent technology remain in the spotlight of the research community. This work introduces two new denial of service attacks against contemporary Wi-Fi 5 and 6 networks. Differently to similar works in the literature which focus on 802.11 management frames, the introduced assaults exploit control frames. Both the attacks target the central element of any infrastructure-based 802.11 network, i.e., the access point (AP), and result in depriving the associated stations from any service. We demonstrate that, at the very least, the attacks affect a great mass of off-the-self AP implementations by different renowned vendors, and it can be mounted with inexpensive equipment, little effort, and a low level of expertise. With reference to the latest standard, namely, 802.11-2020, we elaborate on the root cause of the respected vulnerabilities, pinpointing shortcomings. Following a coordinated vulnerability disclosure process, our findings have been promptly communicated to each affected AP vendor, already receiving positive feedback as well as a - currently reserved - common vulnerabilities and exposures (CVE) id, namely CVE-2022-32666.


title: Investigating the Effect of Relative Positional Embeddings on AMR-to-Text Generation with Structural Adapters

abstract: Text generation from Abstract Meaning Representation (AMR) has substantially benefited from the popularized Pretrained Language Models (PLMs). Myriad approaches have linearized the input graph as a sequence of tokens to fit the PLM tokenization requirements. Nevertheless, this transformation jeopardizes the structural integrity of the graph and is therefore detrimental to its resulting representation. To overcome this issue, Ribeiro et al. have recently proposed StructAdapt, a structure-aware adapter which injects the input graph connectivity within PLMs using Graph Neural Networks (GNNs). In this paper, we investigate the influence of Relative Position Embeddings (RPE) on AMR-to-Text, and, in parallel, we examine the robustness of StructAdapt. Through ablation studies, graph attack and link prediction, we reveal that RPE might be partially encoding input graphs. We suggest further research regarding the role of RPE will provide valuable insights for Graph-to-Text generation.


title: Revisiting the history of the evolution of the universe from radiation dominated to dark energy dominated

abstract: Most of our knowledge of the universe has been obtained from the anisotropy spectrum of the cosmic microwave background and observations of large-scale structures. During the history of the Universe, neutrinos from the early Universe evolve from a relativistic phase at very early times to a massive-particle behavior at later times. The mass of neutrinos affects the history of the expansion of the universe and the growth of the disturbances of the various components of the cosmic microwave background, therefore the anisotropy spectrum of the cosmic radiation and the observations of the large-scale structures. In this article, by using the coupling of neutrinos with dark energy, we investigate the cosmic evolution from the era of matter dominated to the era of dark energy dominated and show that neutrinos can play an important role in the evolution from radiation dominated to matter dominated and the evolution from Matter dominated to dark energy dominated. Also, we investigate the effect of non-relativistic neutrino on bulk flow and show that the direction of bulk flow has a little difference in scales smaller than 0.1, and the more we consider the scales higher than the local universe, the more difference is observed in the direction of bulk flow.


title: Tracing the orbitals of the quantum permutation group

abstract: Using a suitably noncommutative flat matrix model, it is shown that the quantum permutation group has free orbitals: that is, a monomial in the generators of the algebra of functions can be zero for trivial reasons only. It is shown that any strictly intermediate quantum subgroup between the classical and quantum permutation groups must have free three-orbitals, and this is used to derive some elementary bounds for the Haar state on degree four monomials in such quantum permutation groups. Exploiting the main character, explicit formulae are given in the case of the quantum permutation group.


title: Averaging method in combinatorics of symmetric polynomials

abstract: We elaborate on the recent suggestion to consider averaging of Cauchy identities for the Schur functions over power sum variables. This procedure has apparent parallels with the Borel transform, only it changes the number of combinatorial factors like $d_R$ in the sums over Young diagrams instead of just factorials in ordinary sums over numbers. It provides a universal view on a number of previously known, but seemingly random identities.


title: Transforming First-Year Calculus Teaching for Engineering Students -- Blocks with Field Specific Examples, Problems, and Exams

abstract: Contribution: We demonstrate that it is feasible to include field specific problems in introductory mathematics courses to motivate engineering students. This is done in a way that still allows large parts of the course to be common to all students, ensuring economic viability. Background: Many first-year engineering students perceive mathematics courses as being too abstract and far from their chosen study programme. This may lead to a lack of motivation and effort, thus decreasing the learning outcomes. Intended outcomes: That engineering students recognize that the calculus and linear algebra courses are relevant for their future work within their specific field. This is intended to improve their learning outcomes. Application design: The courses have been restructured into smaller subunits, each of which has a corresponding workshop treating a real-world problem from the specific field of a given group of students. These workshops are developed in consultation with the relevant fields of study, and they are given a prominent role in the course for instance by forming the basis for the oral exams. Findings: Based on the feedback from students, we find that inclusion of field specific problems does help to highlight the applicability and importance of mathematics in engineering. When implementing such a solution, however, there are a number of challenges to keep in mind.


title: Single Motion Diffusion

abstract: Synthesizing realistic animations of humans, animals, and even imaginary creatures, has long been a goal for artists and computer graphics professionals. Compared to the imaging domain, which is rich with large available datasets, the number of data instances for the motion domain is limited, particularly for the animation of animals and exotic creatures (e.g., dragons), which have unique skeletons and motion patterns. In this work, we present a Single Motion Diffusion Model, dubbed SinMDM, a model designed to learn the internal motifs of a single motion sequence with arbitrary topology and synthesize motions of arbitrary length that are faithful to them. We harness the power of diffusion models and present a denoising network explicitly designed for the task of learning from a single input motion. SinMDM is designed to be a lightweight architecture, which avoids overfitting by using a shallow network with local attention layers that narrow the receptive field and encourage motion diversity. SinMDM can be applied in various contexts, including spatial and temporal in-betweening, motion expansion, style transfer, and crowd animation. Our results show that SinMDM outperforms existing methods both in quality and time-space efficiency. Moreover, while current approaches require additional training for different applications, our work facilitates these applications at inference time. Our code and trained models are available at https://sinmdm.github.io/SinMDM-page.