title: Global solutions to 3D incompressible MHD system with dissipation in only one direction

abstract: The small data global well-posedness of the 3D incompressible Navier-Stokes equations in $\mathbb R^3$ with only one-directional dissipation remains an outstanding open problem. The dissipation in just one direction, say $\partial_1^2 u$ is simply insufficient in controlling the nonlinearity in the whole space $\mathbb R^3$. The beautiful work of Paicu and Zhang \cite{ZHANG1} solved the case when the spatial domain is bounded in the $x_1$-direction by observing a crucial Poincar\'{e} type inequality. Motivated by this Navier-Stokes open problem and by experimental observations on the stabilizing effects of background magnetic fields, this paper intends to understand the global well-posedness and stability of a special 3D magnetohydrodynamic (MHD) system near a background magnetic field. The spatial domain is $\mathbb R^3$ and the velocity in this MHD system obeys the 3D Navier-Stokes with only one-directional dissipation. With no Poincar\'{e} type inequality, this problem appears to be impossible. By discovering the mathematical mechanism of the experimentally observed stabilizing effect and introducing several innovative techniques to deal with the derivative loss difficulties, we are able to bound the Navier-Stokes nonlinearity and solve the desired global well-posedness and stability problem.


title: Scalable Spectral Clustering with Group Fairness Constraints

abstract: There are synergies of research interests and industrial efforts in modeling fairness and correcting algorithmic bias in machine learning. In this paper, we present a scalable algorithm for spectral clustering (SC) with group fairness constraints. Group fairness is also known as statistical parity where in each cluster, each protected group is represented with the same proportion as in the entirety. While FairSC algorithm (Kleindessner et al., 2019) is able to find the fairer clustering, it is compromised by high costs due to the kernels of computing nullspaces and the square roots of dense matrices explicitly. We present a new formulation of underlying spectral computation by incorporating nullspace projection and Hotelling's deflation such that the resulting algorithm, called s-FairSC, only involves the sparse matrix-vector products and is able to fully exploit the sparsity of the fair SC model. The experimental results on the modified stochastic block model demonstrate that s-FairSC is comparable with FairSC in recovering fair clustering. Meanwhile, it is sped up by a factor of 12 for moderate model sizes. s-FairSC is further demonstrated to be scalable in the sense that the computational costs of s-FairSC only increase marginally compared to the SC without fairness constraints.


title: Rod and slit photonic crystal microrings for on-chip cavity quantum electrodynamics

abstract: Micro-/nanocavities that combine high quality factor ($Q$) and small mode volume ($V$) have been used to enhance light-matter interactions for cavity quantum electrodynamics (cQED). Whispering gallery mode (WGM) geometries such as microdisks and microrings support high-$Q$ and are design- and fabrication-friendly, but $V$ is often limited to tens of cubic wavelengths to avoid WGM radiation. The stronger modal confinement provided by either one-dimensional or two-dimensional photonic crystal defect geometries can yield sub-cubic-wavelength $V$, yet the requirements on precise design and dimensional control are typically much more stringent to ensure high-$Q$. Given their complementary features, there has been sustained interest in geometries that combine the advantages of WGM and photonic crystal cavities. Recently, a `microgear' photonic crystal ring (MPhCR) has shown promise in enabling additional defect localization ($>$ 10$\times$ reduction of $V$) of a WGM, while maintaining high-$Q$ ($\approx10^6$) and other WGM characteristics in ease of coupling and design. However, the unit cell geometry used is unlike traditional PhC cavities, and etched surfaces may be too close to embedded quantum nodes (quantum dots, atomic defect spins, etc.) for cQED applications. Here, we report two novel PhCR designs with `rod' and `slit' unit cells, whose geometries are more traditional and suitable for solid-state cQED. Both rod and slit PhCRs have high-$Q$ ($>10^6$) with WGM coupling properties preserved. A further $\approx$~10$\times$ reduction of $V$ by defect localization is observed in rod PhCRs. Moreover, both fundamental and 2nd-order PhC modes co-exist in slit PhCRs with high $Q$s and good coupling. Our work showcases that high-$Q/V$ PhCRs are in general straightforward to design and fabricate and are a promising platform to explore for cQED.


title: An almost-tight $L^2$ autoconvolution inequality

abstract: Let $\mathcal{F}$ denote the set of functions $f \colon [-1/2,1/2] \to \mathbb{R}$ such that $\int f = 1$. We determine the value of $\inf_{f \in \mathcal{F}} \| f \ast f \|_2$ up to a 0.0014\% error, thereby making progress on a problem asked by Ben Green. Furthermore, we prove that a unique minimizer exists. As a corollary, we obtain improvements on the maximum size of $B_h[g]$ sets for $(g,h) \in \{ (2,2),(3,2),(4,2),(1,3),(1,4)\}$.


title: Quantum Variational Rewinding for Time Series Anomaly Detection

abstract: Electron dynamics, financial markets and nuclear fission reactors, though seemingly unrelated, all produce observable characteristics evolving with time. Within this broad scope, departures from normal temporal behavior range from academically interesting to potentially catastrophic. New algorithms for time series anomaly detection (TAD) are therefore certainly in demand. With the advent of newly accessible quantum processing units (QPUs), exploring a quantum approach to TAD is now relevant and is the topic of this work. Our approach - Quantum Variational Rewinding, or, QVR - trains a family of parameterized unitary time-devolution operators to cluster normal time series instances encoded within quantum states. Unseen time series are assigned an anomaly score based upon their distance from the cluster center, which, beyond a given threshold, classifies anomalous behavior. After a first demonstration with a simple and didactic case, QVR is used to study the real problem of identifying anomalous behavior in cryptocurrency market data. Finally, multivariate time series from the cryptocurrency use case are studied using IBM's Falcon r5.11H family of superconducting transmon QPUs, where anomaly score errors resulting from hardware noise are shown to be reducible by as much as 20% using advanced error mitigation techniques.


title: Cosmological states in loop quantum gravity on homogeneous graphs

abstract: We introduce a class of states characterized by proposed conditions of homogeneity and isotropy in loop quantum gravity and construct concrete examples given by Bell-network states on a special class of homogeneous graphs. Such states provide new representations of cosmological spaces that can be explored for the formulation of cosmological models in the context of loop quantum gravity. We show that their local geometry is described in an automorphism-invariant manner by one-node observables analogous to the one-body observables used in many-body quantum mechanics, and compute the density matrix representing the restriction of global states to the algebra of one-node observables. The von Neumann entropy of this density matrix provides a notion of entanglement entropy of a local region which respects automorphism-invariance and can be applied to states involving superpositions of distinct graphs.


title: ODNet: A Convolutional Neural Network for Asteroid Occultation Detection

abstract: We propose to design and build an algorithm that will use a Convolutional Neural Network (CNN) and observations from the Unistellar network to reliably detect asteroid occultations. The Unistellar Network, made of more than 10,000 digital telescopes owned by citizen scientists, and is regularly used to record asteroid occultations. In order to process the increasing amount of observational produced by this network, we need a quick and reliable way to analyze occultations. In an effort to solve this problem, we trained a CNN with artificial images of stars with twenty different types of photometric signals. Inputs to the network consists of two stacks of snippet images of stars, one around the star that is supposed to be occulted and a reference star used for comparison. We need the reference star to distinguish between a true occultation and artefacts introduced by poor atmospheric condition. Our Occultation Detection Neural Network (ODNet), can analyze three sequence of stars per second with 91\% of precision and 87\% of recall. The algorithm is sufficiently fast and robust so we can envision incorporating onboard the eVscopes to deliver real-time results. We conclude that citizen science represents an important opportunity for the future studies and discoveries in the occultations, and that application of artificial intelligence will permit us to to take better advantage of the ever-growing quantity of data to categorize asteroids.


title: GowFed -- A novel Federated Network Intrusion Detection System

abstract: Network intrusion detection systems are evolving into intelligent systems that perform data analysis while searching for anomalies in their environment. Indeed, the development of deep learning techniques paved the way to build more complex and effective threat detection models. However, training those models may be computationally infeasible in most Edge or IoT devices. Current approaches rely on powerful centralized servers that receive data from all their parties - violating basic privacy constraints and substantially affecting response times and operational costs due to the huge communication overheads. To mitigate these issues, Federated Learning emerged as a promising approach, where different agents collaboratively train a shared model, without exposing training data to others or requiring a compute-intensive centralized infrastructure. This work presents GowFed, a novel network threat detection system that combines the usage of Gower Dissimilarity matrices and Federated averaging. Different approaches of GowFed have been developed based on state-of the-art knowledge: (1) a vanilla version; and (2) a version instrumented with an attention mechanism. Furthermore, each variant has been tested using simulation oriented tools provided by TensorFlow Federated framework. In the same way, a centralized analogous development of the Federated systems is carried out to explore their differences in terms of scalability and performance - across a set of designed experiments/scenarios. Overall, GowFed intends to be the first stepping stone towards the combined usage of Federated Learning and Gower Dissimilarity matrices to detect network threats in industrial-level networks.


title: Mesh Refinement for Anisotropic Diffusion in Magnetized Plasmas

abstract: Highly accurate simulation of plasma transport is needed for the successful design and operation of magnetically confined fusion reactors. Unfortunately, the extreme anisotropy present in magnetized plasmas results in thin boundary layers that are expensive to resolve. This work investigates how mesh refinement strategies might reduce that expense to allow for more efficient simulation. It is first verified that higher order discretization only realizes the proper rate of convergence once the mesh resolves the thin boundary layer, motivating the focusing of refinement on the boundary layer. Three mesh refinement strategies are investigated: one that focuses the refinement across the layer by using rectangular elements with a ratio equal to the boundary layer width, one that allows for exponential growth in mesh spacing away from the layer, and one adaptive strategy utilizing the established Zienkiewicz and Zhu error estimator. Across 4 two-dimensional test cases with high anisotropy, the adaptive mesh refinement strategy consistently achieves the same accuracy as uniform refinement using orders of magnitude less degrees of freedom. In the test case where the magnetic field is aligned with the mesh, the other refinement strategies also show substantial improvement in efficiency. This work also includes a discussion generalizing the results to larger magnetic anisotropy ratios and to three-dimensional problems. It is shown that isotropic mesh refinement requires degrees of freedom on the order of either the layer width (2D) or the square of the layer width (3D), whereas anisotropic refinement requires a number on the order of the log of layer width for all dimensions. It is also shown that the number of conjugate gradient iterations scales as a power of layer width when preconditioned with algebraic multigrid, whereas the number is independent of layer width when preconditioned with ILU.


title: CR Yamabe constant and inequivalent CR structures

abstract: The CR Yamabe constant is an invariant of a compact strongly pseudoconvex CR manifold and plays an important role in CR geometry. We show some integral formulae of the CR Yamabe constant. We also construct an infinite-dimensional family of strongly pseudoconvex CR structures with varying CR Yamabe constants and a compact simply-connected manifold admitting two strongly pseudoconvex CR structures with different signs of the CR Yamabe constant.


title: Testing Primordial Black Hole Dark Matter with ALMA Observations of the Gravitational Lens B1422+231

abstract: We examine the flux density ratio anomaly in the quadruply-imaged strong gravitational lens, B1422+231, and consider the contribution of $10-10^3M_{\odot}$ primordial black holes (PBHs) as a potential dark matter constituent. We describe the first flux density ratio measurement of B1422+231 in the millimeter-wave band using the Atacama Large Millimeter Array (ALMA). This fills an important multi-wavelength gap in our knowledge of this key lensed system. The flux density of the quasar at 233 GHz is dominated by synchrotron emission and the source size is estimated to be 66.9 pc. The observed flux density ratios at 233 GHz are similar to those measured in radio, mid-infrared and optical bands, which cannot be explained by a simple smooth mass model of the lens galaxy. We examine the probability of the flux density ratio anomaly arising from PBH microlensing using ray tracing simulations. The simulations consider the cases where 10% and 50% of dark matter are $10-10^3M_{\odot}$ PBHs with a power law mass function. Our analysis shows that the anomalous flux density ratio for B1422+231 can be explained by a lens model with a significant fraction of dark matter being PBHs. This study demonstrates the potential for new constraints on PBH dark matter using ALMA observations of multiply imaged strong gravitational lenses.


title: Coupling between colossal charge density wave ordering and magnetism in Ho2Ir3Si5

abstract: Ho2Ir3Si5 belongs to the family of three-dimensional (3D) R2Ir3Si5 (R = Lu, Er and Ho) compounds that exhibit a colossal first-order charge density wave (CDW) transition where there is a strong orthorhombic-to-triclinic distortion of the lattice accompanied by superlattice reflections. The analysis by single-crystal X-ray diffraction (SXRD) has revealed that the Ir-Ir zigzag chains along c are responsible for the CDW in all three compounds. The replacement of the rare earth element from non-magnetic Lu to magnetic Er or Ho lowers TCDW, where TCDWLu = 200 K, TCDWEr = 150 K and TCDWHo = 90 K. Out of the three compounds, Ho2Ir3Si5 is the only system where second-order superlattice reflections could be observed, indicative of an anharmonic shape of the modulation wave. The CDW transition is observed as anomalies in the temperature dependencies of the specific heat, electrical conductivity and magnetic susceptibility, which includes a large hysteresis of 90 to 130 K for all measured properties, thus corroborating the SXRD measurements. Similar to previously reported Er2Ir3Si5, there appears to be a coupling between CDW and magnetism such that the Ho3+ magnetic moments are influenced by the CDW transition, even in the paramagnetic state. Moreover, earlier investigations on polycrystalline material revealed antiferromagnetic (AFM) ordering at TN = 5.1 K, whereas AFM order is suppressed and only the CDW is present in our highly ordered single-crystal. First-principles calculations predict Ho2Ir3Si5 to be a metal with coexisting electron and hole pockets at the Fermi level. The Ho and Ir atoms have spherically symmetric metallic-type charge density distributions that are prone to CDW distortion. Phonon calculations affirm that the Ir atoms are primarily responsible for the CDW distortion, which is in agreement with the experiment.


title: Measurable Imbeddings, Free Products, and Graph Products

abstract: We study Measurable Imbeddability between groups, which is an order-like generalization of Measure Equivalence that allows the imbedded group to have an infinite measure fundamental domain. We prove if $\Lambda_1$ measurably imbeds into $\Gamma_1$, and $\Lambda_2$ measurably imbeds into $\Gamma_2$ under an additional assumption that lets the corresponding fundamental domains to be arranged in a special way, then $\Lambda_1 * \Lambda_2$ measurably imbeds into $\Gamma_1 * \Gamma_2$. Building upon the techniques we used, we show that the analogous result holds for graph products of groups.


title: Thermal transport properties of IrSbSe

abstract: We report a thermal transport study of IrSbSe, which crystallizes in a noncentrosymmetric cubic structure with the $P2_13$ space group and shows a narrow-gap semiconducting behavior. The large discrepancy between the activation energy for conductivity [$E_\rho$ = 128(2) meV] and for thermopower [$E_S$ = 17.7(9) meV] from 200 to 300 K indicates the polaronic transport mechanism. Electrical resistivity varies as $exp(T_0/T)^{1/4}$ and thermopower varies as $T^{1/2}$ at low temperatures, indicating that it evolves into the Mott's variable-range hopping dominant conduction with decreasing temperature. IrSbSe shows relatively low value of thermal conductivity ($\sim$ 1.65 W/K$\cdot$m) and thermopower of about 0.24 mV/K around 100 K, yet poor electrical conductivity. On the other hand, high vacancy defect concentration on both Ir and Sb atomic sites of up to 15\%, suggests high defect tolerance and points to possibility of future improvement of carrier density by chemical substitution or defect optimization.


title: Kummer-type constructions of almost Ricci-flat 5-manifolds

abstract: A smooth closed manifold $M$ is called almost Ricci-flat if $$\inf_g||\textrm{Ric}_g||_\infty\cdot \textrm{diam}_g(M)^2=0$$ where $\textrm{Ric}_g$ and $\textrm{diam}_g$ denote the Ricci tensor and the diameter of $g$ respectively and $g$ runs over all Riemannian metrics on $M$. By using Kummer-type method we construct a smooth closed almost Ricci-flat nonspin 5-manifold $M$ which is simply connected. It's minimal volume vanishes, namely it collapses with sectional curvature bounded.


title: Gender Bias in Computing

abstract: This paper examines the historical dimension of gender bias in the US computing workforce. It offers new quantitative data on the computing workforce prior to the availability of US Census data in the 1970s. Computer user groups (including SHARE, Inc., and the Mark IV software user group) are taken as a cross-section of the computing workforce. A novel method of gender analysis is developed to estimate women's and men's participation in computing beginning in the 1950s. The data presented here are consistent with well-known NSF statistics that show computer science undergraduate programs enrolling increasing numbers of women students during 1965-1985. These findings challenge the 'making programming masculine' thesis, and serve to correct the unrealistically high figures often cited for women's participation in early computer programming. Gender bias in computing today is traced not to 1960s professionalization but to cultural changes in the 1980s and beyond.


title: The Secret Source : Incorporating Source Features to Improve Acoustic-to-Articulatory Speech Inversion

abstract: In this work, we incorporated acoustically derived source features, aperiodicity, periodicity and pitch as additional targets to an acoustic-to-articulatory speech inversion (SI) system. We also propose a Temporal Convolution based SI system, which uses auditory spectrograms as the input speech representation, to learn long-range dependencies and complex interactions between the source and vocal tract, to improve the SI task. The experiments are conducted with both the Wisconsin X-ray microbeam (XRMB) and Haskins Production Rate Comparison (HPRC) datasets, with comparisons done with respect to three baseline SI model architectures. The proposed SI system with the HPRC dataset gains an improvement of close to 28% when the source features are used as additional targets. The same SI system outperforms the current best performing SI models by around 9% on the XRMB dataset.


title: Robust Boosting Forests with Richer Deep Feature Hierarchy

abstract: We propose a robust variant of boosting forest to the various adversarial defense methods, and apply it to enhance the robustness of the deep neural network. We retain the deep network architecture, weights, and middle layer features, then install gradient boosting forest to select the features from each layer of the deep network, and predict the target. For training each decision tree, we propose a novel conservative and greedy trade-off, with consideration for less misprediction instead of pure gain functions, therefore being suboptimal and conservative. We actively increase tree depth to remedy the accuracy with splits in more features, being more greedy in growing tree depth. We propose a new task on 3D face model, whose robustness has not been carefully studied, despite the great security and privacy concerns related to face analytics. We tried a simple attack method on a pure convolutional neural network (CNN) face shape estimator, making it degenerate to only output average face shape with invisible perturbation. Our conservative-greedy boosting forest (CGBF) on face landmark datasets showed a great improvement over original pure deep learning methods under the adversarial attacks.


title: Khovanov homology and the Fukaya category of the traceless character variety for the twice-punctured torus

abstract: We describe a strategy for constructing reduced Khovanov homology for links in lens spaces by generalizing a symplectic interpretation of reduced Khovanov homology for links in $S^3$ due to Hedden, Herald, Hogancamp, and Kirk. The strategy relies on a partly conjectural description of the Fukaya category of the traceless $SU(2)$ character variety of the 2-torus with two punctures. From a diagram of a 1-tangle in a solid torus, we construct a corresponding object $(X,\delta)$ in the $A_\infty$ category of twisted complexes over this Fukaya category. The homotopy type of $(X,\delta)$ is an isotopy invariant of the tangle diagram. We use $(X,\delta)$ to construct cochain complexes for links in $S^3$ and some links in $S^2 \times S^1$. For links in $S^3$, the cohomology of our cochain complex reproduces reduced Khovanov homology, though the cochain complex itself is not the usual one. For links in $S^2 \times S^1$, we present results that suggest the cohomology of our cochain complex may be a link invariant.


title: Joint Sub-component Level Segmentation and Classification for Anomaly Detection within Dual-Energy X-Ray Security Imagery

abstract: X-ray baggage security screening is in widespread use and crucial to maintaining transport security for threat/anomaly detection tasks. The automatic detection of anomaly, which is concealed within cluttered and complex electronics/electrical items, using 2D X-ray imagery is of primary interest in recent years. We address this task by introducing joint object sub-component level segmentation and classification strategy using deep Convolution Neural Network architecture. The performance is evaluated over a dataset of cluttered X-ray baggage security imagery, consisting of consumer electrical and electronics items using variants of dual-energy X-ray imagery (pseudo-colour, high, low, and effective-Z). The proposed joint sub-component level segmentation and classification approach achieve ~99% true positive and ~5% false positive for anomaly detection task.


title: Learning to Compute the Articulatory Representations of Speech with the MIRRORNET

abstract: Most organisms including humans function by coordinating and integrating sensory signals with motor actions to survive and accomplish desired tasks. Learning these complex sensorimotor mappings proceeds simultaneously and often in an unsupervised or semi-supervised fashion. An autoencoder architecture (MirrorNet) inspired by this sensorimotor learning paradigm is explored in this work to control an articulatory synthesizer, with minimal exposure to ground-truth articulatory data. The articulatory synthesizer takes as input a set of six vocal Tract Variables (TVs) and source features (voicing indicators and pitch) and is able to synthesize continuous speech for unseen speakers. We show that the MirrorNet, once initialized (with ~30 mins of articulatory data) and further trained in unsupervised fashion (`learning phase'), can learn meaningful articulatory representations with comparable accuracy to articulatory speech-inversion systems trained in a completely supervised fashion.


title: Flow regimes and types of solid obstacle surface roughness in turbulent heat transfer inside periodic porous media

abstract: The focus of this paper is to systematically study the influence of solid obstacle surface roughness in porous media on the microscale flow physics and report its effect on macroscale drag and Nusselt number. The Reynolds averaged flow field is numerically simulated for a flow through a periodic porous medium consisting of an in-line arrangement of square cylinders with square roughness particles on the cylinder surface. Two flow regimes are identified with respect to the surface roughness particle height: fine and coarse roughness regimes. The effect of the roughness particles in the fine roughness regime is limited to the near-wall boundary layer around the solid obstacle surface. In the coarse roughness regime, the roughness particles modify the microscale flow field in the entire pore space of the porous medium. In the fine roughness regime, the heat transfer from the rough solid obstacles to the fluid inside the porous medium is less than that from a smooth solid obstacle. In the coarse roughness regime, there is an enhancement in the heat transfer from the rough solid obstacle to the fluid inside the porous medium. Total drag reduction is also observed in the fine roughness regime for the smallest roughness particle height. The surface roughness particle spacing determines the fractional area of the solid obstacle surface covered by recirculating, reattached, and stagnating flow. As the roughness particle spacing increases, there are two competing factors for the heat transfer rate: increase due to more surface area covered by reattached flow, and decrease due to the decrease in the number of roughness particles on the solid obstacle surface. Decreasing the porosity and increasing the Reynolds number amplify the effect of the surface roughness on the microscale flow.


title: Flows, Scaling, and Entropy Revisited: a Unified Perspective via Optimizing Joint Distributions

abstract: In this short expository note, we describe a unified algorithmic perspective on several classical problems which have traditionally been studied in different communities. This perspective views the main characters -- the problems of Optimal Transport, Minimum Mean Cycle, Matrix Scaling, and Matrix Balancing -- through the same lens of optimization problems over joint probability distributions P(x,y) with constrained marginals. While this is how Optimal Transport is typically introduced, this lens is markedly less conventional for the other three problems. This perspective leads to a simple and unified framework spanning problem formulation, algorithm development, and runtime analysis.


title: Region of Interest Detection in Melanocytic Skin Tumor Whole Slide Images

abstract: Automated region of interest detection in histopathological image analysis is a challenging and important topic with tremendous potential impact on clinical practice. The deep-learning methods used in computational pathology help us to reduce costs and increase the speed and accuracy of regions of interest detection and cancer diagnosis. In this work, we propose a patch-based region of interest detection method for melanocytic skin tumor whole-slide images. We work with a dataset that contains 165 primary melanomas and nevi Hematoxylin and Eosin whole-slide images and build a deep-learning method. The proposed method performs well on a hold-out test data set including five TCGA-SKCM slides (accuracy of 93.94\% in slide classification task and intersection over union rate of 41.27\% in the region of interest detection task), showing the outstanding performance of our model on melanocytic skin tumor. Even though we test the experiments on the skin tumor dataset, our work could also be extended to other medical image detection problems, such as various tumors' classification and prediction, to help and benefit the clinical evaluation and diagnosis of different tumors.


title: Reformulating van Rijsbergen's $F_{\beta}$ metric for weighted binary cross-entropy

abstract: The separation of performance metrics from gradient based loss functions may not always give optimal results and may miss vital aggregate information. This paper investigates incorporating a performance metric alongside differentiable loss functions to inform training outcomes. The goal is to guide model performance and interpretation by assuming statistical distributions on this performance metric for dynamic weighting. The focus is on van Rijsbergens $F_{\beta}$ metric -- a popular choice for gauging classification performance. Through distributional assumptions on the $F_{\beta}$, an intermediary link can be established to the standard binary cross-entropy via dynamic penalty weights. First, the $F_{\beta}$ metric is reformulated to facilitate assuming statistical distributions with accompanying proofs for the cumulative density function. These probabilities are used within a knee curve algorithm to find an optimal $\beta$ or $\beta_{opt}$. This $\beta_{opt}$ is used as a weight or penalty in the proposed weighted binary cross-entropy. Experimentation on publicly available data along with benchmark analysis mostly yields better and interpretable results as compared to the baseline for both imbalanced and balanced classes. For example, for the IMDB text data with known labeling errors, a 14% boost in $F_1$ score is shown. The results also reveal commonalities between the penalty model families derived in this paper and the suitability of recall-centric or precision-centric parameters used in the optimization. The flexibility of this methodology can enhance interpretation.


title: Non-Gaussianities in generalized non-local $R^2$-like inflation

abstract: In [1], a most general higher curvature non-local gravity action was derived that admits a particular $R^2$-like inflationary solution predicting the spectral index of primordial scalar perturbations $n_s(N)\approx 1-\frac{2}{N}$, where $N$ is the number of e-folds before the end of inflation, $N\gg 1$, any value of the tensor-to-scalar ratio $r(N)<0.036$ and the tensor tilt $n_t(N)$ violating the $r= -8n_t$ condition. In this paper, we compute scalar primordial non-Gaussianities (PNGs) in this theory and effectively demonstrate that higher curvature non-local terms lead to reduced bispectrum $f_{\rm NL}\left( k_1,\,k_2,\,k_3 \right)$ mimicking several classes of scalar field models of inflation known in the literature. We obtain $\vert f_{\rm NL}\vert \sim O(1-10)$ in the equilateral, orthogonal, and squeezed limits and the running of these PNGs measured by the quantity $\vert\frac{d\ln f_{\rm NL}}{d\ln k}\vert\lesssim 1$. Such PNGs are sufficiently large to be measurable by future CMB and Large Scale Structure observations, thus providing a possibility to probe the nature of quantum gravity. Furthermore, we demonstrate that the $R^2$-like inflation in non-local modification of gravity brings non-trivial predictions which go beyond the current status of effective field theories (EFTs) of single field, quasi-single field and multiple field inflation. A distinguishable feature of non-local $R^2$-like inflation compared to local EFTs is that we can have running of PNGs at least an order of magnitude higher. In summary, through our generalized non-local $R^2$-like inflation, we obtain a robust geometric framework of inflation that can explain any detection of observable quantities related to scalar PNGs.


title: The Vector Balancing Constant for Zonotopes

abstract: The vector balancing constant $\mathrm{vb}(K,Q)$ of two symmetric convex bodies $K,Q$ is the minimum $r \geq 0$ so that any number of vectors from $K$ can be balanced into an $r$-scaling of $Q$. A question raised by Schechtman is whether for any zonotope $K \subseteq \mathbb{R}^d$ one has $\mathrm{vb}(K,K) \lesssim \sqrt{d}$. Intuitively, this asks whether a natural geometric generalization of Spencer's Theorem (for which $K = B^d_\infty$) holds. We prove that for any zonotope $K \subseteq \mathbb{R}^d$ one has $\mathrm{vb}(K,K) \lesssim \sqrt{d} \log \log \log d$. Our main technical contribution is a tight lower bound on the Gaussian measure of any section of a normalized zonotope, generalizing Vaaler's Theorem for cubes. We also prove that for two different normalized zonotopes $K$ and $Q$ one has $\mathrm{vb}(K,Q) \lesssim \sqrt{d \log d}$. All the bounds are constructive and the corresponding colorings can be computed in polynomial time.


title: Sentiment Classification of Code-Switched Text using Pre-trained Multilingual Embeddings and Segmentation

abstract: With increasing globalization and immigration, various studies have estimated that about half of the world population is bilingual. Consequently, individuals concurrently use two or more languages or dialects in casual conversational settings. However, most research is natural language processing is focused on monolingual text. To further the work in code-switched sentiment analysis, we propose a multi-step natural language processing algorithm utilizing points of code-switching in mixed text and conduct sentiment analysis around those identified points. The proposed sentiment analysis algorithm uses semantic similarity derived from large pre-trained multilingual models with a handcrafted set of positive and negative words to determine the polarity of code-switched text. The proposed approach outperforms a comparable baseline model by 11.2% for accuracy and 11.64% for F1-score on a Spanish-English dataset. Theoretically, the proposed algorithm can be expanded for sentiment analysis of multiple languages with limited human expertise.


title: Late-Forming PBH: Beyond the CMB era

abstract: The intermediate mass black hole range, $10\lesssim M_{\rm BH}^{}/M_\odot^{}\lesssim 10^{5} $, has long offered enticing possibilities for primordial black holes (PBH), with populations in this range postulated to be responsible for some of the black hole binary merger detected events as well as the existence of supermassive black holes embedded at galactic centers. However, a prominent bound derived from PBH accretion during recombination severely restricts the mass fraction of intermediate mass PBH. We address this problem by proposing a formation scenario in which ``primordial" black holes form late in our cosmological history, beyond the CMB era, and bypassing this bound. During this crucial epoch, our population of compact objects exist as thermal balls supported by thermal pressure, which eventually cool to Fermi balls supported by degeneracy pressure and finally collapse to PBH. Our mechanism is a viable production method for both the mass gap LIGO-VIRGO-KAGRA detections and the JWST observation of an early time $z>10$ supermassive black hole. Furthermore, we present the remarkable possibility of PBH formation after the present era, which we term \textit{future} PBH. Such a population would evade most, if not all bounds on the PBH mass spectrum in the literature and open up previously unthought-of possibilities. Light future PBH could form below the Hawking evaporation threshold and convert the bulk of the matter in the Universe into radiation.


title: Augmented Reality and Mixed Reality Measurement Under Different Environments: A Survey on Head-Mounted Devices

abstract: Augmented Reality (AR) and Mixed Reality (MR) have been two of the most explosive research topics in the last few years. Head-Mounted Devices (HMDs) are essential intermediums for using AR and MR technology, playing an important role in the research progress in these two areas. Behavioral research with users is one way of evaluating the technical progress and effectiveness of HMDs. In addition, AR and MR technology is dependent upon virtual interactions with the real environment. Thus, conditions in real environments can be a significant factor for AR and MR measurements with users. In this paper, we survey 87 environmental-related HMD papers with measurements from users, spanning over 32 years. We provide a thorough review of AR- and MR-related user experiments with HMDs under different environmental factors. Then, we summarize trends in this literature over time using a new classification method with four environmental factors, the presence or absence of user feedback in behavioral experiments, and ten main categories to subdivide these papers (e.g., domain and method of user assessment). We also categorize characteristics of the behavioral experiments, showing similarities and differences among papers.


title: Transition to instability of the leapfrogging vortex quartet

abstract: The point vortex system is a system of longstanding interest in nonlinear dynamics, describing the motion of a two-dimensional inviscid fluid that is irrotational except at a discrete set of moving point vortices, at which the vorticity diverges. The leapfrogging orbit consists of two rotating pairs of like-signed vortices which, taken as a quartet, propagate at constant velocity. It is known that if the two pairs are initially widely separated, the motion is stable, while if they are closer together it becomes unstable, with this relation represented by a dimensionless parameter $\alpha$ defined in the text. We here demonstrate analytically that the transition from stability to instability happens at a critical value $\alpha = \phi^{-2}$, where $\phi$ is the golden ratio. This value had been hypothesized based on careful numerics by Toph{\o}j and Aref, and by the present authors using a semi-analytic argument but not previously demonstrated through exact analysis.


title: Efficient Mean-Field Simulation of Quantum Circuits Inspired by Density Functional Theory

abstract: Exact simulations of quantum circuits (QCs) are currently limited to $\sim$50 qubits because the memory and computational cost required to store the QC wave function scale exponentially with qubit number. Therefore, developing efficient schemes for approximate QC simulations is a current research focus. Here we show simulations of QCs with a method inspired by density functional theory (DFT), a widely used approach to study many-electron systems. Our calculations can predict marginal single-qubit probabilities (SQPs) with over 90% accuracy in several classes of QCs with universal gate sets, using memory and computational resources linear in qubit number despite the formal exponential cost of the SQPs. This is achieved by developing a mean-field description of QCs and formulating optimal single- and two-qubit gate functionals $-$ analogs of exchange-correlation functionals in DFT $-$ to evolve the SQPs without computing the QC wave function. Current limitations and future extensions of this formalism are discussed.


title: The $A_\alpha$ spectral radius with given independence number $n-4$

abstract: Let $G$ be a graph with adjacency matrix $A(G)$ and degree diagonal matrix $D (G)$. In 2017, Nikiforov [Appl. Anal. Discrete Math., 11 (2017) 81--107] defined the matrix $A_\alpha(G) = \alpha D(G) + (1-\alpha)A(G)$ for any real $\alpha\in[0,1]$. The largest eigenvalue of $A(G)$ is called the spectral radius of $G$, while the largest eigenvalue of $A_\alpha(G)$ is called the $A_\alpha$ spectral radius of $G$. Let $\mathcal{G}_{n,i}$ be the set of graphs of order $n$ with independence number $i$. Recently, for all graphs in $\mathcal{G}_{n,i}$ having the minimum or the maximum $A$, $Q$ and $A_\alpha$ spectral radius where $i\in\{1,2,\lfloor\frac{n}{2}\rfloor\,\lceil\frac{n}{2}\rceil+1,n-3,n-2,n-1\}$, there are some results have been given by Xu, Li and Sun et al., respectively. In 2021, Luo and Guo [Discrete Math., 345 (2022) 112778] determined all graphs in $\mathcal{G}_{n,n-4}$ having the minimum spectral radius. In this paper, we characterize the graphs in $\mathcal{G}_{n,n-4}$ having the minimum and the maximum $A_\alpha$ spectral radius for $\alpha\in[\frac{1}{2},1)$, respectively.


title: ImplantFormer: Vision Transformer based Implant Position Regression Using Dental CBCT Data

abstract: Implant prosthesis is the most appropriate treatment for dentition defect or dentition loss, which usually involves a surgical guide design process to decide the implant position. However, such design heavily relies on the subjective experiences of dentists. In this paper, a transformer-based Implant Position Regression Network, ImplantFormer, is proposed to automatically predict the implant position based on the oral CBCT data. We creatively propose to predict the implant position using the 2D axial view of the tooth crown area and fit a centerline of the implant to obtain the actual implant position at the tooth root. Convolutional stem and decoder are designed to coarsely extract image features before the operation of patch embedding and integrate multi-level feature maps for robust prediction, respectively. As both long-range relationship and local features are involved, our approach can better represent global information and achieves better location performance. Extensive experiments on a dental implant dataset through five-fold cross-validation demonstrated that the proposed ImplantFormer achieves superior performance than existing methods.


title: Curiosity-Driven Multi-Agent Exploration with Mixed Objectives

abstract: Intrinsic rewards have been increasingly used to mitigate the sparse reward problem in single-agent reinforcement learning. These intrinsic rewards encourage the agent to look for novel experiences, guiding the agent to explore the environment sufficiently despite the lack of extrinsic rewards. Curiosity-driven exploration is a simple yet efficient approach that quantifies this novelty as the prediction error of the agent's curiosity module, an internal neural network that is trained to predict the agent's next state given its current state and action. We show here, however, that naively using this curiosity-driven approach to guide exploration in sparse reward cooperative multi-agent environments does not consistently lead to improved results. Straightforward multi-agent extensions of curiosity-driven exploration take into consideration either individual or collective novelty only and thus, they do not provide a distinct but collaborative intrinsic reward signal that is essential for learning in cooperative multi-agent tasks. In this work, we propose a curiosity-driven multi-agent exploration method that has the mixed objective of motivating the agents to explore the environment in ways that are individually and collectively novel. First, we develop a two-headed curiosity module that is trained to predict the corresponding agent's next observation in the first head and the next joint observation in the second head. Second, we design the intrinsic reward formula to be the sum of the individual and joint prediction errors of this curiosity module. We empirically show that the combination of our curiosity module architecture and intrinsic reward formulation guides multi-agent exploration more efficiently than baseline approaches, thereby providing the best performance boost to MARL algorithms in cooperative navigation environments with sparse rewards.


title: On the creation of near-surface nitrogen-vacancy centre ensembles by implantation of type Ib diamond

abstract: Dense, near-surface (within 10 nm) ensembles of nitrogen-vacancy (NV) centres in diamond are rapidly moving into prominence as the workhorse of a variety of envisaged applications, ranging from the imaging of fast-fluctuating magnetic signals to the facilitation of nuclear hyperpolarisation. Unlike their bulk counterparts, near-surface ensembles suffer from charge stability issues and reduced NV formation efficiency due to the diamond surface's role as a vacancy sink during annealing and an electron sink afterwards. To this end, work is ongoing to determine the best methods for producing high-quality ensembles in this regime. Here we examine the prospects for creating such ensembles cost-effectively by implanting nitrogen-rich type Ib diamond with electron donors, aiming to exploit the high bulk nitrogen density to combat surface-induced band bending in the process. This approach has previously been successful at creating deeper ensembles, however we find that in the near-surface regime there are fewer benefits over nitrogen implantation into pure diamond substrates. Our results suggest that control over diamond surface termination during annealing is key to successfully creating high-yield near-surface NV ensembles generally, and implantation into type Ib diamond may be worth revisiting once that has been accomplished.


title: Improving Audio Captioning Using Semantic Similarity Metrics

abstract: Audio captioning quality metrics which are typically borrowed from the machine translation and image captioning areas measure the degree of overlap between predicted tokens and gold reference tokens. In this work, we consider a metric measuring semantic similarities between predicted and reference captions instead of measuring exact word overlap. We first evaluate its ability to capture similarities among captions corresponding to the same audio file and compare it to other established metrics. We then propose a fine-tuning method to directly optimize the metric by backpropagating through a sentence embedding extractor and audio captioning network. Such fine-tuning results in an improvement in predicted captions as measured by both traditional metrics and the proposed semantic similarity captioning metric.


title: Fast Efficient Fixed-Size Memory Pool: No Loops and No Overhead

abstract: In this paper, we examine a ready-to-use, robust, and computationally fast fixed-size memory pool manager with no-loops and no-memory overhead that is highly suited towards time-critical systems such as games. The algorithm achieves this by exploiting the unused memory slots for bookkeeping in combination with a trouble-free indexing scheme. We explain how it works in amalgamation with straightforward step-by-step examples. Furthermore, we compare just how much faster the memory pool manager is when compared with a system allocator (e.g., malloc) over a range of allocations and sizes.


title: Learning Audio-Visual Dynamics Using Scene Graphs for Audio Source Separation

abstract: There exists an unequivocal distinction between the sound produced by a static source and that produced by a moving one, especially when the source moves towards or away from the microphone. In this paper, we propose to use this connection between audio and visual dynamics for solving two challenging tasks simultaneously, namely: (i) separating audio sources from a mixture using visual cues, and (ii) predicting the 3D visual motion of a sounding source using its separated audio. Towards this end, we present Audio Separator and Motion Predictor (ASMP) -- a deep learning framework that leverages the 3D structure of the scene and the motion of sound sources for better audio source separation. At the heart of ASMP is a 2.5D scene graph capturing various objects in the video and their pseudo-3D spatial proximities. This graph is constructed by registering together 2.5D monocular depth predictions from the 2D video frames and associating the 2.5D scene regions with the outputs of an object detector applied on those frames. The ASMP task is then mathematically modeled as the joint problem of: (i) recursively segmenting the 2.5D scene graph into several sub-graphs, each associated with a constituent sound in the input audio mixture (which is then separated) and (ii) predicting the 3D motions of the corresponding sound sources from the separated audio. To empirically evaluate ASMP, we present experiments on two challenging audio-visual datasets, viz. Audio Separation in the Wild (ASIW) and Audio Visual Event (AVE). Our results demonstrate that ASMP achieves a clear improvement in source separation quality, outperforming prior works on both datasets, while also estimating the direction of motion of the sound sources better than other methods.


title: Te Test: A New Non-asymptotic T-test for Behrens-Fisher Problems

abstract: The Behrens-Fisher Problem is a classical statistical problem. It is to test the equality of the means of two normal populations using two independent samples, when the equality of the population variances is unknown. Linnik (1968) has shown that this problem has no exact fixed-level tests based on the complete sufficient statistics. However, exact conventional solutions based on other statistics and approximate solutions based the complete sufficient statistics do exist. Existing methods are mainly asymptotic tests, and usually don't perform well when the variances or sample sizes differ a lot. In this paper, we propose a new method to find an exact t-test (Te) to solve this classical Behrens-Fisher Problem. Confidence intervals for the difference between two means are provided. We also use detailed analysis to show that Te test reaches the maximum of degree of freedom and to give a weak version of proof that Te test has the shortest confidence interval length expectation. Some simulations are performed to show the advantages of our new proposed method compared to available conventional methods like Welch's test, paired t-test and so on. We will also compare it to unconventional method, like two-stage test.


title: Controlling ball progression in soccer

abstract: In this paper, we examine how soccer players can use their spatial relationships to control parts of the field and safely move play up the field via chains of ``safe configurations,'' i.e. configurations of players on a team ensuring the possessor of the ball has a collection of open passing options all connected by open passing lanes. An underlying philosophy behind our work is that it is most difficult to disrupt an attacking team's progression forward (with the ball) when this attacking team has multiple ``good'' options of how to proceed at each moment in time. We provide some evidence of this. Our main construction is a directed weighted graph where the nodes encode the configurations of players, the directed edges encode transformations between these configurations, and the weights encode the relative frequencies of the transformations. We conclude with a few applications and proposed further investigations. We believe that our work can serve as a launching platform for significant further investigation into how teams can ``safely progress'' the ball up the field, strategy development, and sophisticated decision making metrics. For coaches and players, we aim to streamline the process of moving safely up the field. In particular, we aim to construct a framework for creating new successful patterns of movement and aim that our framework allows for the development of new strategy. At the same time, our work could help identify configurations on the field which often result in turnovers or that allow for a lot of strategic flexibility (also impeding defensive containment of the attacking team). *Because the contributions of the female authors to this paper were by no means less than those of the male authors, we have chosen to reverse convention and to list the authors in reverse alphabetical order to ensure that the female authors were not listed only after the male authors.


title: A Mean Curvature Flow with Prescribed Contact Angles in a High Dimensional Cylinder

abstract: In this paper we consider a mean curvature flow $V=H+A$ in a high dimensional cylinder $\Omega\times \R$, where, $A$ is a constant, $\Omega$ is a bounded domain in $\R^n$, and, for a hypersurface $y=u(x,t)$ over $\Omega$, $V$ and $H$ denote its normal velocity and mean curvature, respectively. Assume the hypersurface contacts the cylinder boundary $\partial \Omega \times \R$ with prescribed angle $\theta(x)$. Under certain assumptions such as $\Omega$ is strictly convex and $\|\cos\theta\|_{C^2}$ is small, or $\Omega$ is not necessarily convex but $|A|$ is sufficiently large, we derive some {\it uniform-in-time gradient bounds} for the solutions to initial boundary value problems. Then, we present a trichotomy result as well as its criterion for the asymptotic behavior of the solutions, that is, when $I:= A|\Omega|+\int_{\partial \Omega} \cos\theta(x) d\sigma>0$ (resp. $=0$, $<0$), the solution $u$ converges as $t\to \infty$ to a translating solution with positive speed (resp. stationary solution, a translating solution with negative speed).


title: Pair DETR: Contrastive Learning Speeds Up DETR Training

abstract: The DETR object detection approach applies the transformer encoder and decoder architecture to detect objects and achieves promising performance. In this paper, we present a simple approach to address the main problem of DETR, the slow convergence, by using representation learning technique. In this approach, we detect an object bounding box as a pair of keypoints, the top-left corner and the center, using two decoders. By detecting objects as paired keypoints, the model builds up a joint classification and pair association on the output queries from two decoders. For the pair association we propose utilizing contrastive self-supervised learning algorithm without requiring specialized architecture. Experimental results on MS COCO dataset show that Pair DETR can converge at least 10x faster than original DETR and 1.5x faster than Conditional DETR during training, while having consistently higher Average Precision scores.


title: Adaptive Fuzzy Tracking Control with Global Prescribed-Time Prescribed Performance for Uncertain Strict-Feedback Nonlinear Systems

abstract: Adaptive fuzzy control strategies are established to achieve global prescribed performance with prescribed-time convergence for strict-feedback systems with mismatched uncertainties and unknown nonlinearities. Firstly, to quantify the transient and steady performance constraints of the tracking error, a class of prescribed-time prescribed performance functions are designed, and a novel error transformation function is introduced to remove the initial value constraints and solve the singularity problem in existing works. Secondly, based on dynamic surface control methods, controllers with or without approximating structures are established to guarantee that the tracking error achieves prescribed transient performance and converges into a prescribed bounded set within prescribed time. In particular, the settling time and initial value of the prescribed performance function are completely independent of initial conditions of the tracking error and system parameters, which improves existing results. Moreover, with a novel Lyapunov-like energy function, not only the differential explosion problem frequently occurring in backstepping techniques is solved, but the drawback of the semi-global boundedness of tracking error induced by dynamic surface control can be overcome. The validity and effectiveness of the main results are verified by numerical simulations on practical examples.


title: GPA-Net:No-Reference Point Cloud Quality Assessment with Multi-task Graph Convolutional Network

abstract: With the rapid development of 3D vision, point cloud has become an increasingly popular 3D visual media content. Due to the irregular structure, point cloud has posed novel challenges to the related research, such as compression, transmission, rendering and quality assessment. In these latest researches, point cloud quality assessment (PCQA) has attracted wide attention due to its significant role in guiding practical applications, especially in many cases where the reference point cloud is unavailable. However, current no-reference metrics which based on prevalent deep neural network have apparent disadvantages. For example, to adapt to the irregular structure of point cloud, they require preprocessing such as voxelization and projection that introduce extra distortions, and the applied grid-kernel networks, such as Convolutional Neural Networks, fail to extract effective distortion-related features. Besides, they rarely consider the various distortion patterns and the philosophy that PCQA should exhibit shifting, scaling, and rotational invariance. In this paper, we propose a novel no-reference PCQA metric named the Graph convolutional PCQA network (GPA-Net). To extract effective features for PCQA, we propose a new graph convolution kernel, i.e., GPAConv, which attentively captures the perturbation of structure and texture. Then, we propose the multi-task framework consisting of one main task (quality regression) and two auxiliary tasks (distortion type and degree predictions). Finally, we propose a coordinate normalization module to stabilize the results of GPAConv under shift, scale and rotation transformations. Experimental results on two independent databases show that GPA-Net achieves the best performance compared to the state-of-the-art no-reference PCQA metrics, even better than some full-reference metrics in some cases.


title: Primordial Black Hole Mass Function with Mass Gap

abstract: Primordial black holes (PBHs) are mainly characterized by their mass function, in which there may be some huge suppression for certain mass spans. If this is the case, the absence of these PBHs will form mass gaps. In this paper, we investigate the PBH mass function with mass gap. Firstly, to obtain a data-supported PBH mass function with mass gap for subsolar masses PBHs, we fine-tune the coefficients of a model-independent power spectrum of primordial curvature perturbations. Then we take this unique PBH mass function into consideration and calculate the energy density spectrum of the stochastic gravitational wave background from PBH mergers. We find the location of its first peak almost has no relationship with the mass gap and is only determined by the probability distribution of frequencies at which PBH binaries merge. Apart from the first peak, there must be an accompanying smaller trough at higher frequency resulting from the mass gap. Therefore, the detection of this smaller trough will provide more information about inflation and PBH formation.


title: The $A_\alpha$ spectral radius of $k$-connected graphs with given diameter

abstract: Let $G$ be a graph with adjacency matrix $A(G)$ and degree diagonal matrix $D (G)$. In 2017, Nikiforov defined the matrix $A_\alpha(G) = \alpha D(G) + (1-\alpha)A(G)$ for any real $\alpha\in[0,1]$. The largest eigenvalue of $A_\alpha(G)$ is called the $A_\alpha$ spectral radius or the $A_\alpha$-index of $G$. Let $\mathcal{G}_{n,k}^d$ be the set of $k$-connected graphs of order $n$ with diameter $d$. In this paper, we determine the graphs with maximum $A_\alpha$ spectral radius among all graphs in $\mathcal{G}_{n,k}^d$ for any $\alpha\in[0,1)$, where $k\geq2$ and $d\geq2$. We generalizes the results about adjacency matrix of Theorem 3.6 in [P. Huang, W.C. Shiu, P.K. Sun, Linear Algebra Appl., 488 (2016) 350--362] and the results about signless Laplacian matrix of Theorem 3.4 in [P. Huang, J.X. Li, W.C. Shiu, Linear Algebra Appl., 617 (2021) 78--99]. Furthermore, we also obtain the upper and lower bounds of the extremal graph in $\mathcal{G}_{n,k}^d$.


title: Accelerating RNN-T Training and Inference Using CTC guidance

abstract: We propose a novel method to accelerate training and inference process of recurrent neural network transducer (RNN-T) based on the guidance from a co-trained connectionist temporal classification (CTC) model. We made a key assumption that if an encoder embedding frame is classified as a blank frame by the CTC model, it is likely that this frame will be aligned to blank for all the partial alignments or hypotheses in RNN-T and it can be discarded from the decoder input. We also show that this frame reduction operation can be applied in the middle of the encoder, which result in significant speed up for the training and inference in RNN-T. We further show that the CTC alignment, a by-product of the CTC decoder, can also be used to perform lattice reduction for RNN-T during training. Our method is evaluated on the Librispeech and SpeechStew tasks. We demonstrate that the proposed method is able to accelerate the RNN-T inference by 2.2 times with similar or slightly better word error rates (WER).


title: Recursive Reasoning in Minimax Games: A Level $k$ Gradient Play Method

abstract: Despite the success of generative adversarial networks (GANs) in generating visually appealing images, they are notoriously challenging to train. In order to stabilize the learning dynamics in minimax games, we propose a novel recursive reasoning algorithm: Level $k$ Gradient Play (Lv.$k$ GP) algorithm. In contrast to many existing algorithms, our algorithm does not require sophisticated heuristics or curvature information. We show that as $k$ increases, Lv.$k$ GP converges asymptotically towards an accurate estimation of players' future strategy. Moreover, we justify that Lv.$\infty$ GP naturally generalizes a line of provably convergent game dynamics which rely on predictive updates. Furthermore, we provide its local convergence property in nonconvex-nonconcave zero-sum games and global convergence in bilinear and quadratic games. By combining Lv.$k$ GP with Adam optimizer, our algorithm shows a clear advantage in terms of performance and computational overhead compared to other methods. Using a single Nvidia RTX3090 GPU and 30 times fewer parameters than BigGAN on CIFAR-10, we achieve an FID of 10.17 for unconditional image generation within 30 hours, allowing GAN training on common computational resources to reach state-of-the-art performance.


title: Remarkable enhancement in catechol sensing by the decoration of selective transition metals in biphenylene sheet: A systematic first-principles study

abstract: Motivated by the recent successful synthesis of biphenylene structure [Science 372, (2021), 852], we have explored the sensing properties of this material towards the catechol biomolecule by performing the first-principles density functional theory and molecular dynamics simulations. Pristine biphenylene sheet adsorbs catechol molecule with a binding energy of -0.35 eV, which can be systematically improved by decorating the transition metals (Ag, Au, Pd, and Ti) at various possible sites of biphenylene. It is observed that the catechol molecule is adsorbed on Pd and Ti-decorated biphenylene sheets with strong adsorption energies of -1.00 eV and -2.54 eV, respectively. The interaction of the catechol molecule with biphenylene and metal-decorated biphenylene is due to the charge transfer from the O-2p orbitals of the catechol molecule to the C-2p orbitals of biphenylene and d-orbitals of metals in metal-decorated biphenylene, respectively. From the Bader charge calculation, we found that 0.05e amount of charge is transferred from the catechol molecule to pristine biphenylene, which gets almost double (~0.1e) for the Ti-decorated biphenylene sheet. The diffusion energy barrier for the clustering of the Pd and Ti atoms comes out to be 2.39 eV and 4.29 eV, computed by performing the climbing-image nudged elastic band calculations. We found that the catechol molecule gets desorbed from the pristine biphenylene sheet even at 100 K but remains attached to metal (Pd, Ti) decorated biphenylene sheets at room temperature by performing the ab-initio molecular dynamics simulations. The Ti-decorated biphenylene sheet has more sensitivity toward catechol adsorption while the Pd-decorated biphenylene sheet has a suitable recovery time at 500 K. The results suggest that the Pd and Ti-decorated biphenylene sheets are promising materials for catechol detection.


title: A Systematic Survey of Chemical Pre-trained Models

abstract: Deep learning has achieved remarkable success in learning representations for molecules, which is crucial for various biochemical applications, ranging from property prediction to drug design. However, training Deep Neural Networks (DNNs) from scratch often requires abundant labeled molecules, which are expensive to acquire in the real world. To alleviate this issue, tremendous efforts have been devoted to Molecular Pre-trained Models (CPMs), where DNNs are pre-trained using large-scale unlabeled molecular databases and then fine-tuned over specific downstream tasks. Despite the prosperity, there lacks a systematic review of this fast-growing field. In this paper, we present the first survey that summarizes the current progress of CPMs. We first highlight the limitations of training molecular representation models from scratch to motivate CPM studies. Next, we systematically review recent advances on this topic from several key perspectives, including molecular descriptors, encoder architectures, pre-training strategies, and applications. We also highlight the challenges and promising avenues for future research, providing a useful resource for both machine learning and scientific communities.


title: IM: An R-Package for Computation of Image Moments and Moment Invariants

abstract: Moment invariants are well-established and effective shape descriptors for image classification. In this report, we introduce a package for R-language, named IM, that implements the calculation of moments for images and allows the reconstruction of images from moments within an object-oriented framework. Several types of moments may be computed using the IM library, including discrete and continuous Chebyshev, Gegenbauer, Legendre, Krawtchouk, dual Hahn, generalized pseudo-Zernike, Fourier-Mellin, and radial harmonic Fourier moments. In addition, custom bivariate types of moments can be calculated using combinations of two different types of polynomials. A method of polar transformation of pixel coordinates is used to provide an approximate invariance to rotation for moments that are orthogonal over a rectangle. The different types of polynomials used to calculate moments are discussed in this report, as well as comparisons of reconstruction and running time. Examples of image classification using image moments are provided.


title: Learning Probabilistic Models from Generator Latent Spaces with Hat EBM

abstract: This work proposes a method for using any generator network as the foundation of an Energy-Based Model (EBM). Our formulation posits that observed images are the sum of unobserved latent variables passed through the generator network and a residual random variable that spans the gap between the generator output and the image manifold. One can then define an EBM that includes the generator as part of its forward pass, which we call the Hat EBM. The model can be trained without inferring the latent variables of the observed data or calculating the generator Jacobian determinant. This enables explicit probabilistic modeling of the output distribution of any type of generator network. Experiments show strong performance of the proposed method on (1) unconditional ImageNet synthesis at 128x128 resolution, (2) refining the output of existing generators, and (3) learning EBMs that incorporate non-probabilistic generators. Code and pretrained models to reproduce our results are available at https://github.com/point0bar1/hat-ebm.


title: Large-scale motions and self-similar structures in compressible turbulent channel flows

abstract: In this work, we study the scale characteristics of the log- and outer-region motions and structures in subsonic and supersonic turbulence. To this end, a series of direct numerical simulations of the compressible turbulent channel flow at medium Reynolds numbers are performed. Based on this database, the streamwise and spanwise length scales of the outer-region motions are investigated by the two-point correlations and the one-dimensional spectra. The energy distribution among the multi-scale structures in the outer region is found to be dominated by the semilocal friction-Reynolds-number effects rather than the Mach-number effects. This conclusion not only holds for the velocity fluctuations but also the fluctuations of the thermodynamic variables. Besides, the streamwise and spanwise length scales of the outer motions do not alter significantly when the flow passes the sound barrier as reported by a previous experimental study (Bross et al., J. Fluid Mech., vol. 911, 2021, A2). On the other hand, the self-similar structures populating the logarithmic region are investigated by adopting a linear coherence spectrum. The streamwise/wall-normal aspect ratio of the self-similar wall-attached structures of the streamwise velocity and temperature fluctuations is approximately 15.5, and the counterpart of density and pressure fluctuations is 1.8. The present study confirms the existence of self-similar structures in compressible wall turbulence and assesses their geometrical characteristics.


title: Deep Disagreement in Mathematics

abstract: Disagreements that resist rational resolution, often termed ``deep disagreements'', have been the focus of much work in epistemology and informal logic. In this paper, I argue that they also deserve the attention of philosophers of mathematics. I link the question of whether there can be deep disagreements in mathematics to a more familiar debate over whether there can be revolutions in mathematics. I propose an affirmative answer to both questions, using the controversy over Shinichi Mochizuki's work on the abc conjecture as a potential example of both phenomena. I conclude by investigating the prospects for the resolution of mathematical deep disagreements in virtue-theoretic approaches to informal logic and mathematical practice.


title: STPrompt: Semantic-guided and Task-driven prompts for Effective Few-shot Classification

abstract: The effectiveness of prompt learning has been demonstrated in different pre-trained language models. By formulating suitable template and choosing representative label mapping, prompt learning can be used as an efficient knowledge probe. However, finding suitable prompt in existing methods requires multiple experimental attempts or appropriate vector initialization on formulating suitable template and choosing representative label mapping, which it is more common in few-shot learning tasks. Motivating by PLM working process, we try to construct the prompt from task semantic perspective and thus propose the STPrompt -Semantic-guided and Task-driven Prompt model. Specifically, two novel prompts generated from the semantic dependency tree (Dep-prompt) and task-specific metadata description (Meta-prompt), are firstly constructed in a prompt augmented pool, and the proposed model would automatically select a suitable semantic prompt to motivating the prompt learning process. Our results show that the proposed model achieves the state-of-the-art performance in five different datasets of few-shot text classification tasks, which prove that more semantic and significant prompts could assume as a better knowledge proving tool.


title: Harmonic Tutte polynomials of matroids II

abstract: In this work, we introduce the harmonic generalization of the $m$-tuple weight enumerators of codes over finite Frobenius rings. A harmonic version of the MacWilliams-type identity for $m$-tuple weight enumerators of codes over finite Frobenius ring is also given. Moreover, we define the demi-matroid analogue of well-known polynomials from matroid theory, namely Tutte polynomials and coboundary polynomials, and associate them with a harmonic function. We also prove the Greene-type identity relating these polynomials to the harmonic $m$-tuple weight enumerators of codes over finite Frobenius rings. As an application of this Greene-type identity, we provide a simple combinatorial proof of the MacWilliams-type identity for harmonic $m$-tuple weight enumerators over finite Frobenius rings. Finally, we provide the structure of the relative invariant spaces containing the harmonic $m$-tuple weight enumerators of self-dual codes over finite fields.


title: The irregular set for maps with almost weak specification property has full metric mean dimension

abstract: Let $(X, d)$ be a compact metric space, $f: X \to X$ be a continuous transformation with the almost weak specification property and $\varphi: X \to \mathbb{R}$ be a continuous function. We consider the set (called the irregular set for $\varphi$) of points for which the Birkhoff average of $\varphi$ does not exist and show that this set is either empty or carries full Bowen upper and lower metric mean dimension.


title: Gamma Convergence for the de Gennes-Cahn-Hilliard energy

abstract: The degenerate de Gennes-Cahn-Hilliard (dGCH) equation is a model for phase separation which may more closely approximate surface diffusion than others in the limit when the thickness of the transition layer approaches zero. As a first step to understand the limiting behavior, in this paper we study the $\Gamma$--limit of the dGCH energy. We find that its $\Gamma$--limit is a constant multiple of the interface area, where the constant is determined by the de Gennes coefficient together with the double well potential. In contrast, the transition layer profile is solely determined by the double well potential.


title: Neural network quantum state with proximal optimization: a ground-state searching scheme based on variational Monte Carlo

abstract: Neural network quantum states (NQS), incorporating with variational Monte Carlo (VMC) method, are shown to be a promising way to investigate quantum many-body physics. Whereas vanilla VMC methods perform one gradient update per sample, we introduce a novel objective function with proximal optimization (PO) that enables multiple updates via reusing the mismatched samples. Our VMC-PO method keeps the advantage of the previous importance sampling gradient optimization algorithm [L. Yang, {\it et al}, Phys. Rev. Research {\bf 2}, 012039(R)(2020)] that efficiently uses sampled states. PO mitigates the numerical instabilities during network updates, which is similar to stochastic reconfiguration (SR) methods, but achieves an alternative and simpler implement with lower computational complexity. We investigate the performance of our VMC-PO algorithm for ground-state searching with a 1-dimensional transverse-field Ising model and 2-dimensional Heisenberg antiferromagnet on a square lattice, and demonstrate that the reached ground-state energies are comparable to state-of-the-art results.

categories: cond-mat.dis-nn cond-mat.str-el cs.LG physics.comp-ph quant-ph


title: Aligning Offline Metrics and Human Judgments of Value for Code Generation Models

abstract: Large language models have demonstrated great potential to assist programmers in generating code. For such human-AI pair programming scenarios, we empirically demonstrate that while generated code is most often evaluated in terms of their functional correctness (i.e., whether generations pass available unit tests), correctness does not fully capture (e.g., may underestimate) the productivity gains these models may provide. Through a user study with N = 49 experienced programmers, we show that while correctness captures high-value generations, programmers still rate code that fails unit tests as valuable if it reduces the overall effort needed to complete a coding task. Finally, we propose a hybrid metric that combines functional correctness and syntactic similarity and show that it achieves a 14% stronger correlation with value and can therefore better represent real-world gains when evaluating and comparing models.


title: Two is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answering

abstract: We propose a simple refactoring of multi-choice question answering (MCQA) tasks as a series of binary classifications. The MCQA task is generally performed by scoring each (question, answer) pair normalized over all the pairs, and then selecting the answer from the pair that yield the highest score. For n answer choices, this is equivalent to an n-class classification setup where only one class (true answer) is correct. We instead show that classifying (question, true answer) as positive instances and (question, false answer) as negative instances is significantly more effective across various models and datasets. We show the efficacy of our proposed approach in different tasks -- abductive reasoning, commonsense question answering, science question answering, and sentence completion. Our DeBERTa binary classification model reaches the top or close to the top performance on public leaderboards for these tasks. The source code of the proposed approach is available at https://github.com/declare-lab/TEAM.


title: Hybridization of filter and wrapper approaches for the dimensionality reduction and classification of hyperspectral images

abstract: The high dimensionality of hyperspectral images often imposes a heavy computational burden for image processing. Therefore, dimensionality reduction is often an essential step in order to remove the irrelevant, noisy and redundant bands. And consequently, increase the classification accuracy. However, identification of useful bands from hundreds or even thousands of related bands is a nontrivial task. This paper aims at identifying a small set of bands, for improving computational speed and prediction accuracy. Hence, we have proposed a hybrid algorithm through band selection for dimensionality reduction of hyperspectral images. The proposed approach combines mutual information gain (MIG), Minimum Redundancy Maximum Relevance (mRMR) and Error probability of Fano with Support Vector Machine Bands Elimination (SVM-PF). The proposed approach is compared to an effective reproduced filters approach based on mutual information. Experimental results on HSI AVIRIS 92AV3C have shown that the proposed approach outperforms the reproduced filters. Keywords - Hyperspectral images, Classification, band Selection, filter, wrapper, mutual information, information gain.


title: Fiber Organization has Little Effect on Electrical Activation Patterns during Focal Arrhythmias in the Left Atrium

abstract: Over the past two decades there has been a steady trend towards the development of realistic models of cardiac conduction with increasing levels of detail. However, making models more realistic complicates their personalization and use in clinical practice due to limited availability of tissue and cellular scale data. One such limitation is obtaining information about myocardial fiber organization in the clinical setting. In this study, we investigated a chimeric model of the left atrium utilizing clinically derived patient-specific atrial geometry and a realistic, yet foreign for a given patient fiber organization. We discovered that even significant variability of fiber organization had a relatively small effect on the spatio-temporal activation pattern during regular pacing. For a given pacing site, the activation maps were very similar across all fiber organizations tested.


title: Articulatory Representation Learning Via Joint Factor Analysis and Neural Matrix Factorization

abstract: Articulatory representation learning is the fundamental research in modeling neural speech production system. Our previous work has established a deep paradigm to decompose the articulatory kinematics data into gestures, which explicitly model the phonological and linguistic structure encoded with human speech production mechanism, and corresponding gestural scores. We continue with this line of work by raising two concerns: (1) The articulators are entangled together in the original algorithm such that some of the articulators do not leverage effective moving patterns, which limits the interpretability of both gestures and gestural scores; (2) The EMA data is sparsely sampled from articulators, which limits the intelligibility of learned representations. In this work, we propose a novel articulatory representation decomposition algorithm that takes the advantage of guided factor analysis to derive the articulatory-specific factors and factor scores. A neural convolutive matrix factorization algorithm is then employed on the factor scores to derive the new gestures and gestural scores. We experiment with the rtMRI corpus that captures the fine-grained vocal tract contours. Both subjective and objective evaluation results suggest that the newly proposed system delivers the articulatory representations that are intelligible, generalizable, efficient and interpretable.


title: HectoMAP: The Complete Redshift Survey (Data Release 2)

abstract: HectoMAP is a dense redshift survey of 95,403 galaxies based primarily on MMT spectroscopy with a median redshift $z = 0.345$. The survey covers 54.64 square degrees in a 1.5$^\circ$ wide strip across the northern sky centered at a declination of 43.25$^\circ$. We report the redshift, the spectral indicator D$_{n}$4000, and the stellar mass. The red selected survey is 81\% complete for 55,962 galaxies with $(g-r) > 1$ and $r <20.5$; it is 72\% complete for 32,908 galaxies with $(g-r) > 1$, $(r-i) > 0.5$ and $20.5 < r < 21.3$. Comparison of the survey basis SDSS photometry with the HSC-SSP photometry demonstrates that HectoMAP provides complete magnitude limited surveys based on either photometric system. We update the comparison between the HSC-SSP photometric redshifts with HectoMAP spectroscopic redshifts; the comparison demonstrates that the HSC-SSP photometric redshifts have improved between the second and third data releases. HectoMAP is a foundation for examining the quiescent galaxy population (63\% of the survey), clusters of galaxies, and the cosmic web. HectoMAP is completely covered by the HSC-SSP survey, thus enabling a variety of strong and weak lensing investigations.


title: Spectral considerations of Entangled two-photon absorption effects in Hong-Ou-Mandel interference experiments

abstract: Recently, different experimental methods intended to detect the entangled two-photon absorption (ETPA) phenomenon in a variety of materials have been reported. The present work explores a different approach on which the ETPA process is studied based on the changes induced in the visibility of a Hong-Ou-Mandel (HOM) interferogram. By using an organic solution of Rhodamine B as a model of nonlinear material interacting with entangled photons at 800 nm region produced by spontaneous parametric down conversion (SPDC) Type-II, the conditions that make possible to detect changes in the visibility of a HOM interferogram upon ETPA are investigated. We support the discussion of our results by presenting a model in which the sample is considered as a spectral filtering function which fulfills the energy conservation conditions required by ETPA, allowing to explain the experimental observations with good agreement. We believe that this work represents a new perspective to studying the ETPA interaction, by using an ultra-sensitive quantum interference technique and a detailed mathematical model of the process.


title: Energetic variational approaches for multiphase flow systems with phase transition

abstract: We study the governing equations for the motion of the fluid particles near air-water interface from an energetic point of view. Since evaporation and condensation phenomena occur at the interface, we have to consider phase transition. This paper applies an energetic variational approach to derive multiphase flow systems with phase transition, where a multiphase flow means compressible and incompressible two-phase flow. We also research the conservation and energy laws of our system. The key ideas of deriving our systems are to acknowledge the existence of the interface and to apply an energetic variational approach. More precisely, we assume that both the coefficient of surface tension and the density of the interface are constants, and we apply an energetic variational approach to look for the dominant equations for the densities of our multiphase flow systems with phase transition. As applications, we can derive the usual Euler and Navier-Stokes systems, or a two-phase flow system with surface tension by our methods.


title: The solution set of fuzzy relation equations with addition-min composition

abstract: This paper deals with the resolutions of fuzzy relation equations with addition-min composition. When the fuzzy relation equations have a solution, we first propose an algorithm to find all minimal solutions of the fuzzy relation equations and also supply an algorithm to find all maximal solutions of the fuzzy relation equations, which will be illustrated, respectively, by numeral examples. Then we prove that every solution of the fuzzy relation equations is between a minimal solution and a maximal one, so that we describe the solution set of the fuzzy relation equations completely.


title: Plasma emission induced by ring-distributed energetic electrons in overdense plasmas

abstract: According to the standard scenario of plasma emission, escaping radiations are generated by the nonlinear development of the kinetic bump-on-tail instability driven by a single beam of energetic electrons interacting with plasmas. Here we conduct fully-kinetic electromagnetic particle-in-cell simulations to investigate plasma emission induced by the ring-distributed energetic electrons interacting with overdense plasmas. Efficient excitations of the fundamental (F) and harmonic (H) emissions are revealed with radiation mechanism(s) different from the standard scenario: (1) The primary modes accounting for the radiations are generated through the electron cyclotron maser instability (for the upper-hybrid (UH) and Z modes) and the thermal anisotropic instability (for the whistler (W) mode); the F emission is generated by the nonlinear coupling of the Z and W modes and the H emission by the nonlinear coupling of the UH modes. This presents an alternative mechanism of coherent radiation in overdense plasmas.


title: A pruning method based on the dissimilarity of angle among channels and filters

abstract: Convolutional Neural Network (CNN) is more and more widely used in various fileds, and its computation and memory-demand are also increasing significantly. In order to make it applicable to limited conditions such as embedded application, network compression comes out. Among them, researchers pay more attention to network pruning. In this paper, we encode the convolution network to obtain the similarity of different encoding nodes, and evaluate the connectivity-power among convolutional kernels on the basis of the similarity. Then impose different level of penalty according to different connectivity-power. Meanwhile, we propose Channel Pruning base on the Dissimilarity of Angle (DACP). Firstly, we train a sparse model by GL penalty, and impose an angle dissimilarity constraint on the channels and filters of convolutional network to obtain a more sparse structure. Eventually, the effectiveness of our method is demonstrated in the section of experiment. On CIFAR-10, we reduce 66.86% FLOPs on VGG-16 with 93.31% accuracy after pruning, where FLOPs represents the number of floating-point operations per second of the model. Moreover, on ResNet-32, we reduce FLOPs by 58.46%, which makes the accuracy after pruning reach 91.76%.


title: Biphoton engineering using modal spatial overlap on-chip

abstract: Photon pairs generated by spontaneous parametric down-conversion are essential for optical quantum information processing, in which the quality of biphoton states is crucial for the performance. To engineer the biphoton wavefunction (BWF) on-chip, the pump envelope function and the phase matching function are commonly adjusted, while the modal field overlap has been considered as a constant in the frequency range of interest. In this work, by utilizing modal coupling in a system of coupled waveguides, we explore the modal field overlap as a new degree of freedom for biphoton engineering. We provide design examples for on-chip generations of polarization entangled photons and heralded single photons, respectively. This strategy can be applied to waveguides of different materials and structures, offering new possibilities for photonic quantum state engineering.


title: Observable Perfect Equilibrium

abstract: While Nash equilibrium has emerged as the central game-theoretic solution concept, many important games contain several Nash equilibria and we must determine how to select between them in order to create real strategic agents. Several Nash equilibrium refinement concepts have been proposed and studied for sequential imperfect-information games, the most prominent being trembling-hand perfect equilibrium, quasi-perfect equilibrium, and recently one-sided quasi-perfect equilibrium. These concepts are robust to certain arbitrarily small mistakes, and are guaranteed to always exist; however, we argue that neither of these is the correct concept for developing strong agents in sequential games of imperfect information. We define a new equilibrium refinement concept for extensive-form games called observable perfect equilibrium in which the solution is robust over trembles in publicly-observable action probabilities (not necessarily over all action probabilities that may not be observable by opposing players). Observable perfect equilibrium correctly captures the assumption that the opponent is playing as rationally as possible given mistakes that have been observed (while previous solution concepts do not). We prove that observable perfect equilibrium is always guaranteed to exist, and demonstrate that it leads to a different solution than the prior extensive-form refinements in no-limit poker. We expect observable perfect equilibrium to be a useful equilibrium refinement concept for modeling many important imperfect-information games of interest in artificial intelligence.


title: Antiferromagnetic Chern insulators

abstract: The long-sought Chern insulators that manifest quantum anomalous Hall effect are typically considered to occur solely in ferromagnets. Here, we theoretically predict the realizability of Chern insulators in antiferromagnets, of which the magnetic sublattices are connected by symmetry operators enforcing zero net moment. Our symmetry analysis provides comprehensive magnetic layer point groups that allow antiferromagnetic (AFM) Chern insulators, and reveals that in-plane magnetic configuration is required. Followed by first-principles calculations, such design principles naturally lead to two categories of material candidates, exemplified by RbCr2S4 and Mn3Sn thin films with collinear and noncollinear AFM orders, respectively. We further show that the Chern number could be tuned by slight ferromagnetic canting as an effective pivot. Our work elucidates the nature of Chern-insulator phase in AFM systems, paving a new avenue for the search and design of quantum anomalous Hall insulators with the integration of non-dissipative transport and the promising advantages of the AFM order.


title: Clenshaw Graph Neural Networks

abstract: Graph Convolutional Networks (GCNs), which use a message-passing paradigm with stacked convolution layers, are foundational methods for learning graph representations. Recent GCN models use various residual connection techniques to alleviate the model degradation problem such as over-smoothing and gradient vanishing. Existing residual connection techniques, however, fail to make extensive use of underlying graph structure as in the graph spectral domain, which is critical for obtaining satisfactory results on heterophilic graphs. In this paper, we introduce ClenshawGCN, a GNN model that employs the Clenshaw Summation Algorithm to enhance the expressiveness of the GCN model. ClenshawGCN equips the standard GCN model with two straightforward residual modules: the adaptive initial residual connection and the negative second-order residual connection. We show that by adding these two residual modules, ClenshawGCN implicitly simulates a polynomial filter under the Chebyshev basis, giving it at least as much expressive power as polynomial spectral GNNs. In addition, we conduct comprehensive experiments to demonstrate the superiority of our model over spatial and spectral GNN models.


title: Fast Iterative Reconstruction for Multi-spectral CT by a Schmidt Orthogonal Modification Algorithm (SOMA)

abstract: Multi-spectral CT (MSCT) is increasingly used in industrial non-destructive testing and medical diagnosis because of its outstanding performance like material distinguishability. The process of obtaining MSCT data can be modeled as nonlinear equations and the basis material decomposition comes down to the inverse problem of the nonlinear equations. For different spectra data, geometric inconsistent parameters cause geometrical inconsistent rays, which will lead to mismatched nonlinear equations. How to solve the mismatched nonlinear equations accurately and quickly is a hot issue. This paper proposes a general iterative method to invert the mismatched nonlinear equations and develops Schmidt orthogonalization to accelerate convergence. The validity of the proposed method is verified by MSCT basis material decomposition experiments. The results show that the proposed method can decompose the basis material images accurately and improve the convergence speed greatly.


title: Generalized LOAM: LiDAR Odometry Estimation with Trainable Local Geometric Features

abstract: This paper presents a LiDAR odometry estimation framework called Generalized LOAM. Our proposed method is generalized in that it can seamlessly fuse various local geometric shapes around points to improve the position estimation accuracy compared to the conventional LiDAR odometry and mapping (LOAM) method. To utilize continuous geometric features for LiDAR odometry estimation, we incorporate tiny neural networks into a generalized iterative closest point (GICP) algorithm. These neural networks improve the data association metric and the matching cost function using local geometric features. Experiments with the KITTI benchmark demonstrate that our proposed method reduces relative trajectory errors compared to the other LiDAR odometry estimation methods.


title: A Uniform Approach to Compare Architectures in Decentralized Discrete-Event Systems

abstract: Solutions to decentralized discrete-event systems problems are characterized by the way local decisions are fused to yield a global decision. A fusion rule is colloquially called an architecture. Current approaches do not provide a direct way to compare existing architectures. Determining whether an architecture is more permissive than another architecture had relied on producing examples ad hoc and on individual inspiration that puts the conditions for solvability in each architecture into some form that admits comparison. In response to these research efforts, a method based on morphisms between graphs has been extracted to yield a uniform approach to compare the permissiveness of the architectures.


title: MPC Builder for Autonomous Drive: Automatic Generation of MPCs for Motion Planning and Control

abstract: This study presents a new framework for vehicle motion planning and control based on the automatic generation of model predictive controllers (MPCs) named MPC Builder. In this framework, several components necessary for MPC, such as prediction models, constraints, and cost functions, are prepared in advance. The MPC Builder then generates various MPCs online in a unified manner according to traffic situations. This scheme enabled us to represent various driving tasks with less design effort than typical switched MPC systems. The proposed framework was implemented considering the continuation/generalized minimum residual (C/GMRES) method optimization solver, which can reduce computational costs. Finally, numerical experiments on multiple driving scenarios were presented.


title: Mapping State Transition Susceptibility in Quantum Annealing

abstract: Quantum annealing is a novel type of analog computation that aims to use quantum mechanical fluctuations to search for optimal solutions of Ising problems. Quantum annealing in the transverse field Ising model, implemented on D-Wave devices, works by applying a time dependent transverse field, which puts all qubits into a uniform state of superposition, and then applying a Hamiltonian over time which describes a user programmed Ising problem. We present a method which utilizes two control features of D-Wave quantum annealers, reverse annealing and an h-gain schedule, to quantify the susceptibility, or the distance, between two classical states of an Ising problem. The starting state is encoded using reverse annealing, and the second state is encoded on the linear terms of problem Hamiltonian. An h-gain schedule is specified which incrementally increases the strength of the linear terms, thus allowing a quantification of the h-gain strength required to transition the anneal into a specific state at the final measurement. By the nature of quantum annealing, the state tends towards global minima and therefore we restrict the second classical state to a minimum solution of the given Ising problem. This susceptibility mapping, when enumerated across all initial states, shows in detail the behavior of the quantum annealer during reverse annealing. The procedure is experimentally demonstrated on three small test Ising's which were embedded in parallel on the D-Wave Advantage_system4.1. Analysis of the state transition mapping shows detailed characteristics of the reverse annealing process including intermediate state transition paths, which are visually represented as state transition networks.

categories: quant-ph cond-mat.dis-nn cond-mat.stat-mech cs.DM cs.ET