title: The Single Robot Line Coverage Problem: Theory, Algorithms, and Experiments

abstract: Line coverage is the task of servicing a given set of one-dimensional features in an environment. It is important for the inspection of linear infrastructure such as road networks, power lines, and oil and gas pipelines. This paper addresses the single robot line coverage problem for aerial and ground robots by modeling it as an optimization problem on a graph. The problem belongs to the broad class of arc routing problems and is closely related to the rural postman problem (RPP) on asymmetric graphs. The paper presents an integer linear programming formulation with proofs of correctness. Using the minimum cost flow problem, we develop approximation algorithms with guarantees on the solution quality. These guarantees also improve the existing results for the asymmetric RPP. The main algorithm partitions the problem into three cases based on the structure of the required graph, i.e., the graph induced by the features that require servicing. We evaluate our algorithms on road networks from the 50 most populous cities in the world, consisting of up to 730 road segments. The algorithms, augmented with improvement heuristics, run within 3s and generate solutions that are within 10% of the optimum. We experimentally demonstrate our algorithms with commercial UAVs.


title: Twin Papers: A Simple Framework of Causal Inference for Citations via Coupling

abstract: The research process includes many decisions, e.g., how to entitle and where to publish the paper. In this paper, we introduce a general framework for investigating the effects of such decisions. The main difficulty in investigating the effects is that we need to know counterfactual results, which are not available in reality. The key insight of our framework is inspired by the existing counterfactual analysis using twins, where the researchers regard twins as counterfactual units. The proposed framework regards a pair of papers that cite each other as twins. Such papers tend to be parallel works, on similar topics, and in similar communities. We investigate twin papers that adopted different decisions, observe the progress of the research impact brought by these studies, and estimate the effect of decisions by the difference in the impacts of these studies. We release our code and data, which we believe are highly beneficial owing to the scarcity of the dataset on counterfactual studies.


title: Transmittable Nonreciprocal Cloaking

abstract: Cloaking is typically reciprocal. We introduce here the concept of \emph{transmittable nonreciprocal cloaking} whereby the cloaking system operates as a standard omnidirectional cloak for external illumination, but can transmit light from its center outwards at will. We demonstrate a specific implementation of such cloaking that consists in a set of concentric bianisotropic metasurfaces whose innermost element is nonreciprocal and designed to simultaneously block inward waves and pass -- either omnidirectionaly or directionally -- outward waves. Such cloaking represents a fundamental diversification of conventional cloaking and may find applications in areas such as stealth, blockage avoidance, illusion and cooling.


title: Towards Principled User-side Recommender Systems

abstract: Traditionally, recommendation algorithms have been designed for service developers. However, recently, a new paradigm called user-side recommender systems has been proposed and they enable web service users to construct their own recommender systems without access to trade-secret data. This approach opens the door to user-defined fair systems even if the official recommender system of the service is not fair. While existing methods for user-side recommender systems have addressed the challenging problem of building recommender systems without using log data, they rely on heuristic approaches, and it is still unclear whether constructing user-side recommender systems is a well-defined problem from theoretical point of view. In this paper, we provide theoretical justification of user-side recommender systems. Specifically, we see that hidden item features can be recovered from the information available to the user, making the construction of user-side recommender system well-defined. However, this theoretically grounded approach is not efficient. To realize practical yet theoretically sound recommender systems, we propose three desirable properties of user-side recommender systems and propose an effective and efficient user-side recommender system, \textsc{Consul}, based on these foundations. We prove that \textsc{Consul} satisfies all three properties, whereas existing user-side recommender systems lack at least one of them. In the experiments, we empirically validate the theory of feature recovery via numerical experiments. We also show that our proposed method achieves an excellent trade-off between effectiveness and efficiency and demonstrate via case studies that the proposed method can retrieve information that the provider's official recommender system cannot.


title: Area Coverage with Multiple Capacity-Constrained Robots

abstract: The area coverage problem is the task of efficiently servicing a given two-dimensional surface using sensors mounted on robots such as unmanned aerial vehicles (UAVs) and unmanned ground vehicles (UGVs). We present a novel formulation for generating coverage routes for multiple capacity-constrained robots, where capacity can be specified in terms of battery life or flight time. Traversing the environment incurs demands on the robot resources, which have capacity limits. The central aspect of our approach is transforming the area coverage problem into a line coverage problem (i.e., coverage of linear features), and then generating routes that minimize the total cost of travel while respecting the capacity constraints. We define two modes of travel: (1) servicing and (2) deadheading, which correspond to whether a robot is performing task-specific actions or not. Our formulation allows separate and asymmetric travel costs and demands for the two modes. Furthermore, the cells computed from cell decomposition, aimed at minimizing the number of turns, are not required to be monotone polygons. We develop new procedures for cell decomposition and generation of service tracks that can handle non-monotone polygons with or without holes. We establish the efficacy of our algorithm on a ground robot dataset with 25 indoor environments and an aerial robot dataset with 300 outdoor environments. The algorithm generates solutions whose costs are 10% lower on average than state-of-the-art methods. We additionally demonstrate our algorithm in experiments with UAVs.


title: Ghost distributions on supersymmetric spaces II: basic classical superalgebras

abstract: We study ghost distributions on supersymmetric spaces for the case of basic classical Lie superalgebras. We introduce the notion of interlaced pairs, which are those for which both $(\mathfrak{g},\mathfrak{k})$ and $(\mathfrak{g},\mathfrak{k}')$ admit Iwasawa decompositions. For such pairs we define a ghost algebra, generalizing the subalgebra of $\mathcal{U}\mathfrak{g}$ defined by Gorelik. We realize this algebra as an algebra of $G$-equivariant operators on the supersymmetric space itself, and for certain pairs, the `special' ones, we realize our operators as twisted-equivariant differential operators on $G/K$. We additionally show that the Harish-Chandra morphism is injective, compute its image for all rank one pairs, and provide a conjecture for the image when $(\mathfrak{g},\mathfrak{k})$ is interlaced.


title: Automatic tagging of knowledge points for K12 math problems

abstract: Automatic tagging of knowledge points for practice problems is the basis for managing question bases and improving the automation and intelligence of education. Therefore, it is of great practical significance to study the automatic tagging technology for practice problems. However, there are few studies on the automatic tagging of knowledge points for math problems. Math texts have more complex structures and semantics compared with general texts because they contain unique elements such as symbols and formulas. Therefore, it is difficult to meet the accuracy requirement of knowledge point prediction by directly applying the text classification techniques in general domains. In this paper, K12 math problems taken as the research object, the LABS model based on label-semantic attention and multi-label smoothing combining textual features is proposed to improve the automatic tagging of knowledge points for math problems. The model combines the text classification techniques in general domains and the unique features of math texts. The results show that the models using label-semantic attention or multi-label smoothing perform better on precision, recall, and F1-score metrics than the traditional BiLSTM model, while the LABS model using both performs best. It can be seen that label information can guide the neural networks to extract meaningful information from the problem text, which improves the text classification performance of the model. Moreover, multi-label smoothing combining textual features can fully explore the relationship between text and labels, improve the model's prediction ability for new data and improve the model's classification accuracy.


title: Asymptotic behavior of conservative solutions to the Hunter-Saxton equation

abstract: In this paper we study the large time asymptotic behavior of (energy) conservative solutions to the Hunter-Saxton equation in a generalized framework that consists of the evolutions of solution and its energy measure. We describe the large time asymptotic expansions of the conservative solutions, and rigorously verify the validity of the leading order term in $L^{\infty}(\mathbb{R})$ and ${\dot{H}}^1(\mathbb{R})$ spaces respectively. The leading order term is given by a kink-wave that is determined by the total energy of the system only. As a corollary, we also show that the singular part of the energy measure converges to zero, as the time goes to either positive or negative infinity. Under some natural decay rate assumptions on the tails of the initial energy measure, we rigorously provide the optimal error estimates in $L^{\infty}(\mathbb{R})$ and ${\dot{H}}^1(\mathbb{R})$. As the time goes to infinity, the pointwise convergence and pointwise growth rate for the solution are also obtained under the same assumptions on the initial data. The proofs of our results rely heavily on the elaborate analysis of the generalized characteristics designed for the measure-valued initial data, and explicit formulae for conservative solutions.


title: Flexible evaluation of surrogacy in Bayesian adaptive platform studies

abstract: Trial level surrogates are useful tools for improving the speed and cost effectiveness of trials, but surrogates that have not been properly evaluated can cause misleading results. The evaluation procedure is often contextual and depends on the type of trial setting. There have been many proposed methods for trial level surrogate evaluation, but none, to our knowledge, for the specific setting of Bayesian adaptive platform studies. As adaptive studies are becoming more popular, methods for surrogate evaluation using them are needed. These studies also offer a rich data resource for surrogate evaluation that would not normally be possible. However, they also offer a set of statistical issues including heterogeneity of the study population, treatments, implementation, and even potentially the quality of the surrogate. We propose the use of a hierarchical Bayesian semiparametric model for the evaluation of potential surrogates using nonparametric priors for the distribution of true effects based on Dirichlet process mixtures. The motivation for this approach is to flexibly model relationships between the treatment effect on the surrogate and the treatment effect on the outcome and also to identify potential clusters with differential surrogate value in a data-driven manner. In simulations, we find that our proposed method is superior to a simple, but fairly standard, hierarchical Bayesian method. We demonstrate how our method can be used in a simulated illustrative example (based on the ProBio trial), in which we are able to identify clusters where the surrogate is, and is not useful. We plan to apply our method to the ProBio trial, once it is completed.


title: Objects Can Move: 3D Change Detection by Geometric Transformation Constistency

abstract: AR/VR applications and robots need to know when the scene has changed. An example is when objects are moved, added, or removed from the scene. We propose a 3D object discovery method that is based only on scene changes. Our method does not need to encode any assumptions about what is an object, but rather discovers objects by exploiting their coherent move. Changes are initially detected as differences in the depth maps and segmented as objects if they undergo rigid motions. A graph cut optimization propagates the changing labels to geometrically consistent regions. Experiments show that our method achieves state-of-the-art performance on the 3RScan dataset against competitive baselines. The source code of our method can be found at https://github.com/katadam/ObjectsCanMove.


title: Electrostatic complementarity at the interface drives transient protein-protein interactions

abstract: Understanding the molecular mechanisms driving the binding between bio-molecules is a crucial challenge in molecular biology. In this respect, characteristics like the preferentially hydrophobic composition of the binding interfaces, the role of van der Waals interactions (short range forces), and the consequent shape complementarity between the interacting molecular surfaces are well established. However, no consensus has yet been reached on how and how much electrostatic participates in the various stages of protein-protein interactions. Here, we perform extensive analyses on a large dataset of protein complexes for which both experimental binding affinity and pH data were available. We found that (i) although different classes of dimers do not present marked differences in the amino acid composition and charges disposition in the binding region, (ii) homodimers with identical binding region show higher electrostatic compatibility with respect to both homodimers with non-identical binding region and heterodimers. The level of electrostatic compatibility also varies with the pH of the complex, reaching the lowest values for low pH. Interestingly, (iii) shape and electrostatic complementarity behave oppositely when one stratifies the complexes by their binding affinity. Conversely, complexes with low values of binding affinity exploit Coulombic complementarity to acquire specificity, suggesting that electrostatic complementarity may play a greater role in transient (or less stable) complexes. In light of these results, (iv) we provide a fast and efficient method to measure electrostatic complementarity without the need of knowing the complex structure. Expanding the electrostatic potential on a basis of 2D orthogonal polynomials, we can discriminate between transient and permanent protein complexes with an AUC of the ROC of 0.8.


title: Provably Tightest Linear Approximation for Robustness Verification of Sigmoid-like Neural Networks

abstract: The robustness of deep neural networks is crucial to modern AI-enabled systems and should be formally verified. Sigmoid-like neural networks have been adopted in a wide range of applications. Due to their non-linearity, Sigmoid-like activation functions are usually over-approximated for efficient verification, which inevitably introduces imprecision. Considerable efforts have been devoted to finding the so-called tighter approximations to obtain more precise verification results. However, existing tightness definitions are heuristic and lack theoretical foundations. We conduct a thorough empirical analysis of existing neuron-wise characterizations of tightness and reveal that they are superior only on specific neural networks. We then introduce the notion of network-wise tightness as a unified tightness definition and show that computing network-wise tightness is a complex non-convex optimization problem. We bypass the complexity from different perspectives via two efficient, provably tightest approximations. The results demonstrate the promising performance achievement of our approaches over state of the art: (i) achieving up to 251.28% improvement to certified lower robustness bounds; and (ii) exhibiting notably more precise verification results on convolutional networks.


title: A Failed Proof Can Yield a Useful Test

abstract: A successful automated program proof is, in software verification, the ultimate triumph. In practice, however, the road to such success is paved with many failed proof attempts. Unlike a failed test, which provides concrete evidence of an actual bug in the program, a failed proof leaves the programmer in the dark. Can we instead learn something useful from it? The work reported here takes advantage of the rich internal information that some automatic provers collect about the program when attempting a proof. If the proof fails, the Proof2Test tool presented in this article uses the counterexample generated by the prover (specifically, the SMT solver underlying the proof environment Boogie, used in the AutoProof system to perform correctness proofs of contract-equipped Eiffel programs) to produce a failed test, which provides the programmer with immediately exploitable information to correct the program. The discussion presents the Proof2Test tool and demonstrates the application of the ideas and tool to a collection of representative examples.


title: Local equilibrium and Lambda polarization in high energy heavy ion collisions

abstract: The polarization of the $\Lambda$ hyperon has become an important probe of the Quark-Gluon Plasma produced in relativistic heavy-ion collisions. Recently, it has been found that polarization receives a substantial contribution from a local equilibrium term proportional to the symmetric derivative of the four-temperature vector, the thermal shear tensor. We show that, at very high energies, this term can restore the agreement between the experimental measurements and the predictions of the hydrodynamic model, provided that the hadronization hypersurface is isothermal. We review the theoretical derivation of this new term, discuss numerical computations at RHIC and LHC energies, and compare them with the experimental data. We also present the effect of feed-down corrections.


title: Tensor-based flow reconstruction from optimally located sensor measurements

abstract: Reconstructing high-resolution flow fields from sparse measurements is a major challenge in fluid dynamics. Existing methods often vectorize the flow by stacking different spatial directions on top of each other, hence confounding the information encoded in different dimensions. Here, we introduce a tensor-based sensor placement and flow reconstruction method which retains and exploits the inherent multidimensionality of the flow. We derive estimates for the flow reconstruction error, storage requirements and computational cost of our method. We show, with examples, that our tensor-based method is significantly more accurate than similar vectorized methods. Furthermore, the variance of the error is smaller when using our tensor-based method. While the computational cost of our method is comparable to similar vectorized methods, it reduces the storage cost by several orders of magnitude. The reduced storage cost becomes even more pronounced as the dimension of the flow increases. We demonstrate the efficacy of our method on three examples: a chaotic Kolmogorov flow, in-situ and satellite measurements of the global sea surface temperature, and 3D unsteady simulated flow around a marine research vessel.


title: Shotgun threshold for sparse Erd\H{o}s-R\'enyi graphs

abstract: In the shotgun assembly problem for a graph, we are given the empirical profile for rooted neighborhoods of depth $r$ (up to isomorphism) for some $r\geq 1$ and we wish to recover the underlying graph up to isomorphism. When the underlying graph is an Erd\H{o}s-R\'enyi $\mathcal G(n, \frac{\lambda}{n})$, we show that the shotgun assembly threshold $r_* \approx \frac{ \log n}{\log (\lambda^2 \gamma_\lambda)^{-1}}$ where $\gamma_\lambda$ is the probability for two independent Poisson-Galton-Watson trees with parameter $\lambda$ to be rooted isomorphic with each other. Our result sharpens a constant factor in a previous work by Mossel and Ross (2019) and thus solves a question therein.


title: ATOMS: ALMA Three-millimeter Observations of Massive Star-forming regions -- XII: Fragmentation and multi-scale gas kinematics in protoclusters G12.42+0.50 and G19.88-0.53

abstract: We present new continuum and molecular line data from the ALMA Three-millimeter Observations of Massive Star-forming regions (ATOMS) survey for the two protoclusters, G12.42+0.50 and G19.88-0.53. The 3 mm continuum maps reveal seven cores in each of the two globally contracting protoclusters. These cores satisfy the radius-mass relation and the surface mass density criteria for high-mass star formation. Similar to their natal clumps, the virial analysis of the cores suggests that they are undergoing gravitational collapse ($\rm \alpha_{vir} << 2$). The clump to core scale fragmentation is investigated and the derived core masses and separations are found to be consistent with thermal Jeans fragmentation. We detect large-scale filamentary structures with velocity gradients and multiple outflows in both regions. Dendrogram analysis of the H$^{13}$CO$^{+}$ map identifies several branch and leaf structures with sizes $\sim$ 0.1 and 0.03 pc, respectively. The supersonic gas motion displayed by the branch structures is in agreement with the Larson power-law indicating that the gas kinematics at this spatial scale is driven by turbulence. The transition to transonic/subsonic gas motion is seen to occur at spatial scales of $\sim$0.1 pc indicating the dissipation of turbulence. In agreement with this, the leaf structures reveal gas motions that deviate from the slope of Larson's law. From the large-scale converging filaments to the collapsing cores, the gas dynamics in G12.42+0.50 and G19.88-0.53 show scale-dependent dominance of turbulence and gravity and the combination of these two driving mechanisms needs to be invoked to explain massive star formation in the protoclusters.


title: DPTNet: A Dual-Path Transformer Architecture for Scene Text Detection

abstract: The prosperity of deep learning contributes to the rapid progress in scene text detection. Among all the methods with convolutional networks, segmentation-based ones have drawn extensive attention due to their superiority in detecting text instances of arbitrary shapes and extreme aspect ratios. However, the bottom-up methods are limited to the performance of their segmentation models. In this paper, we propose DPTNet (Dual-Path Transformer Network), a simple yet effective architecture to model the global and local information for the scene text detection task. We further propose a parallel design that integrates the convolutional network with a powerful self-attention mechanism to provide complementary clues between the attention path and convolutional path. Moreover, a bi-directional interaction module across the two paths is developed to provide complementary clues in the channel and spatial dimensions. We also upgrade the concentration operation by adding an extra multi-head attention layer to it. Our DPTNet achieves state-of-the-art results on the MSRA-TD500 dataset, and provides competitive results on other standard benchmarks in terms of both detection accuracy and speed.


title: Space-time finite element methods for parabolic distributed optimal control problems

abstract: We present a method for the numerical approximation of distributed optimal control problems constrained by parabolic partial differential equations. We complement the first-order optimality condition by a recently developed space-time variational formulation of parabolic equations which is coercive in the energy norm, and a Lagrangian multiplier. Our final formulation fulfills the Babu\v{s}ka-Brezzi conditions on the continuous as well as discrete level, without restrictions. Consequently, we can allow for final-time desired states, and obtain an a-posteriori error estimator which is efficient and reliable. Numerical experiments confirm our theoretical findings.


title: Search for sub-eV axion-like particles in a stimulated resonant photon-photon collider with two laser beams based on a novel method to discriminate pressure-independent components

abstract: Sub-eV axion-like particles (ALPs) have been searched for by focusing two-color near-infrared pulse lasers into a vacuum along a common optical axis. Within the focused quasi-parallel collision system created by combining a creation field ($2.5\,\mathrm{mJ}/47\,\mathrm{fs}$ Ti:Sapphire laser) and a background inducing field ($1.5\,\mathrm{mJ}/9\,\mathrm{ns}$ Nd:YAG laser), the detection of signal photons via stimulated resonant photon-photon scattering by exchanging ALPs was attempted in a vacuum chamber. The signal wavelength can be determined via energy-momentum conservation in the vacuum, and it coincides with that determined from the atomic four-wave-mixing (aFWM) process. In this work, the pulse energies were one order of magnitude higher than those in the previous search, allowing aFWM from optical elements to be observed as a pressure-independent background for the first time, in addition to the residual-gas-originating aFWM following a quadratic pressure dependence. In principle the four-wave-mixing process in vacuum via ALP exchanges (vFWM) must also be pressure-independent, so the development of a new method for discriminating the optical-element aFWM is indispensable for increasing the pulse energies to the values needed for future upgraded searches. In this paper, we will present the established method for quantifying the yield from the optical-element aFWM process based on the beam cross-section dependence. With the new method, the number of signal photons was found to be consistent with zero. We then successfully obtained a new exclusion region in the relation between ALP-photon coupling, $g/M$, and the ALP mass $m$, reaching the most sensitive point $g/M = 1.14\times10^{-5}\,\mathrm{GeV^{-1}}$ at $m = 0.18\,\mathrm{eV}$.


title: Masked Video Modeling with Correlation-aware Contrastive Learning for Breast Cancer Diagnosis in Ultrasound

abstract: Breast cancer is one of the leading causes of cancer deaths in women. As the primary output of breast screening, breast ultrasound (US) video contains exclusive dynamic information for cancer diagnosis. However, training models for video analysis is non-trivial as it requires a voluminous dataset which is also expensive to annotate. Furthermore, the diagnosis of breast lesion faces unique challenges such as inter-class similarity and intra-class variation. In this paper, we propose a pioneering approach that directly utilizes US videos in computer-aided breast cancer diagnosis. It leverages masked video modeling as pretraining to reduce reliance on dataset size and detailed annotations. Moreover, a correlation-aware contrastive loss is developed to facilitate the identifying of the internal and external relationship between benign and malignant lesions. Experimental results show that our proposed approach achieved promising classification performance and can outperform other state-of-the-art methods.


title: General coefficient-vanishing results associated with theta series

abstract: In previous literature, there are a number of sporadic coefficient-vanishing results associated with theta series. These examples suggest certain underlying patterns. By expanding theta powers as a linear combination of products of theta functions, we present two strategies that will provide a unified treatment. Our approaches rely on studying the behavior of a product of two theta series under the action of the huffing operator. Some explicit criteria are given. We may use the presented method to not only verify experimentally discovered coefficient-vanishing results, but also to generate a series of general phenomena.


title: A predictor-corrector deep learning algorithm for high dimensional stochastic partial differential equations

abstract: In this paper, we present a deep learning-based numerical method for approximating high dimensional stochastic partial differential equations (SPDEs). At each time step, our method relies on a predictor-corrector procedure. More precisely, we decompose the original SPDE into a degenerate SPDE and a deterministic PDE. Then in the prediction step, we solve the degenerate SPDE with the Euler scheme, while in the correction step we solve the second-order deterministic PDE by deep neural networks via its equivalent backward stochastic differential equation (BSDE). Under standard assumptions, error estimates and the rate of convergence of the proposed algorithm are presented. The efficiency and accuracy of the proposed algorithm are illustrated by numerical examples.


title: DiscrimLoss: A Universal Loss for Hard Samples and Incorrect Samples Discrimination

abstract: Given data with label noise (i.e., incorrect data), deep neural networks would gradually memorize the label noise and impair model performance. To relieve this issue, curriculum learning is proposed to improve model performance and generalization by ordering training samples in a meaningful (e.g., easy to hard) sequence. Previous work takes incorrect samples as generic hard ones without discriminating between hard samples (i.e., hard samples in correct data) and incorrect samples. Indeed, a model should learn from hard samples to promote generalization rather than overfit to incorrect ones. In this paper, we address this problem by appending a novel loss function DiscrimLoss, on top of the existing task loss. Its main effect is to automatically and stably estimate the importance of easy samples and difficult samples (including hard and incorrect samples) at the early stages of training to improve the model performance. Then, during the following stages, DiscrimLoss is dedicated to discriminating between hard and incorrect samples to improve the model generalization. Such a training strategy can be formulated dynamically in a self-supervised manner, effectively mimicking the main principle of curriculum learning. Experiments on image classification, image regression, text sequence regression, and event relation reasoning demonstrate the versatility and effectiveness of our method, particularly in the presence of diversified noise levels.


title: HST: Hierarchical Swin Transformer for Compressed Image Super-resolution

abstract: Compressed Image Super-resolution has achieved great attention in recent years, where images are degraded with compression artifacts and low-resolution artifacts. Since the complex hybrid distortions, it is hard to restore the distorted image with the simple cooperation of super-resolution and compression artifacts removing. In this paper, we take a step forward to propose the Hierarchical Swin Transformer (HST) network to restore the low-resolution compressed image, which jointly captures the hierarchical feature representations and enhances each-scale representation with Swin transformer, respectively. Moreover, we find that the pretraining with Super-resolution (SR) task is vital in compressed image super-resolution. To explore the effects of different SR pretraining, we take the commonly-used SR tasks (e.g., bicubic and different real super-resolution simulations) as our pretraining tasks, and reveal that SR plays an irreplaceable role in the compressed image super-resolution. With the cooperation of HST and pre-training, our HST achieves the fifth place in AIM 2022 challenge on the low-quality compressed image super-resolution track, with the PSNR of 23.51dB. Extensive experiments and ablation studies have validated the effectiveness of our proposed methods. The code and models are available at https://github.com/USTC-IMCL/HST-for-Compressed-Image-SR.


title: Importance of higher harmonics and $v_4$ puzzle in quark-gluon plasma tomography

abstract: QGP tomography aims to constrain the parameters characterizing the properties and evolution of Quark-Gluon Plasma (QGP) formed in heavy-ion collisions, by exploiting low and high-$p_\perp$ theory and data. Higher-order harmonics $v_n$ ($n>2$) are an important -- but seldom explored -- part of this approach. However, to take full advantage of them, several issues have to be addressed: i) consistency of different methods for calculating $v_n$, ii) importance of event-by-event fluctuations to high-$p_\perp$ $R_{AA}$ and $v_2$ predictions, iii) sensitivity of higher harmonics to the initial state of fluid-dynamical evolution. We obtain that i) several methods for calculating harmonics are compatible with each other, ii) event-by-event calculations are important in mid-central collisions, and iii) various initializations of the evolution of the medium lead to quantitatively and qualitatively different predictions, likely to be distinguished by future measurements. We also find that the present high-$p_\perp$ $v_4$ data cannot be reproduced using initial states for fluid-dynamical evolution given by state-of-the-art models. We call this discrepancy high-$p_\perp$ $v_4$ puzzle at the LHC.


title: Infrared-active phonons in one-dimensional materials and their spectroscopic signatures

abstract: Dimensionality provides a clear fingerprint on the dispersion of infrared-active, polar-optical phonons. For these phonons, the local dipoles parametrized by the Born effective charges drive the LO-TO splitting of bulk materials; this splitting actually breaks down in two-dimensional materials. Here, we extend the existing theory to the one-dimensional (1D) case. Combining an analytical model with the implementation of density-functional perturbation theory in 1D boundary conditions, we show that the dielectric splitting in the dispersion relations collapses logarithmically at the zone center. The dielectric properties and the radius of the 1D materials are linked by the present work to these red shifts, opening novel IR and Raman characterization avenues.


title: Iterative-Free Quantum Approximate Optimization Algorithm Using Neural Networks

abstract: The quantum approximate optimization algorithm (QAOA) is a leading iterative variational quantum algorithm for heuristically solving combinatorial optimization problems. A large portion of the computational effort in QAOA is spent by the optimization steps, which require many executions of the quantum circuit. Therefore, there is active research focusing on finding better initial circuit parameters, which would reduce the number of required iterations and hence the overall execution time. While existing methods for parameter initialization have shown great success, they often offer a single set of parameters for all problem instances. We propose a practical method that uses a simple, fully connected neural network that leverages previous executions of QAOA to find better initialization parameters tailored to a new given problem instance. We benchmark state-of-the-art initialization methods for solving the MaxCut problem of Erd\H{o}s-R\'enyi graphs using QAOA and show that our method is consistently the fastest to converge while also yielding the best final result. Furthermore, the parameters predicted by the neural network are shown to match very well with the fully optimized parameters, to the extent that no iterative steps are required, thereby effectively realizing an iterative-free QAOA scheme.


title: G2{\Phi}net: Relating Genotype and Biomechanical Phenotype of Tissues with Deep Learning

abstract: Many genetic mutations adversely affect the structure and function of load-bearing soft tissues, with clinical sequelae often responsible for disability or death. Parallel advances in genetics and histomechanical characterization provide significant insight into these conditions, but there remains a pressing need to integrate such information. We present a novel genotype-to-biomechanical-phenotype neural network (G2{\Phi}net) for characterizing and classifying biomechanical properties of soft tissues, which serve as important functional readouts of tissue health or disease. We illustrate the utility of our approach by inferring the nonlinear, genotype-dependent constitutive behavior of the aorta for four mouse models involving defects or deficiencies in extracellular constituents. We show that G2{\Phi}net can infer the biomechanical response while simultaneously ascribing the associated genotype correctly by utilizing limited, noisy, and unstructured experimental data. More broadly, G2{\Phi}net provides a powerful method and a paradigm shift for correlating genotype and biomechanical phenotype quantitatively, promising a better understanding of their interplay in biological tissues.


title: Counting points on smooth plane quartics

abstract: We present efficient algorithms for counting points on a smooth plane quartic curve $X$ modulo a prime $p$. We address both the case where $X$ is defined over $\mathbb F_p$ and the case where $X$ is defined over $\mathbb Q$ and $p$ is a prime of good reduction. We consider two approaches for computing $\#X(\mathbb F_p)$, one which runs in $O(p\log p\log\log p)$ time using $O(\log p)$ space and one which runs in $O(p^{1/2}\log^2\!p)$ time using $O(p^{1/2}\log p)$ space. Both approaches yield algorithms that are faster in practice than existing methods. We also present average polynomial-time algorithms for $X/\mathbb Q$ that compute $\#X(\mathbb F_p)$ for good primes $p\le N$ in $O(N\log^3\! N)$ time using $O(N)$ space. These are the first practical implementations of average polynomial-time algorithms for curves that are not cyclic covers of $\mathbb P^1$, which in combination with previous results addresses all curves of genus $g\le 3$. Our algorithms also compute Cartier-Manin/Hasse-Witt matrices that may be of independent interest.


title: Twisted Self-duality

abstract: We examine a generalisation of the usual self-duality equations for Yang-Mills theory when the colour space admits a non-trivial involution. This involution allows us to construct a non-trivial twist which may be combined with the Hodge star to form a twisted self-dual curvature. We will construct a simple example of twisted self-duality for $su(2) \oplus su(2)$ gauge theory along with its explicit solutions and then dimensionally reduce from four dimensions to obtain families of non-trivial non-linear equations in lower dimensions. This twisted self-duality constraint will be shown to arise in E_7 exceptional field theory through a Scherk-Schwarz reduction and we will show how an Eguchi-Hanson gravitational instanton also obeys the twisted self-duality condition.


title: Analytically Approximation Solution to $R^{2}$ Gravity

abstract: In this paper, we obtain analytical approximate black hole solutions in the framework of $f(R)$ gravity and the absence of a cosmological constant. In this area, we apply the equations of motion of the theory to a spherically symmetric spacetime with one unknown function and derive black hole solutions without any constraints on the Ricci scalar. To do so, first, we obtain the near horizon and asymptotic solutions and then use both of them to obtain a complete solution by utilizing a continued-fraction expansion. Finally, we investigate the stability of the solutions by employing the thermodynamics and quasi-normal modes.


title: Maximal hypersurfaces in asymptotically Anti-de Sitter spacetime

abstract: We prove uniqueness, existence, and regularity results for maximal hypersurfaces in spacetimes with a conformal completion at timelike infinity and asymptotically constant scalar curvature, as relevant for asymptotically AdS spacetimes. This work is dedicated to Yvonne Choquet-Bruhat on the occasion of her upcoming 99th birthday.


title: Byzantines can also Learn from History: Fall of Centered Clipping in Federated Learning

abstract: The increasing popularity of the federated learning (FL) framework due to its success in a wide range of collaborative learning tasks also induces certain security concerns. Among many vulnerabilities, the risk of Byzantine attacks is of particular concern, which refers to the possibility of malicious clients participating in the learning process. Hence, a crucial objective in FL is to neutralize the potential impact of Byzantine attacks and to ensure that the final model is trustable. It has been observed that the higher the variance among the clients' models/updates, the more space there is for Byzantine attacks to be hidden. As a consequence, by utilizing momentum, and thus, reducing the variance, it is possible to weaken the strength of known Byzantine attacks. The centered clipping (CC) framework has further shown that the momentum term from the previous iteration, besides reducing the variance, can be used as a reference point to neutralize Byzantine attacks better. In this work, we first expose vulnerabilities of the CC framework, and introduce a novel attack strategy that can circumvent the defences of CC and other robust aggregators and reduce their test accuracy up to %33 on best-case scenarios in image classification tasks. Then, we propose a new robust and fast defence mechanism that is effective against the proposed and other existing Byzantine attacks.


title: Stability of the Epstein-Zin problem

abstract: We investigate the stability of the Epstein-Zin problem with respect to small distortions in the dynamics of the traded securities. We work in incomplete market model settings, where our parametrization of perturbations allows for joint distortions in returns and volatility of the risky assets and the interest rate. Considering empirically the most relevant specifications of risk aversion and elasticity of intertemporal substitution, we provide a condition that guarantees the convexity of the domain of the underlying problem and results in the existence and uniqueness of a solution to it. Then, we prove the convergence of the optimal consumption streams, the associated wealth processes, the indirect utility processes, and the value functions in the limit when the model perturbations vanish.


title: SIM2E: Benchmarking the Group Equivariant Capability of Correspondence Matching Algorithms

abstract: Correspondence matching is a fundamental problem in computer vision and robotics applications. Solving correspondence matching problems using neural networks has been on the rise recently. Rotation-equivariance and scale-equivariance are both critical in correspondence matching applications. Classical correspondence matching approaches are designed to withstand scaling and rotation transformations. However, the features extracted using convolutional neural networks (CNNs) are only translation-equivariant to a certain extent. Recently, researchers have strived to improve the rotation-equivariance of CNNs based on group theories. Sim(2) is the group of similarity transformations in the 2D plane. This paper presents a specialized dataset dedicated to evaluating sim(2)-equivariant correspondence matching algorithms. We compare the performance of 16 state-of-the-art (SoTA) correspondence matching approaches. The experimental results demonstrate the importance of group equivariant algorithms for correspondence matching on various sim(2) transformation conditions. Since the subpixel accuracy achieved by CNN-based correspondence matching approaches is unsatisfactory, this specific area requires more attention in future works. Our dataset is publicly available at: mias.group/SIM2E.


title: Multiple Descent in the Multiple Random Feature Model

abstract: Recent works have demonstrated a double descent phenomenon in over-parameterized learning. Although this phenomenon has been investigated by recent works, it has not been fully understood in theory. In this paper, we investigate the multiple descent phenomenon in a class of multi-component prediction models. We first consider a ''double random feature model'' (DRFM) concatenating two types of random features, and study the excess risk achieved by the DRFM in ridge regression. We calculate the precise limit of the excess risk under the high dimensional framework where the training sample size, the dimension of data, and the dimension of random features tend to infinity proportionally. Based on the calculation, we further theoretically demonstrate that the risk curves of DRFMs can exhibit triple descent. We then provide a thorough experimental study to verify our theory. At last, we extend our study to the ''multiple random feature model'' (MRFM), and show that MRFMs ensembling $K$ types of random features may exhibit $(K+1)$-fold descent. Our analysis points out that risk curves with a specific number of descent generally exist in learning multi-component prediction models.


title: Fair pricing and hedging under small perturbations of the num\'eraire on a finite probability space

abstract: We consider the problem of fair pricing and hedging under small perturbations of the num\'eraire. We show that for replicable claims, the change of num\'eraire affects neither the fair price nor the hedging strategy. For non-replicable claims, we demonstrate that is not the case. By reformulating the key stochastic control problem in a more tractable form, we show that both the fair price and optimal strategy are stable with respect to small perturbations of the num\'eraire. Further, our approach allows for explicit asymptotic formulas describing the fair price and hedging strategy's leading order correction terms. Mathematically, our results constitute stability and asymptotic analysis of a stochastic control problem under certain perturbations of the integrator of the controlled process, where constraints make this problem hard to analyze.


title: Adaptively restarted block Krylov subspace methods with low-synchronization skeletons

abstract: With the recent realization of exascale performace by Oak Ridge National Laboratory's Frontier supercomputer, reducing communication in kernels like QR factorization has become even more imperative. Low-synchronization Gram-Schmidt methods, first introduced in [K. \'{S}wirydowicz, J. Langou, S. Ananthan, U. Yang, and S. Thomas, Low Synchronization Gram-Schmidt and Generalized Minimum Residual Algorithms, Numer. Lin. Alg. Appl., Vol. 28(2), e2343, 2020], have been shown to improve the scalability of the Arnoldi method in high-performance distributed computing. Block versions of low-synchronization Gram-Schmidt show further potential for speeding up algorithms, as column-batching allows for maximizing cache usage with matrix-matrix operations. In this work, low-synchronization block Gram-Schmidt variants from [E. Carson, K. Lund, M. Rozlo\v{z}n\'{i}k, and S. Thomas, Block Gram-Schmidt algorithms and their stability properties, Lin. Alg. Appl., 638, pp. 150--195, 2022] are transformed into block Arnoldi variants for use in block full orthogonalization methods (BFOM) and block generalized minimal residual methods (BGMRES). An adaptive restarting heuristic is developed to handle instabilities that arise with the increasing condition number of the Krylov basis. The performance, accuracy, and stability of these methods are assessed via a flexible benchmarking tool written in MATLAB. The modularity of the tool additionally permits generalized block inner products, like the global inner product.


title: Provable Adaptivity of Adam under Non-uniform Smoothness

abstract: Adam is widely adopted in practical applications due to its fast convergence. However, its theoretical analysis is still far from satisfactory. Existing convergence analyses for Adam rely on the bounded smoothness assumption, referred to as the \emph{L-smooth condition}. Unfortunately, this assumption does not hold for many deep learning tasks. Moreover, we believe that this assumption obscures the true benefit of Adam, as the algorithm can adapt its update magnitude according to local smoothness. This important feature of Adam becomes irrelevant when assuming globally bounded smoothness. This paper studies the convergence of randomly reshuffled Adam (RR Adam) with diminishing learning rate, which is the major version of Adam adopted in deep learning tasks. We present the first convergence analysis of RR Adam without the bounded smoothness assumption. We demonstrate that RR Adam can maintain its convergence properties when smoothness is linearly bounded by the gradient norm, referred to as the \emph{$(L_0, L_1)$-smooth condition. We further compare Adam to SGD when both methods use diminishing learning rate. We refine the existing lower bound of SGD and show that SGD can be slower than Adam. To our knowledge, this is the first time that Adam and SGD are rigorously compared in the same setting and the advantage of Adam is revealed.


title: Scalable mRMR feature selection to handle high dimensional datasets: Vertical partitioning based Iterative MapReduce framework

abstract: While building machine learning models, Feature selection (FS) stands out as an essential preprocessing step used to handle the uncertainty and vagueness in the data. Recently, the minimum Redundancy and Maximum Relevance (mRMR) approach has proven to be effective in obtaining the irredundant feature subset. Owing to the generation of voluminous datasets, it is essential to design scalable solutions using distributed/parallel paradigms. MapReduce solutions are proven to be one of the best approaches to designing fault-tolerant and scalable solutions. This work analyses the existing MapReduce approaches for mRMR feature selection and identifies the limitations thereof. In the current study, we proposed VMR_mRMR, an efficient vertical partitioning-based approach using a memorization approach, thereby overcoming the extant approaches limitations. The experiment analysis says that VMR_mRMR significantly outperformed extant approaches and achieved a better computational gain (C.G). In addition, we also conducted a comparative analysis with the horizontal partitioning approach HMR_mRMR [1] to assess the strengths and limitations of the proposed approach.


title: Phase diagram of the square lattice Hubbard model with Rashba-type antisymmetric spin-orbit coupling

abstract: We clarify the ground state phase diagram of the half-filled square-lattice Hubbard model with Rashba spin-orbit coupling (SOC) characterized by the spin-split energy bands due to broken inversion symmetry. Although the Rashba metals and insulating magnets have been studied well, the intermediate interaction strength of the system remained elusive due to the lack of appropriate theoretical tools to unbiasedly describe the large-scale magnetic structures. We complementarily apply four different methods; sine square deformed mean-field theory, random phase approximation, Luttinger-Tisza method, and density matrix embedding theory, and succeed in capturing the incommensurate spin density-wave (SDW) phases with very long spatial periods which were previously overlooked. The transition to the SDW phases from the metallic phase is driven by an unprecedented instability that nests the two parts of the Fermi surface carrying opposite spins. For large SOC, the spiral, stipe, and vortex phases are obtained, when the four Dirac points exist near the Fermi level and their whole linear dispersions nest by a wavelength $\pi$, opening a band gap. These two types of transition provide Fermiology that distinguishes the antisymmetric SOC systems, generating a variety of magnetic phases that start from the relatively weak correlation regime and continue to the strongly interacting limit.


title: Dirac series of $GL(n,\mathbb{H})$

abstract: We determine the Dirac series of $GL(n,\mathbb{H})$, give the spin lowest $K$-types of the Dirac series, and show that the spin lowest $K$-type of any Dirac series is unique and multiplicity free. In addition, using the same method, we show that the spin lowest $K$-type of any Dirac series in the $GL(n,\mathbb{R})$ case is unique and multiplicity free.


title: Temperatures in Grains and Plasma

abstract: Grains are widely assumed to be characterized by a single temperature -- derived either from the configurational entropy, or employing the kinetic theory. Yet granular media do have two temperatures, $T_g$ and $T$, pertaining to the grains and atoms. It is argued here that a two-temperature plasma yields a more useful analogy for grains than a molecular gas: (1)~Irreversible collisions also occur in plasma, to reach the equilibrium of equal temperature. (2)~The plasma energy is not linear in the two temperatures; it is quadratic in the temperature difference, minimal at equilibrium. Both points have valid analogues in grains, yielding useful insights.


title: MentorGNN: Deriving Curriculum for Pre-Training GNNs

abstract: Graph pre-training strategies have been attracting a surge of attention in the graph mining community, due to their flexibility in parameterizing graph neural networks (GNNs) without any label information. The key idea lies in encoding valuable information into the backbone GNNs, by predicting the masked graph signals extracted from the input graphs. In order to balance the importance of diverse graph signals (e.g., nodes, edges, subgraphs), the existing approaches are mostly hand-engineered by introducing hyperparameters to re-weight the importance of graph signals. However, human interventions with sub-optimal hyperparameters often inject additional bias and deteriorate the generalization performance in the downstream applications. This paper addresses these limitations from a new perspective, i.e., deriving curriculum for pre-training GNNs. We propose an end-to-end model named MentorGNN that aims to supervise the pre-training process of GNNs across graphs with diverse structures and disparate feature spaces. To comprehend heterogeneous graph signals at different granularities, we propose a curriculum learning paradigm that automatically re-weighs graph signals in order to ensure a good generalization in the target domain. Moreover, we shed new light on the problem of domain adaption on relational data (i.e., graphs) by deriving a natural and interpretable upper bound on the generalization error of the pre-trained GNNs. Extensive experiments on a wealth of real graphs validate and verify the performance of MentorGNN.


title: Development of the Scintillating Fiber Timing Detector for the Mu3e Experiment

abstract: We present and discuss the development and performance of a compact scintillating fiber (SciFi) detector for timing to be used in the Mu3e experiment at very high particle rates. The SciFi detector is read out with multichannel silicon photomuiltipliers (SiPM) arrays at both ends to achieve the best timing performance. Mu3e is a new experiment under preparation at the Paul Scherrer Institute to search for charged Lepton Flavor Violation in the rare neutrinoless muon decay mu->eee using the most intense continuous surface muon beam in the world. The Mu3e detector is based on thin high-voltage monolithic active silicon pixel sensors (HV-MAPS) for very precise tracking in conjunction with scintillating fibers and scintillating tiles coupled to SiPMs for accurate timing measurements and it is designed to operate at very high intensities. In order to reach a single event sensitivity of 10^-16 for this rare mu->eee muon decay, all backgrounds must be rejected well below this level. To suppress all forms of accidental background, a very thin SciFi detector (thickness < 0.2% of a radiation length X_0) with a time resolution of 250 ps, efficiency in excess of 96%, and spatial resolution of 100 micron has been developed. In this paper we report on the development, construction, and performance of this SciFi detector. Different scintillating fiber types have been evaluated and various assembly procedures have been tested to achieve the best performance. The compact size, fast response, good timing, high spatial resolution, insensitivity to magnetic fields, and adaptable geometry make SciFi detectors suitable for a variety of applications.


title: Superfluid Dynamics, Equilibrium Conditions, and Centripetal Forces

abstract: Thermodynamics of superfluids is revisited, clarifying two points. First, the density and pressure distribution for given equilibrium velocities is obtained, with the finding that counter heat currents give rise to a pressure depression and a centripetal force. Second, it is shown that the ideal two-fluid hydro\-dynamics is simply an assembly of \textit{equilibrium conditions} -- expressions of entropy being maximal.


title: On Drinfeld modular forms of higher rank VI: The simplicial complex associated with a coefficient form

abstract: The coefficient forms \( {}_{a} \ell_{k} \) and the para-Eisenstein series \(\alpha_{k}\) are simplicial Drinfeld modular forms. We study the attached simplicial complexes \(\mathcal{BT}^{r}( {}_{a} \ell_{k})\) and \(\mathcal{BT}^{r}(\alpha_{k})\), which are full subcomplexes of the Bruhat-Tits building \(\mathcal{BT}^{r}\) of \( \mathrm{PGL}(r, K_{\infty})\). They are connected (if the rank \(r\) is larger than 2), strongly equidimensional of codimension 1 in \(\mathcal{BT}^{r}\), boundaryless, and satisfy a symmetry property under the non-trivial involution of the Dynkin diagram \(A_{r-1}\).


title: Frequency multiplication with toroidal mode number of kink/fishbone modes on a static HL-2A-like tokamak

abstract: In the presence of energetic particles (EPs), the Long-Lived Mode (LLM) frequency multiplication with n = 1,2,3 or higher is often observed on HL-2A, where n is the toroidal mode number. Hybrid kinetic-MHD model simulations of the energetic particle (EP) driven kink/fishbone modes on a static HL-2A-like tokamak using NIMROD code find that, when the background plasma pressure is relatively high, and the EP pressure and the beam energy are relatively low, the mode frequency increases almost linearly with EP pressure, and the frequency is proportional to n ("frequency multiplication"), even in absence of any equilibrium plasma rotation. In addition, the frequency multiplication persists as the safety factor at magnetic axis q0 varies. In absence of EPs, the growth rate of the 1/1 mode is the largest; however, as the EP pressure increases, the growth rate of 2/2 modes or 3/3 modes becomes dominant, suggesting that the higher-n modes are more vulnerable to EPs. These results may shed light on the understanding about the toroidal mode number dependence of kink/fishbone modes in the advanced scenarios of tokamaks with weak or reversed central magnetic shear.


title: Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentation

abstract: In this work, we revisit the weak-to-strong consistency framework, popularized by FixMatch from semi-supervised classification, where the prediction of a weakly perturbed image serves as supervision for its strongly perturbed version. Intriguingly, we observe that such a simple pipeline already achieves competitive results against recent advanced works, when transferred to our segmentation scenario. Its success heavily relies on the manual design of strong data augmentations, however, which may be limited and inadequate to explore a broader perturbation space. Motivated by this, we propose an auxiliary feature perturbation stream as a supplement, leading to an expanded perturbation space. On the other, to sufficiently probe original image-level augmentations, we present a dual-stream perturbation technique, enabling two strong views to be simultaneously guided by a common weak view. Consequently, our overall Unified Dual-Stream Perturbations approach (UniMatch) surpasses all existing methods significantly across all evaluation protocols on the Pascal, Cityscapes, and COCO benchmarks. Its superiority is also demonstrated in remote sensing interpretation and medical image analysis. We hope our reproduced FixMatch and our results can inspire more future works. Code and logs are available at https://github.com/LiheYoung/UniMatch.


title: Classification of hyperbolic Dehn fillings

abstract: Let $M$ be a $2$-cusped hyperbolic $3$-manifold. By the work of Thurston, the product of the derivatives of the holonomies of core geodesics of each Dehn filling of $M$ is an invariant of it. In this paper, we classify Dehn fillings of $M$ with sufficiently large coefficients using this invariant. Further, for any given two Dehn fillings of $M$ (with sufficiently larger coefficients), if their aforementioned invariants are the same, it is shown their complex volumes are the same as well.


title: A Syntax Aware BERT for Identifying Well-Formed Queries in a Curriculum Framework

abstract: A well formed query is defined as a query which is formulated in the manner of an inquiry, and with correct interrogatives, spelling and grammar. While identifying well formed queries is an important task, few works have attempted to address it. In this paper we propose transformer based language model - Bidirectional Encoder Representations from Transformers (BERT) to this task. We further imbibe BERT with parts-of-speech information inspired from earlier works. Furthermore, we also train the model in multiple curriculum settings for improvement in performance. Curriculum Learning over the task is experimented with Baby Steps and One Pass techniques. Proposed architecture performs exceedingly well on the task. The best approach achieves accuracy of 83.93%, outperforming previous state-of-the-art at 75.0% and reaching close to the approximate human upper bound of 88.4%.


title: A Unified Analysis of Mixed Sample Data Augmentation: A Loss Function Perspective

abstract: We propose the first unified theoretical analysis of mixed sample data augmentation (MSDA), such as Mixup and CutMix. Our theoretical results show that regardless of the choice of the mixing strategy, MSDA behaves as a pixel-level regularization of the underlying training loss and a regularization of the first layer parameters. Similarly, our theoretical results support that the MSDA training strategy can improve adversarial robustness and generalization compared to the vanilla training strategy. Using the theoretical results, we provide a high-level understanding of how different design choices of MSDA work differently. For example, we show that the most popular MSDA methods, Mixup and CutMix, behave differently, e.g., CutMix regularizes the input gradients by pixel distances, while Mixup regularizes the input gradients regardless of pixel distances. Our theoretical results also show that the optimal MSDA strategy depends on tasks, datasets, or model parameters. From these observations, we propose generalized MSDAs, a Hybrid version of Mixup and CutMix (HMix) and Gaussian Mixup (GMix), simple extensions of Mixup and CutMix. Our implementation can leverage the advantages of Mixup and CutMix, while our implementation is very efficient, and the computation cost is almost neglectable as Mixup and CutMix. Our empirical study shows that our HMix and GMix outperform the previous state-of-the-art MSDA methods in CIFAR-100 and ImageNet classification tasks. Source code is available at https://github.com/naver-ai/hmix-gmix


title: An Implementation of the Quantum Verification of Matrix Products Algorithm

abstract: We present a space-efficient implementation of the quantum verification of matrix products (QVMP) algorithm and demonstrate its functionality by running it on the Aer simulator with two simulation methods: statevector and matrix product state (MPS). We report circuit metrics (gate count, qubit count, circuit depth), transpilation time, simulation time, and a proof of Grover oracle correctness. Our study concludes that while QVMP can be simulated on moderately sized inputs, it cannot scale to a degree where we can observe any quantum advantage on current quantum hardware due to circuit depth and qubit count constraints. Further, the choice of simulation method has a noticeable impact on the size of the transpiled circuit which slows down development.


title: MockingBERT: A Method for Retroactively Adding Resilience to NLP Models

abstract: Protecting NLP models against misspellings whether accidental or adversarial has been the object of research interest for the past few years. Existing remediations have typically either compromised accuracy or required full model re-training with each new class of attacks. We propose a novel method of retroactively adding resilience to misspellings to transformer-based NLP models. This robustness can be achieved without the need for re-training of the original NLP model and with only a minimal loss of language understanding performance on inputs without misspellings. Additionally we propose a new efficient approximate method of generating adversarial misspellings, which significantly reduces the cost needed to evaluate a model's resilience to adversarial attacks.


title: A Web Application for Experimenting and Validating Remote Measurement of Vital Signs

abstract: With a surge in online medical advising remote monitoring of patient vitals is required. This can be facilitated with the Remote Photoplethysmography (rPPG) techniques that compute vital signs from facial videos. It involves processing video frames to obtain skin pixels, extracting the cardiac data from it and applying signal processing filters to extract the Blood Volume Pulse (BVP) signal. Different algorithms are applied to the BVP signal to estimate the various vital signs. We implemented a web application framework to measure a person's Heart Rate (HR), Heart Rate Variability (HRV), Oxygen Saturation (SpO2), Respiration Rate (RR), Blood Pressure (BP), and stress from the face video. The rPPG technique is highly sensitive to illumination and motion variation. The web application guides the users to reduce the noise due to these variations and thereby yield a cleaner BVP signal. The accuracy and robustness of the framework was validated with the help of volunteers.


title: Semileptonic baryonic $B$ decays

abstract: We study the semileptonic $B\to{\bf B\bar B'}L\bar L'$ decays with $\bf B\bar B'$ ($L\bar L'$) representing a baryon (lepton) pair. Using the new determination of the $B\to{\bf B\bar B'}$ transition form factors, we obtain ${\cal B}(B^-\to p\bar p \mu^-\bar \nu_\mu) =(5.4\pm 2.0)\times 10^{-6}$ agreeing with the current data. Besides, ${\cal B}(B^-\to \Lambda\bar p \nu \bar \nu)=(3.5\pm 1.0)\times 10^{-8}$ is calculated to be 20 times smaller than the previous prediction. In particular, we predict ${\cal B}(\bar B^0_s\to p\bar \Lambda e^- \bar \nu_e,p\bar \Lambda \mu^- \bar \nu_\mu,p\bar \Lambda \tau^- \bar \nu_\tau) =(2.1\pm 0.6,2.1\pm 0.6,1.7\pm 1.0)\times 10^{-6}$ and ${\cal B}(\bar B^0_s\to \Lambda\bar \Lambda \nu\bar \nu)=(0.8\pm 0.2)\times 10^{-8}$, which can be accessible to the LHCb experiment.


title: Discrete group actions on 3-manifolds and embeddable Cayley complexes

abstract: We prove that a group $\Gamma$ admits a discrete topological (equivalently, smooth) action on some simply-connected 3-manifold if and only if $\Gamma$ has a Cayley complex embeddable -- with certain natural restrictions -- in one of the following four 3-manifolds: (i) $\mathbb{S}^3$, (ii) $\mathbb{R}^3$, (iii) $\mathbb{S}^2 \times \mathbb{R}$, (iv) the complement of a tame Cantor set in $\mathbb{S}^3$.


title: Large And Moderate Deviation For Multivalued Mckean Vlasov Stochastic Differential Equation

abstract: In this paper, we present sufficient conditions and criteria to establish the large and moderate deviation principle of multivalued McKean-Vlasov stochastic differential equation by means of the weak convergence method.


title: On the question of quark confinement in the Abelian U(1) QED gauge interaction

abstract: If we approximate light quarks as massless and apply the Schwinger confinement mechanism to light quarks, we will reach the conclusion that a light quark $q$ and its antiquark $\bar q$ will be confined as a $q\bar q$ boson in the Abelian U(1) QED gauge interaction in (1+1)D, as in an open string. From the work of Coleman, Jackiw, and Susskind, we can infer further that the Schwinger confinement mechanism persists even for massive quarks in (1+1)D. Could such a QED-confined $q\bar q$ one-dimensional open string in (1+1)D be the idealization of a flux tube in the physical world in (3+1)D, similar to the case of QCD-confined $q\bar q$ open string? If so, the QED-confined $q\bar q$ bosons may show up as neutral QED mesons in the mass region of many tens of MeV (PRC81(2010)064903 & JHEP2020(8)165). Is it ever possible that a quark and an antiquark be produced and interact in QED alone to form a confined QED meson? Is there any experimental evidence for the existence of a QED meson (or QED mesons)? The observations of the anomalous soft photons, the X17 particle, and the E38 particle suggest that they may bear the experimental evidence for the existence of such QED mesons. Further confirmation and investigations on the X17 and E38 particles will shed definitive light on the question of quark confinement in QED in (3+1)D. Implications of quark confinement in the QED interaction are discussed.


title: Alexa, Predict My Flight Delay

abstract: Airlines are critical today for carrying people and commodities on time. Any delay in the schedule of these planes can potentially disrupt the business and trade of thousands of employees at any given time. Therefore, precise flight delay prediction is beneficial for the aviation industry and passenger travel. Recent research has focused on using artificial intelligence algorithms to predict the possibility of flight delays. Earlier prediction algorithms were designed for a specific air route or airfield. Many present flight delay prediction algorithms rely on tiny samples and are challenging to understand, allowing almost no room for machine learning implementation. This research study develops a flight delay prediction system by analyzing data from domestic flights inside the United States of America. The proposed models learn about the factors that cause flight delays and cancellations and the link between departure and arrival delays.


title: Efficient Concentration with Gaussian Approximation

abstract: Concentration inequalities for the sample mean, like those due to Bernstein and Hoeffding, are valid for any sample size but overly conservative, yielding confidence intervals that are unnecessarily wide. The central limit theorem (CLT) provides asymptotic confidence intervals with optimal width, but these are invalid for all sample sizes. To resolve this tension, we develop new computable concentration inequalities with asymptotically optimal size, finite-sample validity, and sub-Gaussian decay. These bounds enable the construction of efficient confidence intervals with correct coverage for any sample size and efficient empirical Berry-Esseen bounds that require no prior knowledge of the population variance. We derive our inequalities by tightly bounding non-uniform Kolmogorov and Wasserstein distances to a Gaussian using zero-bias couplings and Stein's method of exchangeable pairs.


title: Search for extended sources in the images from Chandra X-ray Observatory Advanced CCD Imaging Spectrometer

abstract: We present a convenient tool (ChaSES) which allows to search for extended structures in Chandra X-ray Observatory Advanced CCD Imaging Spectrometer (ACIS) images. The tool relies on DBSCAN clustering algorithm to detect regions with overdensity of photons compared to the background. Here we describe the design and functionality of the tool which we make publicly available on GitHub. We also provide online extensive examples of its applications to the real data.


title: Estimating the concentration of chiral media with bright squeezed light

abstract: The concentration of a chiral solution is a key parameter in many scientific fields and industrial processes. This parameter can be estimated to high precision by exploiting circular birefringence or circular dichroism present in optically active media. Using the Quantum Fisher information formalism, we quantify the performance of Gaussian probes in estimating the concentration of chiral analytes. We find that bright-polarization squeezed state probes provide a quantum advantage over equally bright classical strategies that scales exponentially with the squeezing factor for a circularly birefringent sample. Four-fold precision enhancement is achievable using state-of-the-art squeezing levels and intensity measurements.


title: On optimal prediction of missing functional data with memory

abstract: This paper considers the problem of reconstructing missing parts of functions based on their observed segments. It provides, for Gaussian processes and arbitrary bijective transformations thereof, theoretical expressions for the $L^2$-optimal reconstruction of the missing parts. These functions are obtained as solutions of explicit integral equations. In the discrete case, approximations of the solutions provide consistent expressions of all missing values of the processes. Rates of convergence of these approximations, under extra assumptions on the transformation function, are provided. In the case of Gaussian processes with a parametric covariance structure, the estimation can be conducted separately for each function, and yields nonlinear solutions in presence of memory. Simulated examples show that the proposed reconstruction indeed fares better than the conventional interpolation methods in various situations.


title: A semi-supervised Teacher-Student framework for surgical tool detection and localization

abstract: Surgical tool detection in minimally invasive surgery is an essential part of computer-assisted interventions. Current approaches are mostly based on supervised methods which require large fully labeled data to train supervised models and suffer from pseudo label bias because of class imbalance issues. However large image datasets with bounding box annotations are often scarcely available. Semi-supervised learning (SSL) has recently emerged as a means for training large models using only a modest amount of annotated data; apart from reducing the annotation cost. SSL has also shown promise to produce models that are more robust and generalizable. Therefore, in this paper we introduce a semi-supervised learning (SSL) framework in surgical tool detection paradigm which aims to mitigate the scarcity of training data and the data imbalance through a knowledge distillation approach. In the proposed work, we train a model with labeled data which initialises the Teacher-Student joint learning, where the Student is trained on Teacher-generated pseudo labels from unlabeled data. We propose a multi-class distance with a margin based classification loss function in the region-of-interest head of the detector to effectively segregate foreground classes from background region. Our results on m2cai16-tool-locations dataset indicate the superiority of our approach on different supervised data settings (1%, 2%, 5%, 10% of annotated data) where our model achieves overall improvements of 8%, 12% and 27% in mAP (on 1% labeled data) over the state-of-the-art SSL methods and a fully supervised baseline, respectively. The code is available at https://github.com/Mansoor-at/Semi-supervised-surgical-tool-det


title: Sparsification of Large Ultrametric Matrices: Insights into the Microbial Tree of Life

abstract: Ultrametric matrices have a rich structure that is not apparent from their definition. Notably, the subclass of strictly ultrametric matrices are covariance matrices of certain weighted rooted binary trees. In applications, these matrices can be large and dense, making them difficult to store and handle. In this manuscript, we exploit the underlying tree structure of these matrices to sparsify them via a similarity transformation based on Haar-like wavelets. We show that, with overwhelmingly high probability, only an asymptotically negligible fraction of the off-diagonal entries in random but large strictly ultrametric matrices remain non-zero after the transformation; and develop a fast algorithm to compress such matrices directly from their tree representation. We also identify the subclass of matrices diagonalized by the wavelets and supply a sufficient condition to approximate the spectrum of strictly ultrametric matrices outside this subclass. Our methods give computational access to a covariance model of the microbiologists' Tree of Life, which was previously inaccessible due to its size, and motivate defining a new but wavelet-based phylogenetic $\beta$-diversity metric. Applying this metric to a metagenomic dataset demonstrates that it can provide novel insight into noisy high-dimensional samples and localize speciation events that may be most important in determining relationships between environmental factors and microbial composition.

categories: math.NA cs.DM cs.NA q-bio.GN q-bio.PE q-bio.QM


title: Variations of Central Limit Theorems and Stirling numbers of the First Kind

abstract: We construct a new parametrization of double sequences $\{A_{n,k}(s)\}_{n,k}$ between $A_{n,k}(0)= \binom{n-1}{k-1}$ and $A_{n,k}(1)= \frac{1}{n!}\stirl{n}{k}$, where $\stirl{n}{k}$ are the unsigned Stirling numbers of the first kind. For each $s$ we prove a central limit theorem and a local limit theorem. This extends the de\,Moivre--Laplace central limit theorem and Goncharov's result, that unsigned Stirling numbers of the first kind are asymptotically normal. Herewith, we provide several applications.


title: A Survey of Augmented Piano Prototypes: Has Augmentation Improved Learning Experiences?

abstract: Humans have been developing and playing musical instruments for millennia. With technological advancements, instruments were becoming ever more sophisticated. In recent decades computer-supported innovations have also been introduced in hardware design, usability, and aesthetics. One of the most commonly digitally augmented instruments is the piano. Besides electronic keyboards, several prototypes augmenting pianos with different projections providing various levels of interactivity on and around the keyboard have been implemented in order to support piano players. However, it is still not understood if these solutions are indeed supporting the learning process. In this paper we present a systematic review of augmented piano prototypes focusing on instrument learning, which is based on the four themes derived from interviews of piano experts to better understand the problems of teaching the piano. These themes are: (i) synchronised movement and body posture, (ii) sight-reading, (iii) ensuring motivation, and (iv) encouraging improvisation. We found that prototypes are saturated on the synchronisation themes, and there are opportunities for sight-reading, motivation, and improvisation themes. We conclude by presenting recommendations on augmenting piano systems towards enriching the piano learning experience as well as on possible directions to expand knowledge in the area.


title: Kupczynski's Contextual Locally Causal Probabilistic Models are constrained by Bell's theorem

abstract: In a sequence of papers, Marian Kupczynski has argued that Bell's theorem can be circumvented if one takes correct account of contextual setting-dependent parameters describing measuring instruments. We show that this is not true. Despite first appearances, Kupczynksi's concept of a contextual locally causal probabilistic model is mathematically a special case of a Bell local hidden variables model. Thus, even if one takes account of contextuality in the way he suggests, the Bell-CHSH inequality can still be derived. Violation thereof by quantum mechanics cannot be easily explained away: quantum mechanics and local realism (including Kupczynski's claimed enlargement of the concept) are not compatible with one another. Further inspection shows that Kupczynski is actually falling back on the detection loophole. Since 2015, numerous loophole-free experiments have been performed, in which the Bell-CHSH inequality is violated, so despite any other possible imperfections of such experiments, Kupczynski's escape route for local realism is not available


title: ProPaLL: Probabilistic Partial Label Learning

abstract: Partial label learning is a type of weakly supervised learning, where each training instance corresponds to a set of candidate labels, among which only one is true. In this paper, we introduce ProPaLL, a novel probabilistic approach to this problem, which has at least three advantages compared to the existing approaches: it simplifies the training process, improves performance, and can be applied to any deep architecture. Experiments conducted on artificial and real-world datasets indicate that ProPaLL outperforms the existing approaches.


title: Improving GANs for Long-Tailed Data through Group Spectral Regularization

abstract: Deep long-tailed learning aims to train useful deep networks on practical, real-world imbalanced distributions, wherein most labels of the tail classes are associated with a few samples. There has been a large body of work to train discriminative models for visual recognition on long-tailed distribution. In contrast, we aim to train conditional Generative Adversarial Networks, a class of image generation models on long-tailed distributions. We find that similar to recognition, state-of-the-art methods for image generation also suffer from performance degradation on tail classes. The performance degradation is mainly due to class-specific mode collapse for tail classes, which we observe to be correlated with the spectral explosion of the conditioning parameter matrix. We propose a novel group Spectral Regularizer (gSR) that prevents the spectral explosion alleviating mode collapse, which results in diverse and plausible image generation even for tail classes. We find that gSR effectively combines with existing augmentation and regularization techniques, leading to state-of-the-art image generation performance on long-tailed data. Extensive experiments demonstrate the efficacy of our regularizer on long-tailed datasets with different degrees of imbalance.


title: AA-Forecast: Anomaly-Aware Forecast for Extreme Events

abstract: Time series models often deal with extreme events and anomalies, both prevalent in real-world datasets. Such models often need to provide careful probabilistic forecasting, which is vital in risk management for extreme events such as hurricanes and pandemics. However, it is challenging to automatically detect and learn to use extreme events and anomalies for large-scale datasets, which often require manual effort. Hence, we propose an anomaly-aware forecast framework that leverages the previously seen effects of anomalies to improve its prediction accuracy during and after the presence of extreme events. Specifically, the framework automatically extracts anomalies and incorporates them through an attention mechanism to increase its accuracy for future extreme events. Moreover, the framework employs a dynamic uncertainty optimization algorithm that reduces the uncertainty of forecasts in an online manner. The proposed framework demonstrated consistent superior accuracy with less uncertainty on three datasets with different varieties of anomalies over the current prediction models.


title: A Graphical Model for Fusing Diverse Microbiome Data

abstract: This paper develops a Bayesian graphical model for fusing disparate types of count data. The motivating application is the study of bacterial communities from diverse high dimensional features, in this case transcripts, collected from different treatments. In such datasets, there are no explicit correspondences between the communities and each correspond to different factors, making data fusion challenging. We introduce a flexible multinomial-Gaussian generative model for jointly modeling such count data. This latent variable model jointly characterizes the observed data through a common multivariate Gaussian latent space that parameterizes the set of multinomial probabilities of the transcriptome counts. The covariance matrix of the latent variables induces a covariance matrix of co-dependencies between all the transcripts, effectively fusing multiple data sources. We present a computationally scalable variational Expectation-Maximization (EM) algorithm for inferring the latent variables and the parameters of the model. The inferred latent variables provide a common dimensionality reduction for visualizing the data and the inferred parameters provide a predictive posterior distribution. In addition to simulation studies that demonstrate the variational EM procedure, we apply our model to a bacterial microbiome dataset.


title: Ring Structure of Integer-Valued Rational Functions

abstract: $\DeclareMathOperator{\IntR}{Int{}^\text{R}}$Integer-valued rational functions are a natural generalization of integer-valued polynomials. Given a domain $D$, the collection of all integer-valued rational functions over $D$ forms a ring extension $\IntR(D)$ of $D$. For a valuation domain $V$, we characterize when $\IntR(V)$ is a Pr\"ufer domain and when $\IntR(V)$ is a B\'ezout domain. We also extend the classification of when $\IntR(D)$ is a Pr\"ufer domain.


title: Repetitive transcranial magnetic stimulation and epilepsy: A brief essay

abstract: During the last three decades, many studies have been conducted in the field of treatment with non-invasive methods. In this way, researchers try to use alternative methods including the use of electromagnetic waves in the treatment of diseases. As a result, the therapeutic use of electromagnetic waves in the treatment of neurological diseases has made significant progress. Among the various techniques that have revolutionized the non-invasive treatment of neurological disorders, there is a remarkable technique called Repetitive Transcranial Magnetic Stimulation (rTMS). On the other hand, there is a wide range of neurological conditions (like epilepsy) that are somewhat drug-resistant or can only be controlled with high-risk treatments. In this article, the effect of rTMS on epilepsy is investigated.


title: An Incentive-Compatible Mechanism for Decentralized Storage Network

abstract: The dominance of a few big companies in the storage market arising various concerns including single point of failure, privacy violation, and oligopoly. To eliminate the dependency on such a centralized storage architecture, several Decentralized Storage Network (DSN) schemes such as Filecoin, Sia, and Storj have been introduced. DSNs leverage blockchain technology to create a storage platform such that the micro storage providers can also participate in the storage market. To verify the accurate data storage by the storage providers during a storage contract, DSNs apply a Proof of Storage (PoS) scheme to continuously inspect the storage service. However, continuous verification of the storage provider imposes an extra cost to the network and therefore end-users. Moreover, DSN's PoS verification is vulnerable to a service denying attack in which the storage provider submits valid PoS to the network while denying the service to the client. Considering the benefits and existing challenges of DSNs, this paper introduces a novel incentive-compatible DSN scheme. In this scheme, the PoS is conducted only if the client submits a challenge request. We model the storage service as a repeated dynamic game and set the players' payoffs such that the storage provider's dominant strategy is to honestly follow the storage contract. Our proposed mechanism leverages the smart-contract and oracle network to govern the storage agreement between the client and storage provider efficiently. Furthermore, our scheme is independent of a specific blockchain platform but can be plugged into any blockchain platform with smart-contract execution capability. As a proof of concept, we have implemented our scheme using solidity language and chainlink oracle network. The performance analysis demonstrates the applicability of our scheme.


title: Instability and Local Minima in GAN Training with Kernel Discriminators

abstract: Generative Adversarial Networks (GANs) are a widely-used tool for generative modeling of complex data. Despite their empirical success, the training of GANs is not fully understood due to the min-max optimization of the generator and discriminator. This paper analyzes these joint dynamics when the true samples, as well as the generated samples, are discrete, finite sets, and the discriminator is kernel-based. A simple yet expressive framework for analyzing training called the $\textit{Isolated Points Model}$ is introduced. In the proposed model, the distance between true samples greatly exceeds the kernel width, so each generated point is influenced by at most one true point. Our model enables precise characterization of the conditions for convergence, both to good and bad minima. In particular, the analysis explains two common failure modes: (i) an approximate mode collapse and (ii) divergence. Numerical simulations are provided that predictably replicate these behaviors.


title: The minimal number of critical points of a smooth function on a closed manifold and the ball category

abstract: Introduced by Seifert and Threlfall, cylindrical neighborhoods of isolated critical points of smooth functions is an essential tool in the Lusternik- Schnirelmann theory. We conjecture that every isolated critical point of a smooth function admits a cylindrical ball neighborhood. We show that the conjecture is true for cone-like critical points, Cornea reasonable critical points, and critical points that satisfy the Rothe H hypothesis. In particular, the conjecture holds true at least for those critical points that are not infinitely degenerate. If, contrary to the assertion of the conjecture, there are isolated critical points that do not admit cylindrical ball neighborhoods, then we say that such critical points are exotic. We prove a Lusternik-Schnirelmann type theorem asserting that the minimal number of critical points of smooth functions without exotic critical points on a closed manifold of dimension at least 6 is the same as the minimal number of elements in a Singhof-Takens filling of M by smooth balls with corners.


title: Efficient numerical method for reliable upper and lower bounds on homogenized parameters

abstract: A numerical procedure providing guaranteed two-sided bounds on the effective coefficients of elliptic partial differential operators is presented. The upper bounds are obtained in a standard manner through the variational formulation of the problem and by applying the finite element method. To obtain the lower bounds we formulate the dual variational problem and introduce appropriate approximation spaces employing the finite element method as well. We deal with the 3D setting, which has been rarely considered in the literature so far. The theoretical justification of the procedure is presented and supported with illustrative examples.


title: Why So Inflammatory? Explainability in Automatic Detection of Inflammatory Social Media Users

abstract: Hate speech and misinformation, spread over social networking services (SNS) such as Facebook and Twitter, have inflamed ethnic and political violence in countries across the globe. We argue that there is limited research on this problem within the context of the Global South and present an approach for tackling them. Prior works have shown how machine learning models built with user-level interaction features can effectively identify users who spread inflammatory content. While this technique is beneficial in low-resource language settings where linguistic resources such as ground truth data and processing capabilities are lacking, it is still unclear how these interaction features contribute to model performance. In this work, we investigate and show significant differences in interaction features between users who spread inflammatory content and others who do not, applying explainability tools to understand our trained model. We find that features with higher interaction significance (such as account age and activity count) show higher explanatory power than features with lower interaction significance (such as name length and if the user has a location on their bio). Our work extends research directions that aim to understand the nature of inflammatory content in low-resource, high-risk contexts as the growth of social media use in the Global South outstrips moderation efforts.


title: SeNMFk-SPLIT: Large Corpora Topic Modeling by Semantic Non-negative Matrix Factorization with Automatic Model Selection

abstract: As the amount of text data continues to grow, topic modeling is serving an important role in understanding the content hidden by the overwhelming quantity of documents. One popular topic modeling approach is non-negative matrix factorization (NMF), an unsupervised machine learning (ML) method. Recently, Semantic NMF with automatic model selection (SeNMFk) has been proposed as a modification to NMF. In addition to heuristically estimating the number of topics, SeNMFk also incorporates the semantic structure of the text. This is performed by jointly factorizing the term frequency-inverse document frequency (TF-IDF) matrix with the co-occurrence/word-context matrix, the values of which represent the number of times two words co-occur in a predetermined window of the text. In this paper, we introduce a novel distributed method, SeNMFk-SPLIT, for semantic topic extraction suitable for large corpora. Contrary to SeNMFk, our method enables the joint factorization of large documents by decomposing the word-context and term-document matrices separately. We demonstrate the capability of SeNMFk-SPLIT by applying it to the entire artificial intelligence (AI) and ML scientific literature uploaded on arXiv.


title: Regular ideals, ideal intersections, and quotients

abstract: Let $B \subseteq A$ be an inclusion of C$^*$-algebras. We study the relationship between the regular ideals of $B$ and regular ideals of $A$. We show that if $B \subseteq A$ is a regular C$^*$-inclusion and there is a faithful invariant conditional expectation from $A$ onto $B$, then there is an isomorphism between the lattice of regular ideals of $A$ and invariant regular ideals of $B$. We study properties of inclusions preserved under quotients by regular ideals. This includes showing that if $D \subseteq A$ is a Cartan inclusion and $J$ is a regular ideal in $A$, then $D/(J\cap D)$ is a Cartan subalgebra of $A/J$. We provide a description of regular ideals in reduced crossed products $A \rtimes_r \Gamma$.


title: MolGraph: a Python package for the implementation of molecular graphs and graph neural networks with TensorFlow and Keras

abstract: Molecular machine learning (ML) has proven important for tackling various molecular problems, such as predicting molecular properties based on molecular descriptors or fingerprints. Since relatively recently, graph neural network (GNN) algorithms have been implemented for molecular ML, showing comparable or superior performance to descriptor or fingerprint-based approaches. Although various tools and packages exist to apply GNNs in molecular ML, a new GNN package, named MolGraph, was developed in this work with the motivation to create GNN model pipelines highly compatible with the TensorFlow and Keras application programming interface (API). MolGraph also implements a chemistry module to accommodate the generation of small molecular graphs, which can be passed to a GNN algorithm to solve a molecular ML problem. To validate the GNNs, they were benchmarked against the datasets of MoleculeNet, as well as three chromatographic retention time datasets. The results on these benchmarks illustrate that the GNNs performed as expected. Additionally, the GNNs proved useful for molecular identification and improved interpretability of chromatographic retention time data. MolGraph is available at https://github.com/akensert/molgraph. Installation, tutorials and implementation details can be found at https://molgraph.readthedocs.io/en/latest/.


title: On regression analysis with Pad\'e approximants

abstract: The advantages and difficulties of application of Pad\'e approximants to two-dimensional regression analysis are discussed. New formulation of residuals is suggested in the method of least squares. It leads to a system of linear equations in case of rational functions. The possibility of using Tikhonov regularization technique to avoid overfitting is demonstrated in this approach. To illustrate the efficiency of the suggested method, several practical cases from physics and reliability theory are considered.


title: Tense logic based on finite orthomodular posets

abstract: It is widely accepted that the logic of quantum mechanics is based on orthomodular posets. However, such a logic is not dynamic in the sense that it does not incorporate time dimension. To fill this gap, we introduce certain tense operators on such a logic in an inexact way, but still satisfying requirements asked on tense operators in the classical logic based on Boolean algebras or in various non-classical logics. Our construction of tense operators works perfectly when the orthomodular poset in question is finite. We investigate the behaviour of these tense operators, e.g. we show that some of them form a dynamic pair. Moreover, we prove that if the tense operators preserve one of the inexact connectives conjunction or implication as defined by the authors recently in another paper, then they also preserve the other one. Finally, we show how to construct the binary relation of time preference on a given time set provided the tense operators are given, up to equivalence induced by natural quasiorders.


title: Enhanced magnetoresistance in perpendicular magnetic tunneling junctions with MgAl2O4 barrier

abstract: Perpendicular magnetic tunnel junction with MgAl2O4 barrier is investigated. It is found that reactive RF sputtering with O2 is essential to obtain strong perpendicular magnetic anisotropy and large tunneling magnetoresistance in MgAl2O4-based junctions. An interfacial perpendicular magnetic anisotropy energy density of 2.25 mJ/m2 is obtained for the samples annealed at 400C. An enhanced magnetoresistance of 60% has also been achieved. The Vhalf, bias voltage at which tunneling magnetoresistance drops to half of the zero-bias value, is found to be about 1V, which is substantially higher than that of MgO-based junctions.