title: Gaia Data Release 3: Stellar multiplicity, a teaser for the hidden treasure

abstract: The Gaia DR3 Catalogue contains for the first time about eight hundred thousand solutions with either orbital elements or trend parameters for astrometric, spectroscopic and eclipsing binaries, and combinations of them. This paper aims to illustrate the huge potential of this large non-single star catalogue. Using the orbital solutions together with models of the binaries, a catalogue of tens of thousands of stellar masses, or lower limits, partly together with consistent flux ratios, has been built. Properties concerning the completeness of the binary catalogues are discussed, statistical features of the orbital elements are explained and a comparison with other catalogues is performed. Illustrative applications are proposed for binaries across the H-R diagram. The binarity is studied in the RGB/AGB and a search for genuine SB1 among long-period variables is performed. The discovery of new EL CVn systems illustrates the potential of combining variability and binarity catalogues. Potential compact object companions are presented, mainly white dwarf companions or double degenerates, but one candidate neutron star is also presented. Towards the bottom of the main sequence, the orbits of previously-suspected binary ultracool dwarfs are determined and new candidate binaries are discovered. The long awaited contribution of Gaia to the analysis of the substellar regime shows the brown dwarf desert around solar-type stars using true, rather than minimum, masses, and provides new important constraints on the occurrence rates of substellar companions to M dwarfs. Several dozen new exoplanets are proposed, including two with validated orbital solutions and one super-Jupiter orbiting a white dwarf, all being candidates requiring confirmation. Beside binarity, higher order multiple systems are also found.

categories: astro-ph.SR astro-ph.EP astro-ph.GA astro-ph.IM


title: Neural Network-based Flight Control Systems: Present and Future

abstract: As the first review in this field, this paper presents an in-depth mathematical view of Intelligent Flight Control Systems (IFCSs), particularly those based on artificial neural networks. The rapid evolution of IFCSs in the last two decades in both the methodological and technical aspects necessitates a comprehensive view of them to better demonstrate the current stage and the crucial remaining steps towards developing a truly intelligent flight management unit. To this end, in this paper, we will provide a detailed mathematical view of Neural Network (NN)-based flight control systems and the challenging problems that still remain. The paper will cover both the model-based and model-free IFCSs. The model-based methods consist of the basic feedback error learning scheme, the pseudocontrol strategy, and the neural backstepping method. Besides, different approaches to analyze the closed-loop stability in IFCSs, their requirements, and their limitations will be discussed in detail. Various supplementary features, which can be integrated with a basic IFCS such as the fault-tolerance capability, the consideration of system constraints, and the combination of NNs with other robust and adaptive elements like disturbance observers, would be covered, as well. On the other hand, concerning model-free flight controllers, both the indirect and direct adaptive control systems including indirect adaptive control using NN-based system identification, the approximate dynamic programming using NN, and the reinforcement learning-based adaptive optimal control will be carefully addressed. Finally, by demonstrating a well-organized view of the current stage in the development of IFCSs, the challenging issues, which are critical to be addressed in the future, are thoroughly identified.


title: Lower Bounds for Sorting 16, 17, and 18 Elements

abstract: It is a long-standing open question to determine the minimum number of comparisons $S(n)$ that suffice to sort an array of $n$ elements. Indeed, before this work $S(n)$ has been known only for $n\leq 22$ with the exception for $n=16$, $17$, and $18$. In this work, we fill that gap by proving that sorting $n=16$, $17$, and $18$ elements requires $46$, $50$, and $54$ comparisons respectively. This fully determines $S(n)$ for these values and disproves a conjecture by Knuth that $S(16) = 45$. Moreover, we show that for sorting $28$ elements at least 99 comparisons are needed. We obtain our result via an exhaustive computer search which extends previous work by Wells (1965) and Peczarski (2002, 2004, 2007, 2012). Our progress is both based on advances in hardware and on novel algorithmic ideas such as applying a bidirectional search to this problem.


title: Convex Quantization Preserves Logconcavity

abstract: A logconcave likelihood is as important to proper statistical inference as a convex cost function is important to variational optimization. Quantization is often disregarded when writing likelihood models, ignoring the limitations of the physical detectors used to collect the data. These two facts call for the question: would including quantization in likelihood models preclude logconcavity? are the true data likelihoods logconcave? We provide a general proof that the same simple assumption that leads to logconcave continuous-data likelihoods also leads to logconcave quantized-data likelihoods, provided that convex quantization regions are used.


title: Non-Abelian topological superconductivity in maximally twisted double-layer spin-triplet valley-singlet superconductors

abstract: Recent theoretical and experimental studies point to a novel spin-triplet valley-singlet (STVS) superconducting phase in certain two-valley electron liquids, including rhombohedral trilayer graphene, Bernal bilayer graphene and ZrNCl. This fully gapped phase is exotic in that it combines into Cooper pairs same-spin electrons from valleys centered around the opposing corners of a hexagonal Brillouin zone, but is, nevertheless, topologically trivial. Here, we predict that upon stacking two layers of an STVS material with an angular twist, a novel chiral topological phase -- an $f \pm if'$-wave superconductor -- emerges in the vicinity of the `maximal' twist angle of 30$^{\circ}$ where the system becomes an extrinsic quasi-crystal with 12-fold tiling. The resulting composite is a non-Abelian topological superconductor (TSC) with an odd number of chiral Majorana modes at its edges and a single Majorana zero mode (MZM) localized in the vortex core. Through symmetry analysis and detailed microscopic modelling based on a novel quasi-crystal band structure technique, we demonstrate that the non-Abelian TSC forms when the isolated Fermi pockets coalesce into a single connected Fermi surface around the center of the moir\'{e} Brillouin zone and is stable over a wide range of electron density. We further discuss how the energetics leading to the $f \pm if'$-wave phase results in anomalous $\pi$-periodic inter-layer Josephson effect, which can serve as a distinctive signature of the chiral phase. Distinct from the valley-preserving moir\'{e} physics in small-angle twisted graphene, our results establish the large-angle moir\'{e} physics arising near maximal twist as a new avenue toward intrinsic TSC with non-Abelian excitations.


title: Narratives: the Unforeseen Influencer of Privacy Concerns

abstract: Privacy requirements are increasingly growing in importance as new privacy regulations are enacted. To adequately manage privacy requirements, organizations not only need to comply with privacy regulations, but also consider user privacy concerns. In this exploratory study, we used Reddit as a source to understand users' privacy concerns regarding software applications. We collected 4.5 million posts from Reddit and classified 129075 privacy related posts, which is a non-negligible number of privacy discussions. Next, we clustered these posts and identified 9 main areas of privacy concerns. We use the concept of narratives from economics (i.e., posts that can go viral) to explain the phenomenon of what and when users change in their discussion of privacy. We further found that privacy discussions change over time and privacy regulatory events have a short term impact on such discussions. However, narratives have a notable impact on what and when users discussed about privacy. Considering narratives could guide software organizations in eliciting the relevant privacy concerns before developing them as privacy requirements.


title: Simple Kinesthetic Haptics for Object Recognition

abstract: Object recognition is an essential capability when performing various tasks. Humans naturally use either or both visual and tactile perception to extract object class and properties. Typical approaches for robots, however, require complex visual systems or multiple high-density tactile sensors which can be highly expensive. In addition, they usually require actual collection of a large dataset from real objects through direct interaction. In this paper, we propose a kinesthetic-based object recognition method that can be performed with any multi-fingered robotic hand in which the kinematics is known. The method does not require tactile sensors and is based on observing grasps of the objects. We utilize a unique and frame invariant parameterization of grasps to learn instances of object shapes. To train a classifier, training data is generated rapidly and solely in a computational process without interaction with real objects. We then propose and compare between two iterative algorithms that can integrate any trained classifier. The classifiers and algorithms are independent of any particular robot hand and, therefore, can be exerted on various ones. We show in experiments, that with few grasps, the algorithms acquire accurate classification. Furthermore, we show that the object recognition approach is scalable to objects of various sizes. Similarly, a global classifier is trained to identify general geometries (e.g., an ellipsoid or a box) rather than particular ones and demonstrated on a large set of objects. Full scale experiments and analysis are provided to show the performance of the method.


title: RadNet: Incident Prediction in Spatio-Temporal Road Graph Networks Using Traffic Forecasting

abstract: Efficient and accurate incident prediction in spatio-temporal systems is critical to minimize service downtime and optimize performance. This work aims to utilize historic data to predict and diagnose incidents using spatio-temporal forecasting. We consider the specific use case of road traffic systems where incidents take the form of anomalous events, such as accidents or broken-down vehicles. To tackle this, we develop a neural model, called RadNet, which forecasts system parameters such as average vehicle speeds for a future timestep. As such systems largely follow daily or weekly periodicity, we compare RadNet's predictions against historical averages to label incidents. Unlike prior work, RadNet infers spatial and temporal trends in both permutations, finally combining the dense representations before forecasting. This facilitates informed inference and more accurate incident detection. Experiments with two publicly available and a new road traffic dataset demonstrate that the proposed model gives up to 8% higher prediction F1 scores compared to the state-of-the-art methods.


title: Can the Language of the Collation be Translated into the Language of the Stemma? Using Machine Translation for Witness Localization

abstract: Stemmatology is a subfield of philology where one approach to understand the copy-history of textual variants of a text (witnesses of a tradition) is to generate an evolutionary tree. Computational methods are partly shared between the sister discipline of phylogenetics and stemmatology. In 2022, a surveypaper in nature communications found that Deep Learning (DL), which otherwise has brought about major improvements in many fields (Krohn et al 2020) has had only minor successes in phylogenetics and that "it is difficult to conceive of an end-to-end DL model to directly estimate phylogenetic trees from raw data in the near future"(Sapoval et al. 2022, p.8). In stemmatology, there is to date no known DL approach at all. In this paper, we present a new DL approach to placement of manuscripts on a stemma and demonstrate its potential. This could be extended to phylogenetics where the universal code of DNA might be an even better prerequisite for the method using sequence to sequence based neural networks in order to retrieve tree distances.


title: A Theoretical Understanding of Neural Network Compression from Sparse Linear Approximation

abstract: The goal of model compression is to reduce the size of a large neural network while retaining a comparable performance. As a result, computation and memory costs in resource-limited applications may be significantly reduced by dropping redundant weights, neurons, or layers. There have been many model compression algorithms proposed that provide impressive empirical success. However, a theoretical understanding of model compression is still limited. One problem is understanding if a network is more compressible than another of the same structure. Another problem is quantifying how much one can prune a network with theoretically guaranteed accuracy degradation. In this work, we propose to use the sparsity-sensitive $\ell_q$-norm ($0<q<1$) to characterize compressibility and provide a relationship between soft sparsity of the weights in the network and the degree of compression with a controlled accuracy degradation bound. We also develop adaptive algorithms for pruning each neuron in the network informed by our theory. Numerical studies demonstrate the promising performance of the proposed methods compared with standard pruning algorithms.


title: Interest Flooding Attacks in Named Data Networking: Survey of Existing Solutions, Open Issues, Requirements and Future Directions (Extended version)

abstract: Named Data Networking (NDN) is a prominent realization of the vision of Information-Centric Networking. The NDN architecture adopts name-based routing and location-independent data retrieval. Among other important features, NDN integrates security mechanisms and focuses on protecting the content rather than the communications channels. Along with a new architecture come new threats and NDN is no exception. NDN is a potential target for new network attacks such as Interest Flooding Attacks (IFAs). Attackers take advantage of IFA to launch (D)DoS attacks in NDN. Many IFA detection and mitigation solutions have been proposed in the literature. However, there is no comprehensive review study of these solutions that has been proposed so far. Therefore, in this paper, we propose a survey of the various IFAs with a detailed comparative study of all the relevant proposed solutions as counter-measures against IFAs. We also review the requirements for a complete and efficient IFA solution and pinpoint the various issues encountered by IFA detection and mitigation mechanisms through a series of attack scenarios. Finally, in this survey, we offer an analysis of the open issues and future research directions regarding IFAs. This manuscript consists of an extended version of the paper published in ACM Computing Surveys: https://dl.acm.org/doi/10.1145/3539730.


title: Signal-informed DNN-based DOA Estimation combining an External Microphone and GCC-PHAT Features

abstract: Aiming at estimating the direction of arrival (DOA) of a desired speaker in a multi-talker environment using a microphone array, in this paper we propose a signal-informed method exploiting the availability of an external microphone attached to the desired speaker. The proposed method applies a binary mask to the GCC-PHAT input features of a convolutional neural network, where the binary mask is computed based on the power distribution of the external microphone signal. Experimental results for a reverberant scenario with up to four interfering speakers demonstrate that the signal-informed masking improves the localization accuracy, without requiring any knowledge about the interfering speakers.


title: Distribution of a Markov chain in reverse-time with cluster observations in the extremes of a finite time window

abstract: In this brief note, we find formulas for the distribution and the transition probability matrices of a stochastic process described as a time-reversion in a finite time window of a Markov chain, with cluster observation of the Markov state in the extremes of that window.


title: Gradient Boosting Performs Gaussian Process Inference

abstract: This paper shows that gradient boosting based on symmetric decision trees can be equivalently reformulated as a kernel method that converges to the solution of a certain Kernel Ridge Regression problem. Thus, we obtain the convergence to a Gaussian Process' posterior mean, which, in turn, allows us to easily transform gradient boosting into a sampler from the posterior to provide better knowledge uncertainty estimates through Monte-Carlo estimation of the posterior variance. We show that the proposed sampler allows for better knowledge uncertainty estimates leading to improved out-of-domain detection.


title: Maximal operators associated with Fourier multipliers and applications

abstract: In this paper, we introduce a criterion for maximal operators associated with Fourier multipliers to be bounded on $L^p(\mathbb{R}^d)$. Noteworthy examples satisfying the criterion are multipliers of the Mikhlin type or limited decay which are not necessarily radial. To do so, we make use of modified square function estimates and bilinear interpolation. In result, we obtain convergence results for fractional half-wave equations and surface averages as well as the $L^p$ boundedness for the maximal operators.


title: A double series for $\pi$ using Fourier series and the Grothendieck-Krivine constant

abstract: We provide a double-series formula for $\pi$ obtained using the Fourier series expansion of $1/\cos(x/4)$ and applying the Parseval-Plancherel identity. We show that such a formula involves the Grothendieck-Krivine constant, and that the latter can therefore be expressed as a double series as well.


title: Tits Alternative for the 3-dimensional tame automorphism group

abstract: We prove the strong Tits alternative for the 3-dimensional tame automorphism group over a field K of characteristic zero.


title: Hessenberg-Sobolev Matrices and Favard type theorems

abstract: We study the relation between certain non-degenerate lower Hessenberg infinite matrices $\mathcal{G}$ and the existence of sequences of orthogonal polynomials with respect to Sobolev inner products. In other words, we extend the well-known Favard theorem for Sobolev orthogonality. We characterize the structure of the matrix $\mathcal{G}$ and the associated matrix of formal moments $\mathcal{M}_{\mathcal{G}}$ in terms of certain matrix operators.


title: Barcode Posets: Combinatorial Properties and Connections

abstract: A barcode is a finite multiset of intervals on the real line, $B = \{ (b_i, d_i)\}_{i=1}^n$. Barcodes are important objects in topological data analysis, where they serve as summaries of the persistent homology groups of a filtration. The combinatorial properties of barcodes have also been studied, mainly in the context of interval orders and interval graphs. In this paper, we define a new family of maps from the space of barcodes with $n$ bars to the permutation sets of various multisets, known as multipermutations. These multipermutations provide new combinatorial invariants on the space of barcodes. We then define an order relation on these multipermutations, which we show can be interpreted as a crossing number for barcodes, reminiscent of T\'{u}ran's crossing number for graphs. Next, we show that the resulting posets are order-isomorphic to principal ideals of a well known poset known as the multinomial Newman lattice. Consequently, these posets form the graded face-lattices of polytopes, which we refer to as barcode lattices or barcode polytopes. Finally, we show that for a large class of barcodes, these invariants can provide bounds on the Wasserstein and bottleneck distances between a pair of barcodes, linking these discrete invariants to continuous metrics on barcodes.


title: Information theory of spatial network ensembles

abstract: This chapter provides a comprehensive and self-contained discussion of the most recent developments of information theory of networks. Maximum entropy models of networks are the least biased ensembles enforcing a set of constraints and are used in a number of application to produce null model of networks. Here maximum entropy ensembles of networks are introduced by distinguishing between microcanonical and canonical ensembles revealing the the non-equivalence of these two classes of ensembles in the case in which an extensive number of constraints is imposed. It is very common that network data includes also meta-data describing feature of the nodes such as their position in a real or in an abstract space. The features of the nodes can be treated as latent variables that determine the cost associated to each link. Maximum entropy network ensembles with latent variables include spatial networks and their generalisation. In this chapter we cover the case of transportation networks including airport and rail networks. Maximum entropy network ensemble satisfy a given set of constraints. However traditional approaches do not provide any insight on the origin of such constraints. We use information theory principles to find the optimal distribution of latent variables in the framework of the classical information theory of networks. This theory explains the "blessing of non-uniformity" of data guaranteeing the efficiency of inference algorithms.


title: Machine learning approaches for COVID-19 detection from chest X-ray imaging: A Systematic Review

abstract: There is a necessity to develop affordable, and reliable diagnostic tools, which allow containing the COVID-19 spreading. Machine Learning (ML) algorithms have been proposed to design support decision-making systems to assess chest X-ray images, which have proven to be useful to detect and evaluate disease progression. Many research articles are published around this subject, which makes it difficult to identify the best approaches for future work. This paper presents a systematic review of ML applied to COVID-19 detection using chest X-ray images, aiming to offer a baseline for researchers in terms of methods, architectures, databases, and current limitations.


title: Is Kernel Code Different From Non-Kernel Code? A Case Study of BSD Family Operating Systems

abstract: Code churn and code velocity describe the evolution of a code base. Current research quantifies and studies code churn and velocity at a high level of abstraction, often at the overall project level or even at the level of an entire company. We argue that such an approach ignores noticeable differences among the subsystems of large projects. We conducted an exploratory study on four BSD family operating systems: DragonFlyBSD, FreeBSD, NetBSD, and OpenBSD. We mine 797,879 commits to characterize code churn in terms of the annual growth rate, commit types, change type ratio, and size taxonomy of commits for different subsystems (kernel, non-kernel, and mixed). We also investigate differences among various code review periods, i.e., time-to-first-response, time-to-accept, and time-to-merge, as indicators of code velocity. Our study provides empirical evidence that quantifiable evolutionary code characteristics at a global system scope fail to take into account significant individual differences that exist at a subsystem level. We found that while there exist similarities in the code base growth rate and distribution of commit types (neutral, additive, and subtractive) across BSD subsystems, (a) most commits contain kernel or non-kernel code exclusively, (b) kernel commits are larger than non-kernel commits, and (c) code reviews for kernel code take longer than non-kernel code.


title: Federated Learning with Research Prototypes for Multi-Center MRI-based Detection of Prostate Cancer with Diverse Histopathology

abstract: Early prostate cancer detection and staging from MRI are extremely challenging tasks for both radiologists and deep learning algorithms, but the potential to learn from large and diverse datasets remains a promising avenue to increase their generalization capability both within- and across clinics. To enable this for prototype-stage algorithms, where the majority of existing research remains, in this paper we introduce a flexible federated learning framework for cross-site training, validation, and evaluation of deep prostate cancer detection algorithms. Our approach utilizes an abstracted representation of the model architecture and data, which allows unpolished prototype deep learning models to be trained without modification using the NVFlare federated learning framework. Our results show increases in prostate cancer detection and classification accuracy using a specialized neural network model and diverse prostate biopsy data collected at two University of California research hospitals, demonstrating the efficacy of our approach in adapting to different datasets and improving MR-biomarker discovery. We open-source our FLtools system, which can be easily adapted to other deep learning projects for medical imaging.


title: Synthetic PET via Domain Translation of 3D MRI

abstract: Historically, patient datasets have been used to develop and validate various reconstruction algorithms for PET/MRI and PET/CT. To enable such algorithm development, without the need for acquiring hundreds of patient exams, in this paper we demonstrate a deep learning technique to generate synthetic but realistic whole-body PET sinograms from abundantly-available whole-body MRI. Specifically, we use a dataset of 56 $^{18}$F-FDG-PET/MRI exams to train a 3D residual UNet to predict physiologic PET uptake from whole-body T1-weighted MRI. In training we implemented a balanced loss function to generate realistic uptake across a large dynamic range and computed losses along tomographic lines of response to mimic the PET acquisition. The predicted PET images are forward projected to produce synthetic PET time-of-flight (ToF) sinograms that can be used with vendor-provided PET reconstruction algorithms, including using CT-based attenuation correction (CTAC) and MR-based attenuation correction (MRAC). The resulting synthetic data recapitulates physiologic $^{18}$F-FDG uptake, e.g. high uptake localized to the brain and bladder, as well as uptake in liver, kidneys, heart and muscle. To simulate abnormalities with high uptake, we also insert synthetic lesions. We demonstrate that this synthetic PET data can be used interchangeably with real PET data for the PET quantification task of comparing CT and MR-based attenuation correction methods, achieving $\leq 7.6\%$ error in mean-SUV compared to using real data. These results together show that the proposed synthetic PET data pipeline can be reasonably used for development, evaluation, and validation of PET/MRI reconstruction methods.


title: Deep Learning Models for Automated Classification of Dog Emotional States from Facial Expressions

abstract: Similarly to humans, facial expressions in animals are closely linked with emotional states. However, in contrast to the human domain, automated recognition of emotional states from facial expressions in animals is underexplored, mainly due to difficulties in data collection and establishment of ground truth concerning emotional states of non-verbal users. We apply recent deep learning techniques to classify (positive) anticipation and (negative) frustration of dogs on a dataset collected in a controlled experimental setting. We explore the suitability of different backbones (e.g. ResNet, ViT) under different supervisions to this task, and find that features of a self-supervised pretrained ViT (DINO-ViT) are superior to the other alternatives. To the best of our knowledge, this work is the first to address the task of automatic classification of canine emotions on data acquired in a controlled experiment.


title: Nonexistence results of global solutions for fractional order integral equations on the Heisenberg group

abstract: We consider the fractional order integral equation with a time nonlocal nonlinearity $$^{c}\mathbf{D}_{0\mid t}^{\beta}\left( u \right) +\left(-\Delta_{\mathbb{H}} \right)^{m} \left( u \right) = \frac{1}{\Gamma(\alpha)}\int_{0}^{t}\left( t-\omega\right)^{\alpha-1}\vert u(\omega)\vert^{p} d\omega,$$ posed in $ (.,t)\in\mathbb{H}\times(0,\infty) $, supplemented with an initial data $u(.,0)=u_{0}(.) $,where $ m>1 \ , \ p>1 \ , \ 0<\beta<1 \ , \ 0<\alpha<1 $, and $^{c}\mathbf{D}_{0\mid t}^{\beta} $ denotes the caputo fractional derivative of order $ \beta $, and $\Delta_{\mathbb{H}}$ is the Laplacian operator on the $ (2N+1) $-dimensional Heisenberg group $\mathbb{H} $.Then, we prove a blow up result for its solutions.


title: Localization for constrained martingale problems and optimal conditions for uniqueness of reflecting diffusions in 2-dimensional domains

abstract: We prove existence and uniqueness for semimartingale reflecting diffusions in 2-dimensional piecewise smooth domains with varying, oblique directions of reflection on each "side", under geometric, easily verifiable conditions. Our conditions are optimal in the sense that, in the case of a convex polygon with constant direction of reflection on each side, they reduce to the conditions of Dai and Williams (1996), which are necessary for existence of Reflecting Brownian Motion. Moreover our conditions allow for cusps. Our argument is based on a new localization result for constrained martingale problems which holds quite generally: as an additional example, we show that it holds for diffusions with jump boundary conditions.


title: Meromorphic Functions with a Polar Asymptotic Value

abstract: This paper is part of a general program in complex dynamics to understand parameter spaces of transcendental maps with finitely many singular values. The simplest families of such functions have two asymptotic values and no critical values. These families, up to affine conjugation, depend on two complex parameters. Understanding their parameter spaces is key to understanding families with more asymptotic values, just as understanding quadratic polynomials was for rational maps more generally. The first such families studied were the one-dimensional slices of the exponential family, $\exp(z) + a$, and the tangent family $\lambda \tan z$. The exponential case exhibited phenomena not seen for rational maps: Cantor bouquets in both the dynamic and parameter spaces, and no bounded hyperbolic components. The tangent case, with its two finite asymptotic values $\pm \lambda i$, is closer to the rational case, a kind of infinite degree version of the latter. In this paper, we consider a general family that interpolates between $\exp(z) + a$ and $\lambda \tan z$. Our new family has two asymptotic values and a one-dimensional slice for which one of the asymptotic values is constrained to be pole, the "polar asymptotic value" of the title. We show how the dynamic and parameter planes for this slice exhibit behavior that is a surprisingly delicate interplay between that of the $\exp(z) + a$ and $\lambda \tan z$ families.


title: Graphene-based quantum Hall interferometer with self-aligned side gates

abstract: The vanishing band gap of graphene has long presented challenges for making high-quality quantum point contacts (QPCs) -- the partially transparent p-n interfaces introduced by conventional split-gates tend to short the QPC. This complication has hindered the fabrication of graphene quantum Hall Fabry-P\'erot interferometers, until recent advances have allowed split-gate QPCs to operate utilizing the highly resistive $\nu=0$ state. Here, we present a simple recipe to fabricate QPCs by etching a narrow trench in the graphene sheet to separate the conducting channel from self-aligned graphene side gates. We demonstrate operation of the individual QPCs in the quantum Hall regime, and further utilize these QPCs to create and study a quantum Hall interferometer.


title: A Challenge to the Standard Cosmological Model

abstract: We present the first joint analysis of catalogs of radio galaxies and quasars to determine if their sky distribution is consistent with the standard $\Lambda$CDM model of cosmology. This model is based on the cosmological principle, which asserts that the universe is statistically isotropic and homogeneous on large scales, so the observed dipole anisotropy in the cosmic microwave background (CMB) must be attributed to our local peculiar motion. We test the null hypothesis that there is a dipole anisotropy in the sky distribution of radio galaxies and quasars consistent with the motion inferred from the CMB, as is expected for cosmologically distant sources. Our two samples, constructed respectively from the NRAO VLA Sky Survey and the Wide-field Infrared Survey Explorer, are systematically independent and have no shared objects. Using a completely general statistic that accounts for correlation between the found dipole amplitude and its directional offset from the CMB dipole, the null hypothesis is independently rejected by the radio galaxy and quasar samples with $p$-value of $8.9\times10^{-3}$ and $1.2\times10^{-5}$, respectively, corresponding to $2.6\sigma$ and $4.4\sigma$ significance. The joint significance, using sample size-weighted $Z$-scores, is $5.1\sigma$. We show that the radio galaxy and quasar dipoles are consistent with each other and find no evidence for any frequency dependence of the amplitude. The consistency of the two dipoles improves if we boost to the CMB frame assuming its dipole to be fully kinematic, suggesting that cosmologically distant radio galaxies and quasars may have an intrinsic anisotropy in this frame.


title: Exploring the Intersection between Neural Architecture Search and Continual Learning

abstract: Despite the significant advances achieved in Artificial Neural Networks (ANNs), their design process remains notoriously tedious, depending primarily on intuition, experience and trial-and-error. This human-dependent process is often time-consuming and prone to errors. Furthermore, the models are generally bound to their training contexts, with no considerations to their surrounding environments. Continual adaptiveness and automation of neural networks is of paramount importance to several domains where model accessibility is limited after deployment (e.g IoT devices, self-driving vehicles, etc.). Additionally, even accessible models require frequent maintenance post-deployment to overcome issues such as Concept/Data Drift, which can be cumbersome and restrictive. By leveraging and combining approaches from Neural Architecture Search (NAS) and Continual Learning (CL), more robust and adaptive agents can be developed. This study conducts the first extensive review on the intersection between NAS and CL, formalizing the prospective Continually-Adaptive Neural Networks (CANNs) paradigm and outlining research directions for lifelong autonomous ANNs.


title: Kinetic asymmetry versus dissipation in the evolution of chemical systems as exemplified by single enzyme chemotaxis

abstract: Single enzyme chemotaxis is a phenomenon by which a non-equilibrium spatial distribution of an enzyme is created and maintained by concentration gradients of the substrate and product of the catalyzed reaction. These gradients can arise either naturally through metabolism, or experimentally, e.g., by flow of materials through several channels or by use of diffusion chambers with semipermeable membranes. Numerous hypotheses regarding the mechanism of this phenomenon have been proposed. Here we discuss a mechanism based solely on diffusion and chemical kinetics and show that kinetic asymmetry, a difference in the off rates for substrate and for product, and diffusion asymmetry, a difference in the diffusivities of the bound and free forms of the enzyme, are the sole determinates of the direction of chemotaxis. Exploration of these fundamental symmetries that govern nonequilibrium behavior helps to distinguish between possible mechanisms for the evolution of a chemical system from initial to the steady state, and whether the principle that determines the direction a system shifts when exposed to an external energy source is based on thermodynamics, or on kinetics, with the latter being supported by the results of the present paper. Our results show that while dissipation ineluctably accompanies non-equilibrium phenomena, including chemotaxis, systems do not evolve to maximize dissipation, but rather to attain greatest kinetic stability. Chemotactic response to the gradients formed by other enzymes provides a mechanism for forming loose associations known as metabolons. Significantly the direction of the effective force due to these gradients depends on the kinetic asymmetry of the enzyme, and so can be non-reciprocal, where one enzyme is attracted to another enzyme, but the other enzyme is repelled by the one, an important ingredient in the behavior of active matter.


title: Benchmark of $\boldsymbol{GW}$ Methods for Core-Level Binding Energies

abstract: The $GW$ approximation has recently gained increasing attention as a viable method for the computation of deep core-level binding energies as measured by X-ray photoelectron spectroscopy (XPS). We present a comprehensive benchmark study of different $GW$ methodologies (starting-point optimized, partial and full eigenvalue-self-consistent, Hedin shift and renormalized singles) for molecular inner-shell excitations. We demonstrate that all methods yield a unique solution and apply them to the CORE65 benchmark set and ethyl trifluoroacetate. Three $GW$ schemes clearly outperform the other methods for absolute core-level energies with a mean absolute error of 0.3 eV with respect to experiment. These are partial eigenvalue self-consistency, in which the eigenvalues are only updated in the Green's function, single-shot $GW$ calculations based on an optimized hybrid functional starting point and a Hedin shift in the Green's function. While all methods reproduce the experimental relative binding energies well, the eigenvalue self-consistent schemes and the Hedin shift yield with mean errors $<0.2$ eV the best results.


title: Ab initio estimation of $E2$ strengths in $^8$Li and its neighbors by normalization to the measured quadrupole moment

abstract: For electric quadrupole ($E2$) observables, which depend on the large-distance tails of the nuclear wave function, ab initio no-core configuration interaction (NCCI) calculations converge slowly, making meaningful predictions challenging to obtain. Nonetheless, the calculated values for different $E2$ matrix elements, particularly those involving levels with closely-related structure (e.g., within the same rotational band) are found to be robustly proportional. This observation suggests that a known value for one observable may be used to determine the overall scale of $E2$ strengths, and thereby provide predictions for others. In particular, we demonstrate that meaningful predictions for $E2$ transitions may be obtained by calibration to the ground-state quadrupole moment. We test this approach for well-measured low-lying $E2$ transitions in $^7$Li and $^9$Be, then provide predictions for transitions in $^8$Li and $^9$Li. In particular, we address the $2^+\rightarrow1^+$ transition in $^8$Li, for which the reported measured strength exceeds ab initio Green's function Monte Carlo (GFMC) predictions by over an order of magnitude.


title: Governing for Free: Rule Process Effects on Reddit Moderator Motivations

abstract: Developing a strong community requires empowered leadership capable of overcoming governance challenges. New online platforms have given users opportunities to practice governance through content moderation roles. The over 2.8 million "subreddit" communities on Reddit are governed by hundreds of thousands of volunteer moderators, many of whom have no training or prior experience in a governing role. While moderators often devote daily time to community maintenance and cope with the emotional effects of hate comments or disturbing content, Reddit provides no compensation for this position. Thus, moderators' internal motivations and desire to continue filling this role is critical for their community. Drawing upon the relationship between governance procedures and internalized motivation, we investigate how the processes through which subreddit moderators generate community rules increase moderators' motivation through the meeting of social-psychological needs: Procedural Justice and Self Determination, and Self-Other Merging. Preliminary analysis of survey data from 620 moderators across Reddit shows a correlation between moderators' administrative behaviors and the social-psychological needs underpinning their motivations. Understanding these relationships will allow us to empower moderators to build engaging and cooperative online communities.


title: Mathematical Theory of Bayesian Statistics for Unknown Information Source

abstract: In statistical inference, uncertainty is unknown and all models are wrong. That is to say, a person who makes a statistical model and a prior distribution is simultaneously aware that both are fictional candidates. To study such cases, statistical measures have been constructed, such as cross validation, information criteria, and marginal likelihood, however, their mathematical properties have not yet been completely clarified when statistical models are under- and over- parametrized. We introduce a place of mathematical theory of Bayesian statistics for unknown uncertainty, which clarifies general properties of cross validation, information criteria, and marginal likelihood, even if an unknown data-generating process is unrealizable by a model or even if the posterior distribution cannot be approximated by any normal distribution. Hence it gives a helpful standpoint for a person who cannot believe in any specific model and prior. This paper consists of three parts. The first is a new result, whereas the second and third are well-known previous results with new experiments. We show there exists a more precise estimator of the generalization loss than leave-one-out cross validation, there exists a more accurate approximation of marginal likelihood than BIC, and the optimal hyperparameters for generalization loss and marginal likelihood are different.


title: Borel-Laplace Sum Rules with $\tau$ decay data, using OPE with improved anomalous dimensions

abstract: We perform numerical analysis of double-pinched Borel-Laplace QCD sum rules for the strangeless semihadronic $\tau$-decay data. The $D=0$ contribution to the theoretical contour integral in the sum rules is evaluated by the (truncated) Fixed Order perturbation theory method (FO) and by the Principal Value (PV) of the Borel integration. We use for the full Adler function the Operator Product Expansion (OPE) with the terms $\sim \langle O_D \rangle$ of dimension $D=2 n$ where $2 \leq n \leq 5$ for the (V+A)-channel, and $2 \leq n \leq 7$ for the V-channel data. In our previous works [1,2], only the (V+A)-channel data was analysed. In this work, the analysis of a new set of V-channel data is performed as well. Further, a renormalon-motivated construction of the $D=0$ part of the Adler function is improved in the $u=3$ infrared renormalon sector, by involving the recently known information on the two principal noninteger values $k^{(j)}=\gamma^{(1)}(O_6^{(j)})/\beta_0$ of the effective leading-order anomalous dimensions. Additionally, the OPE of the Adler function has now the D=6 contribution with the principal anomalous dimension ($\sim \alpha_s^{k^{(1)}}$), and terms of higher dimension (with zero anomalous dimension). Cross-checks of the obtained extracted values of $\alpha_s$ and of the condensates were performed by reproduction of the (central) experimental values of several double-pinched momenta $a^{(2,n)}$. The averaged final extracted values of the (MSbar) coupling are: $\alpha_s(m_{\tau}^2) = 0.3169^{+0.0070}_{-0.0096}$, corresponding to $\alpha_s(M_Z^2)=0.1183^{+0.0009}_{-0.0012}$.


title: Norm Inequalities Related to Heinz and Logarithmic Means

abstract: In this paper, we got some refinements of the norm inequalities related to the Heinz mean and logarithmic mean.


title: On the uniqueness of linear convection--diffusion equations with integral boundary conditions

abstract: This work contributes to an understanding of the domain size's effect on the existence and uniqueness of the linear convection--diffusion equation with integral-type boundary conditions, where boundary conditions depend non-locally on unknown solutions. Generally, the uniqueness result of this type of equation is unclear. In this preliminary study, a uniqueness result is verified when the domain is sufficiently large or small. The main approach has an advantage of transforming the integral boundary conditions into new Dirichlet boundary conditions so that we can obtain refined estimates, and the comparison theorem can be applied to the equations. Furthermore, we show a domain such that under different boundary data, the equation in this domain can have infinitely numerous solutions or no solution.


title: Random Access-based Multiuser Computation Offloading for Devices in IoT Applications

abstract: In various Internet-of-Things (IoT) applications, a number of devices and sensors are used to collect data sets. As devices become more capable and smarter, they can not only collect data sets, but also process them locally. However, since most devices would be limited in terms of computing power and energy, they can take advantage of offloading so that their tasks can be carried out at mobile edge computing (MEC) servers. In this paper, we discuss computation offloading for devices in IoT applications. In particular, we consider users or devices with sporadic tasks, where optimizing resource allocation between offloading devices and coordinating for multiuser offloading becomes inefficient. Thus, we propose a two-stage offloading approach that is friendly to devices with sporadic tasks as it employs multichannel random access for offloading requests with low signaling overhead. The stability of the two-stage offloading approach is considered with methods to stabilize the system. We also analyze the latency outage probability as a performance index from a device perspective.


title: La$_2$Rh$_{3+\delta}$Sb$_4$: A new ternary superconducting rhodium-antimonide

abstract: Rhodium-containing compounds offer a fertile playground to explore novel materials with superconductivity and other fantastic electronic correlation effects. A new ternary rhodium-antimonide La$_2$Rh$_{3+\delta}$Sb$_4$ ($\delta\approx 1/8$) has been synthesized by a Bi-flux method. It crystallizes in the orthorhombic Pr$_2$Ir$_3$Sb$_4$-like structure, with the space group $Pnma$ (No. 62). The crystalline structure appears as stacking the two dimensional RhSb$_4$- and RhSb$_5$-polyhedra networks along $\mathbf{b}$ axis, and the La atoms embed in the cavities of these networks. Band structure calculations confirm it as a multi-band metal with a van-Hove singularity like feature at the Fermi level, whose density of states are mainly of Rh-4$d$ and Sb-5$p$ characters. The calculations also imply that the redundant Rh acts as charge dopant. Superconductivity is observed in this material with onset transition at $T_c^{on}\approx$ 0.8 K. Ultra-low temperature magnetic susceptibility and specific heat measurements suggest that it is an s-wave type-II superconductor. Our work may also imply that the broad $Ln_2$$Tm_{3+\delta}$Sb$_4$ ($Ln$=Rare earth, $Tm$=Rh, Ir...) family may host new material bases where new superconductors, quantum magnetism and other electronic correlation effects could be found.


title: Convex geometries representable with colors, by ellipses on the plane, and impossible by circles

abstract: A convex geometry is a closure system satisfying the anti-exchange property. This paper, following the work of K. Adaricheva and M. Bolat (2016) and the Polymath REU 2020 team, continues to investigate representations of convex geometries on a 5-element base set. It introduces several properties: the opposite property, nested triangle property, area Q property, and separation property, of convex geometries of circles on a plane, preventing this representation for numerous convex geometries on a 5-element base set. It also demonstrates that all 672 convex geometries on a 5-element base set have a representation by ellipses, as given in the appendix for those without a known representation by circles, and introduces a method of expanding representation with circles by defining unary predicates, shown as colors.


title: Convergence and Stability of Coupled Belief--Strategy Learning Dynamics in Continuous Games

abstract: We propose a learning dynamics to model how strategic agents repeatedly play a continuous game while relying on an information platform to learn an unknown payoff-relevant parameter. In each time step, the platform updates a belief estimate of the parameter based on players' strategies and realized payoffs using Bayes's rule. Then, players adopt a generic learning rule to adjust their strategies based on the updated belief. We present results on the convergence of beliefs and strategies and the properties of convergent fixed points of the dynamics. We obtain sufficient and necessary conditions for the existence of globally stable fixed points. We also provide sufficient conditions for the local stability of fixed points. These results provide an approach to analyzing the long-term outcomes that arise from the interplay between Bayesian belief learning and strategy learning in games, and enable us to characterize conditions under which learning leads to a complete information equilibrium.


title: Interacting planetary nebulae III: Verification and galactic population based on the measurements of Gaia EDR3

abstract: The phenomenon of interaction between planetary nebulae (PNe) and the interstellar medium (ISM) is one of the significant issues in the field of astrophysics. The main objective of this paper is to verify the interaction process for objects that have been known as interacting PNe (IPNe) in the literature. This study is based on parallax and proper motion observations facilitated recently by the early third data release of the Gaia space mission. Based on the proper nebular central star (CS) motion towards the region of interaction between the PN and ISM, we were able to verify the interaction process for a group of 68 PNe and disprove the interaction process for a group of 33 PNe. The members of both groups were confirmed as genuine PN-ISM interacting objects in the literature. The members belonging to the 33 PNe group are false PN-ISM interacting objects that mimic the structure of IPNe. Moreover, we calculated the physical and kinematic properties of the verified group and analyzed their galactic population classification using reliable and precise measurements of the proper motion and parallax of the CS. We find that 41\% and 41\% of this group are associated with galactic thin and thick disks, respectively, while 18\% are members of thin or thick disks. The kinematical results show that the galactic thin-disk members have smaller vertical galactic heights, space velocities, and peculiar velocities than those belonging to the galactic thick disk.


title: Twists of graded Poisson algebras and related properties

abstract: We introduce a Poisson version of the graded twist of a graded associative algebra and prove that every graded Poisson structure on a connected graded polynomial ring $A:=\Bbbk[x_1,\ldots,x_n]$ is a graded twist of a unimodular Poisson structure on $A$, namely, if $\pi$ is a graded Poisson structure on $A$, then $\pi$ has a decomposition $$\pi=\pi_{unim} +\frac{1}{\sum_{i=1}^n {\rm deg} x_i} E\wedge {\mathbf m}$$ where $E$ is the Euler derivation, $\pi_{unim}$ is the unimodular graded Poisson structure on $A$ corresponding to $\pi$, and ${\mathbf m}$ is the modular derivation of $(A,\pi)$. This result is a generalization of the same result in the quadratic setting. The rigidity of graded twisting, $PH^1$-minimality, and $H$-ozoneness are studied. As an application, we compute the Poisson cohomologies of the quadratic Poisson structures on the polynomial ring of three variables when the potential is irreducible, but not necessarily having isolated singularities.


title: Robust Estimating Method for Propensity Score Models and its Application to Some Causal Estimands: A review and proposal

abstract: In observational study, the propensity score has the central role to estimate causal effects. Since the propensity score is usually unknown, estimating by appropriate procedures is an indispensable step. A point to note that a causal effect estimator might have some bias if a propensity score model was misspecified; valid model construction is important. To overcome the problem, a variety of interesting methods has been proposed. In this paper, we review four methods: using ordinary logistic regression approach; CBPS proposed by Imai and Ratkovic; boosted CART proposed by McCaffrey and colleagues; a semiparametric strategy proposed by Liu and colleagues. Also, we propose the novel robust two step strategy: estimating each candidate model in the first step and integrating them in the second step. We confirm the performance of these methods through simulation examples by estimating the ATE and ATO proposed by Li and colleagues. From the results of the simulation examples, the boosted CART and CBPS with higher-order balancing condition have good properties; both the estimate of the ATE and ATO has the small variance and the absolute value of bias. The boosted CART and CBPS are useful for a variety of estimands and estimating procedures.


title: An Unsupervised Deep-Learning Method for Bone Age Assessment

abstract: The bone age, reflecting the degree of development of the bones, can be used to predict the adult height and detect endocrine diseases of children. Both examinations of radiologists and variability of operators have a significant impact on bone age assessment. To decrease human intervention , machine learning algorithms are used to assess the bone age automatically. However, conventional supervised deep-learning methods need pre-labeled data. In this paper, based on the convolutional auto-encoder with constraints (CCAE), an unsupervised deep-learning model proposed in the classification of the fingerprint, we propose this model for the classification of the bone age and baptize it BA-CCAE. In the proposed BA-CCAE model, the key regions of the raw X-ray images of the bone age are encoded, yielding the latent vectors. The K-means clustering algorithm is used to obtain the final classifications by grouping the latent vectors of the bone images. A set of experiments on the Radiological Society of North America pediatric bone age dataset (RSNA) show that the accuracy of classifications at 48-month intervals is 76.15%. Although the accuracy now is lower than most of the existing supervised models, the proposed BA-CCAE model can establish the classification of bone age without any pre-labeled data, and to the best of our knowledge, the proposed BA-CCAE is one of the few trails using the unsupervised deep-learning method for the bone age assessment.


title: Average-case hardness of estimating probabilities of random quantum circuits with a linear scaling in the error exponent

abstract: We consider the hardness of computing additive approximations to output probabilities of random quantum circuits. We consider three random circuit families, namely, Haar random, $p=1$ QAOA, and random IQP circuits. Our results are as follows. For Haar random circuits with $m$ gates, we improve on prior results by showing $\mathsf{coC_=P}$ hardness of average-case additive approximations to an imprecision of $2^{-O(m)}$. Efficient classical simulation of such problems would imply the collapse of the polynomial hierarchy. For constant depth circuits i.e., when $m=O(n)$, this linear scaling in the exponent is within a constant of the scaling required to show hardness of sampling. Prior to our work, such a result was shown only for Boson Sampling in Bouland et al (2021). We also use recent results in polynomial interpolation to show $\mathsf{coC_=P}$ hardness under $\mathsf{BPP}$ reductions rather than $\mathsf{BPP}^{\mathsf{NP}}$ reductions. This improves the results of prior work for Haar random circuits both in terms of the error scaling and the power of reductions. Next, we consider random $p=1$ QAOA and IQP circuits and show that in the average-case, it is $\mathsf{coC_=P}$ hard to approximate the output probability to within an additive error of $2^{-O(n)}$. For $p=1$ QAOA circuits, this work constitutes the first average-case hardness result for the problem of approximating output probabilities for random QAOA circuits, which include Sherrington-Kirkpatrick and Erd\"{o}s-Renyi graphs. For IQP circuits, a consequence of our results is that approximating the Ising partition function with imaginary couplings to an additive error of $2^{-O(n)}$ is hard even in the average-case, which extends prior work on worst-case hardness of multiplicative approximation to Ising partition functions.


title: Density Regression and Uncertainty Quantification with Bayesian Deep Noise Neural Networks

abstract: Deep neural network (DNN) models have achieved state-of-the-art predictive accuracy in a wide range of supervised learning applications. However, accurately quantifying the uncertainty in DNN predictions remains a challenging task. For continuous outcome variables, an even more difficult problem is to estimate the predictive density function, which not only provides a natural quantification of the predictive uncertainty, but also fully captures the random variation in the outcome. In this work, we propose the Bayesian Deep Noise Neural Network (B-DeepNoise), which generalizes standard Bayesian DNNs by extending the random noise variable from the output layer to all hidden layers. The latent random noise equips B-DeepNoise with the flexibility to approximate highly complex predictive distributions and accurately quantify predictive uncertainty. For posterior computation, the unique structure of B-DeepNoise leads to a closed-form Gibbs sampling algorithm that iteratively simulates from the posterior full conditional distributions of the model parameters, circumventing computationally intensive Metropolis-Hastings methods. A theoretical analysis of B-DeepNoise establishes a recursive representation of the predictive distribution and decomposes the predictive variance with respect to the latent parameters. We evaluate B-DeepNoise against existing methods on benchmark regression datasets, demonstrating its superior performance in terms of prediction accuracy, uncertainty quantification accuracy, and uncertainty quantification efficiency. To illustrate our method's usefulness in scientific studies, we apply B-DeepNoise to predict general intelligence from neuroimaging features in the Adolescent Brain Cognitive Development (ABCD) project.


title: Monte Carlo with Soft Constraints: the Surface Augmented Sampler

abstract: We describe an MCMC method for sampling distributions with soft constraints, which are constraints that are almost but not exactly satisfied. We sample a total distribution that is a convex combination of the target soft distribution with the nearby hard distribution supported on the constraint surface. Hard distribution moves lead to performance that is uniform in the softness parameter. On and Off moves related to the Holmes-Cerfon Stratification Sampler enable sampling the target soft distribution. Computational experiments verify that performance is uniform in the soft constraints limit.

categories: stat.CO cs.NA math.NA math.PR math.ST stat.TH


title: True gravitational atom: Spherical cloud of dilatonic black holes

abstract: Black hole as elementary particle is a fairly glamorous idea. For ordinary black holes, a surrounding particle inevitably penetrates into the interior of the hole since the center of the hole is an infinite potential well. For the first time we demonstrate that an extreme dilatonic black hole in spherical symmetry perfectly behaves as an atom, in the sense that its surrounding cloud of particles are completely stable. Thus we reach a spherical cloud of dilatonic black hole. We find exact wave functions of the cloud for arbitrary gravitational fine structure constant $\mu M$, and clear the underlying physical nature of the stability. Through careful studies of the exact wave function, we find the spectrum of this system. We discuss the physical meaning of this discovery especially from considerations of entropy, and the resultant possibility to explore quantization of gravitational waves from coming observations.


title: On Continuous 2-Category Symmetries and Yang-Mills Theory

abstract: We study a 4d gauge theory $U(1)^{N-1}\rtimes S_N$ obtained from a $U(1)^{N-1}$ theory by gauging a 0-form symmetry $S_N$. We show that this theory has a global continuous 2-category symmetry, whose structure is particularly rich for $N>2$. This example allows us to draw a connection between the higher gauging procedure and the difference between local and global fusion, which turns out to be a key feature of higher category symmetries. By studying the spectrum of local and extended operators, we find a mapping with gauge invariant operators of 4d $SU(N)$ Yang-Mills theory. The largest group-like subcategory of the non-invertible symmetries of our theory is a $\mathbb{Z}_N^{(1)}$ 1-form symmetry, acting on the Wilson lines in the same way as the center symmetry of Yang-Mills theory does. Supported by a path-integral argument, we propose that the $U(1)^{N-1}\rtimes S_N$ gauge theory has a relation with the ultraviolet limit of $SU(N)$ Yang-Mills theory in which all Gukov-Witten operators become topological, and form a continuous non-invertible 2-category symmetry, broken down to the center symmetry by the RG flow.


title: A Fast Alternating Minimization Algorithm for Coded Aperture Snapshot Spectral Imaging Based on Sparsity and Deep Image Priors

abstract: Coded aperture snapshot spectral imaging (CASSI) is a technique used to reconstruct three-dimensional hyperspectral images (HSIs) from one or several two-dimensional projection measurements. However, fewer projection measurements or more spectral channels leads to a severly ill-posed problem, in which case regularization methods have to be applied. In order to significantly improve the accuracy of reconstruction, this paper proposes a fast alternating minimization algorithm based on the sparsity and deep image priors (Fama-SDIP) of natural images. By integrating deep image prior (DIP) into the principle of compressive sensing (CS) reconstruction, the proposed algorithm can achieve state-of-the-art results without any training dataset. Extensive experiments show that Fama-SDIP method significantly outperforms prevailing leading methods on simulation and real HSI datasets.


title: Indirect-Instant Attention Optimization for Crowd Counting in Dense Scenes

abstract: One of appealing approaches to guiding learnable parameter optimization, such as feature maps, is global attention, which enlightens network intelligence at a fraction of the cost. However, its loss calculation process still falls short: 1)We can only produce one-dimensional 'pseudo labels' for attention, since the artificial threshold involved in the procedure is not robust; 2) The attention awaiting loss calculation is necessarily high-dimensional, and decreasing it by convolution will inevitably introduce additional learnable parameters, thus confusing the source of the loss. To this end, we devise a simple but efficient Indirect-Instant Attention Optimization (IIAO) module based on SoftMax-Attention , which transforms high-dimensional attention map into a one-dimensional feature map in the mathematical sense for loss calculation midway through the network, while automatically providing adaptive multi-scale fusion to feature pyramid module. The special transformation yields relatively coarse features and, originally, the predictive fallibility of regions varies by crowd density distribution, so we tailor the Regional Correlation Loss (RCLoss) to retrieve continuous error-prone regions and smooth spatial information . Extensive experiments have proven that our approach surpasses previous SOTA methods in many benchmark datasets.


title: TileGen: Tileable, Controllable Material Generation and Capture

abstract: Recent methods (e.g. MaterialGAN) have used unconditional GANs to generate per-pixel material maps, or as a prior to reconstruct materials from input photographs. These models can generate varied random material appearance, but do not have any mechanism to constrain the generated material to a specific category or to control the coarse structure of the generated material, such as the exact brick layout on a brick wall. Furthermore, materials reconstructed from a single input photo commonly have artifacts and are generally not tileable, which limits their use in practical content creation pipelines. We propose TileGen, a generative model for SVBRDFs that is specific to a material category, always tileable, and optionally conditional on a provided input structure pattern. TileGen is a variant of StyleGAN whose architecture is modified to always produce tileable (periodic) material maps. In addition to the standard "style" latent code, TileGen can optionally take a condition image, giving a user direct control over the dominant spatial (and optionally color) features of the material. For example, in brick materials, the user can specify a brick layout and the brick color, or in leather materials, the locations of wrinkles and folds. Our inverse rendering approach can find a material perceptually matching a single target photograph by optimization. This reconstruction can also be conditional on a user-provided pattern. The resulting materials are tileable, can be larger than the target image, and are editable by varying the condition.


title: Preprocessing Enhanced Image Compression for Machine Vision

abstract: Recently, more and more images are compressed and sent to the back-end devices for the machine analysis tasks~(\textit{e.g.,} object detection) instead of being purely watched by humans. However, most traditional or learned image codecs are designed to minimize the distortion of the human visual system without considering the increased demand from machine vision systems. In this work, we propose a preprocessing enhanced image compression method for machine vision tasks to address this challenge. Instead of relying on the learned image codecs for end-to-end optimization, our framework is built upon the traditional non-differential codecs, which means it is standard compatible and can be easily deployed in practical applications. Specifically, we propose a neural preprocessing module before the encoder to maintain the useful semantic information for the downstream tasks and suppress the irrelevant information for bitrate saving. Furthermore, our neural preprocessing module is quantization adaptive and can be used in different compression ratios. More importantly, to jointly optimize the preprocessing module with the downstream machine vision tasks, we introduce the proxy network for the traditional non-differential codecs in the back-propagation stage. We provide extensive experiments by evaluating our compression method for two representative downstream tasks with different backbone networks. Experimental results show our method achieves a better trade-off between the coding bitrate and the performance of the downstream machine vision tasks by saving about 20% bitrate.


title: STD-NET: Search of Image Steganalytic Deep-learning Architecture via Hierarchical Tensor Decomposition

abstract: Recent studies shows that the majority of existing deep steganalysis models have a large amount of redundancy, which leads to a huge waste of storage and computing resources. The existing model compression method cannot flexibly compress the convolutional layer in residual shortcut block so that a satisfactory shrinking rate cannot be obtained. In this paper, we propose STD-NET, an unsupervised deep-learning architecture search approach via hierarchical tensor decomposition for image steganalysis. Our proposed strategy will not be restricted by various residual connections, since this strategy does not change the number of input and output channels of the convolution block. We propose a normalized distortion threshold to evaluate the sensitivity of each involved convolutional layer of the base model to guide STD-NET to compress target network in an efficient and unsupervised approach, and obtain two network structures of different shapes with low computation cost and similar performance compared with the original one. Extensive experiments have confirmed that, on one hand, our model can achieve comparable or even better detection performance in various steganalytic scenarios due to the great adaptivity of the obtained network architecture. On the other hand, the experimental results also demonstrate that our proposed strategy is more efficient and can remove more redundancy compared with previous steganalytic network compression methods.


title: Dealing with Sparse Rewards in Continuous Control Robotics via Heavy-Tailed Policies

abstract: In this paper, we present a novel Heavy-Tailed Stochastic Policy Gradient (HT-PSG) algorithm to deal with the challenges of sparse rewards in continuous control problems. Sparse reward is common in continuous control robotics tasks such as manipulation and navigation, and makes the learning problem hard due to non-trivial estimation of value functions over the state space. This demands either reward shaping or expert demonstrations for the sparse reward environment. However, obtaining high-quality demonstrations is quite expensive and sometimes even impossible. We propose a heavy-tailed policy parametrization along with a modified momentum-based policy gradient tracking scheme (HT-SPG) to induce a stable exploratory behavior to the algorithm. The proposed algorithm does not require access to expert demonstrations. We test the performance of HT-SPG on various benchmark tasks of continuous control with sparse rewards such as 1D Mario, Pathological Mountain Car, Sparse Pendulum in OpenAI Gym, and Sparse MuJoCo environments (Hopper-v2). We show consistent performance improvement across all tasks in terms of high average cumulative reward. HT-SPG also demonstrates improved convergence speed with minimum samples, thereby emphasizing the sample efficiency of our proposed algorithm.


title: Electronic and magnetic properties of intermetallic Kagome magnets $R$V$_6$Sn$_6$ ($R$ = Tb - Tm)

abstract: We present a systematic study of the structure, electronic, and magnetic properties of a new branch of intermetalllic compounds, $R$V$_6$Sn$_6$ ($R$ = Tb - Tm) by using X-ray diffraction, magnetic susceptibility, magnetization, electrical transport, and heat-capacity measurements. These compounds feature a combination of a non-magnetic vanadium kagome sublattice and a magnetic rare-earth triangular sublattice that supports various spin anisotropies based on different $R$ ions. We find magnetic orders for the $R$ = Tb, Dy, and Ho compounds at 4.4, 3, 2.5 K, respectively, while no ordering is detected down to 0.4 K for the $R$ = Er and Tm compounds with easy-plane anisotropies. Electronically, we found no superconductivity or charge ordering transition down to 0.4 K for any member of this family, while all compounds exhibit multi-band transport properties that originate from the band topology of the vanadium kagome sublattice.


title: A Matrix Decomposition Model Based on Feature Factors in Movie Recommendation System

abstract: Currently, matrix decomposition is one of the most widely used collaborative filtering algorithms by using factor decomposition to effectively deal with large-scale rating matrix. It mainly uses the interaction records between users and items to predict ratings. Based on the characteristic attributes of items and users, this paper proposes a new UISVD++ model that fuses the type attributes of movies and the age attributes of users into SVD++ framework. By projecting the age attribute into the user's implicit space and the type attribute into the item's implicit space, the model enriches the side information of the users and items. At last, we conduct comparative experiments on two public data sets, Movielens-100K and Movielens-1M. Experiment results express that the prediction accuracy of this model is better than other baselines in the task of predicting scores. In addition, these results also show that UISVD++ can effectively alleviate the cold start situation.


title: Variational Bayes Deep Operator Network: A data-driven Bayesian solver for parametric differential equations

abstract: Neural network based data-driven operator learning schemes have shown tremendous potential in computational mechanics. DeepONet is one such neural network architecture which has gained widespread appreciation owing to its excellent prediction capabilities. Having said that, being set in a deterministic framework exposes DeepONet architecture to the risk of overfitting, poor generalization and in its unaltered form, it is incapable of quantifying the uncertainties associated with its predictions. We propose in this paper, a Variational Bayes DeepONet (VB-DeepONet) for operator learning, which can alleviate these limitations of DeepONet architecture to a great extent and give user additional information regarding the associated uncertainty at the prediction stage. The key idea behind neural networks set in Bayesian framework is that, the weights and bias of the neural network are treated as probability distributions instead of point estimates and, Bayesian inference is used to update their prior distribution. Now, to manage the computational cost associated with approximating the posterior distribution, the proposed VB-DeepONet uses \textit{variational inference}. Unlike Markov Chain Monte Carlo schemes, variational inference has the capacity to take into account high dimensional posterior distributions while keeping the associated computational cost low. Different examples covering mechanics problems like diffusion reaction, gravity pendulum, advection diffusion have been shown to illustrate the performance of the proposed VB-DeepONet and comparisons have also been drawn against DeepONet set in deterministic framework.


title: On the initiation of fiber fuse damage in high-power ytterbium-doped fiber lasers

abstract: Fiber fuse effect can occur spontaneously and propagate along optical fibers to cause wide-spread damage; it threatens all applications involving optical fibers. This paper presents two results. First, it establishes that the initiation of fiber fuse (IFF) in silica fibers is caused by defect-induced absorption. Critical temperatures and critical optical powers for IFF are simulated for the first time using a 3D solid-state heat transfer model with heat source generated by defect-induced absorption. In this method, formation energies of the defects can be uniquely determined, which offers critical information on the chemical reasons for fiber fuse. Second, this paper offers a method to evaluate operating temperatures of fiber lasers. General analytical solutions of the operating temperatures along gain fibers are deduced. Results of 976-nm laser-diode-(LD)-pumped and 1018-nm tandem-pumped ytterbium-doped fiber (YDF) amplifiers using 10/130-{\mu}m YDFs are calculated. Potential limits caused by fiber fuse are discussed.


title: LUEM : Local User Engagement Maximization in Networks

abstract: Understanding a social network is a fundamental problem in social network analysis because of its numerous applications. Recently, user engagement in networks has received extensive attention from many research groups. However, most user engagement models focus on global user engagement to maximize (or minimize) the number of engaged users. In this study, we formulate the so-called Local User Engagement Maximization (LUEM) problem. We prove that the LUEM problem is NP-hard. To obtain high-quality results, we propose an approximation algorithm that incorporates a traditional hill-climbing method. To improve efficiency, we propose an efficient pruning strategy while maintaining effectiveness. In addition, by observing the relationship between the degree and user engagement, we propose an efficient heuristic algorithm that preserves effectiveness. Finally, we conducted extensive experiments on ten real-world networks to demonstrate the superiority of the proposed algorithms. We observed that the proposed algorithm achieved up to 605% more engaged users compared to the best baseline algorithms.


title: Improving Pre-trained Language Model Fine-tuning with Noise Stability Regularization

abstract: The advent of large-scale pre-trained language models has contributed greatly to the recent progress in natural language processing. Many state-of-the-art language models are first trained on a large text corpus and then fine-tuned on downstream tasks. Despite its recent success and wide adoption, fine-tuning a pre-trained language model often suffers from overfitting, which leads to poor generalizability due to the extremely high complexity of the model and the limited training samples from downstream tasks. To address this problem, we propose a novel and effective fine-tuning framework, named Layerwise Noise Stability Regularization (LNSR). Specifically, we propose to inject the standard Gaussian noise or In-manifold noise and regularize hidden representations of the fine-tuned model. We first provide theoretical analyses to support the efficacy of our method. We then demonstrate the advantages of the proposed method over other state-of-the-art algorithms including L2-SP, Mixout and SMART. While these previous works only verify the effectiveness of their methods on relatively simple text classification tasks, we also verify the effectiveness of our method on question answering tasks, where the target problem is much more difficult and more training examples are available. Furthermore, extensive experimental results indicate that the proposed algorithm can not only enhance the in-domain performance of the language models but also improve the domain generalization performance on out-of-domain data.


title: Synergistic correlated states and nontrivial topology in coupled graphene-insulator heterostructures

abstract: In this work, we study the synergistic correlated states in two distinct types of interacting electronic systems coupled by interlayer Coulomb interactions. We propose that this scenario can be realized in a type of Coulomb-coupled graphene-insulator heterostructures with gate tunable band alignment. We find that, by virtue of the interlayer Coulomb coupling between the interacting electrons in the two layers, electronic states that cannot be revealed in either individual layer would emerge in a cooperative and synergistic manner. Specifically, as a result of the band alignment, charge carriers can be transferred between graphene and the substrate under the control of gate voltages, which can yield a long-wavelength electronic crystal at the surface of the substrate. This electronic crystal exerts a superlattice Coulomb potential on the Dirac electrons in graphene, which generates subbands with reduced non-interacting Fermi velocity. As a result, $e$-$e$ Coulomb interactions within graphene would play a more important role, giving rise to a gapped Dirac state at the charge neutrality point, accompanied by interaction-enhanced Fermi velocity. Moreover, the superlattice potential can give rise to topologically nontrivial subband structures which are tunable by superlattice's constant and anisotropy. Reciprocally, the electronic crystal formed in the substrate can be substantially stabilized in such coupled bilayer heterostructure by virtue of the cooperative interlayer Coulomb coupling. We further perform high-throughput first principles calculations to identify a number of promising insulating materials as candidate substrates for graphene to demonstrate these effects.


title: The $p$-Frobenius and $p$-Sylvester numbers for Fibonacci and Lucas triplets

abstract: In this paper we study a certain kind of generalized linear Diophantine problem of Frobenius. Let $a_1,a_2,\dots,a_l$ be positive integers such that their greatest common divisor is one. For a nonnegative integer $p$, denote the $p$-Frobenius number by $g_p(a_1,a_2,\dots,a_l)$, which is the largest integer that can be represented at most $p$ ways by a linear combination with nonnegative integer coefficients of $a_1,a_2,\dots,a_l$. When $p=0$, $0$-Frobenius number is the classical Frobenius number. When $l=2$, $p$-Frobenius number is explicitly given. However, when $l=3$ and even larger, even in special cases, it is not easy to give the Frobenius number explicitly, and it is even more difficult when $p>0$, and no specific example has been known. However, very recently, we have succeeded in giving explicit formulas for the case where the sequence is of triangular numbers or of repunits for the case where $l=3$. In this paper, we show the explicit formula for the Fibonacci triple when $p>0$. In addition, we give an explicit formula for the $p$-Sylvester number, that is, the total number of nonnegative integers that can be represented in at most $p$ ways. Furthermore, explicit formulas are shown concerning the Lucas triple.


title: Modeling the inner part of M87 jet: confronting jet morphology with theory

abstract: The formation of jets in black hole accretion systems is a long-standing problem. It has been proposed that a jet can be formed by extracting the rotation energy of the black hole ("BZ-jet") or the accretion flow ("disk-jet"). While both models can produce collimated relativistic outflows, neither has successfully explained the observed jet morphology. In this paper, by employing general relativistic magnetohydrodynamic simulations, and considering nonthermal electrons accelerated by magnetic reconnection driven by kink instability of the jet, we have obtained images by radiative transfer calculations and compared them to millimeter observations of the jet in M87. We find that the BZ-jet originated from a magnetically arrested disk around a high-spin black hole can well reproduce the jet morphology, including its width and limb-brightening feature.


title: Resilience for Distributed Consensus with Constraints

abstract: This paper proposes a new approach that enables multi-agent systems to achieve resilient \textit{constrained} consensus in the presence of Byzantine attacks, in contrast to existing literature that is only applicable to \textit{unconstrained} resilient consensus problems. The key enabler for our approach is a new device called a \textit{$(\gamma_i,\alpha_i)$-resilient convex combination}, which allows normal agents in the network to utilize their locally available information to automatically isolate the impact of the Byzantine agents. Such a resilient convex combination is computable through linear programming, whose complexity scales well with the size of the overall system. By applying this new device to multi-agent systems, we introduce network and constraint redundancy conditions under which resilient constrained consensus can be achieved with an exponential convergence rate. We also provide insights on the design of a network such that the redundancy conditions are satisfied. Finally, numerical simulations and an example of safe multi-agent learning are provided to demonstrate the effectiveness of the proposed results.


title: Synchronization based model for turbulent thermoacoustic systems

abstract: We present a phenomenological reduced-order model to capture the transition to thermoacoustic instability in turbulent combustors. The model is based on the framework of synchronization and considers the acoustic field and the unsteady heat release rate from turbulent reactive flow as two nonlinearly coupled sub-systems. Previous experimental studies have reported a route from low amplitude chaotic oscillation (i. e. combustion noise) to periodic oscillations through intermittency in turbulent combustors. By varying the coupling strength, our proposed model can replicate the route that is observed in experiments. Instead of assessing combustion noise as background noise to the system, the model considered a coupled oscillator system that produces multifractal chaotic oscillations to represent the combustion noise. This set of coupled oscillators is then nonlinearly coupled to a linear oscillator representing the acoustic field. As the coupling strength increases, the system loses its multifractality and exhibits large-amplitude periodic oscillations in a manner consistent with the dynamics observed in experimental studies.


title: An Efficient Method for Sample Adversarial Perturbations against Nonlinear Support Vector Machines

abstract: Adversarial perturbations have drawn great attentions in various machine learning models. In this paper, we investigate the sample adversarial perturbations for nonlinear support vector machines (SVMs). Due to the implicit form of the nonlinear functions mapping data to the feature space, it is difficult to obtain the explicit form of the adversarial perturbations. By exploring the special property of nonlinear SVMs, we transform the optimization problem of attacking nonlinear SVMs into a nonlinear KKT system. Such a system can be solved by various numerical methods. Numerical results show that our method is efficient in computing adversarial perturbations.


title: Falling non-harmonic Slinkys

abstract: Slinkys that start from a stretched equilibrium position supported at the top and then released to fall under the influence of gravity exhibit the interesting behavior that the bottom of the slinky does not move until the collapsing top of the Slinky reaches the bottom. In this paper, we examine this problem using numerical methods to investigate whether this property holds for generalizations of the slinky physics such as changing the restoring force from the traditional Hookes law or considering random and non-uniform distributions of masses.


title: Theory of Muon g-2

abstract: The longstanding discrepancy between the measured and the predicted values of the anomalous magnetic moment of the muon, $a_\mu = (g-2)/2$, is one of the most intriguing potential hints of new physics in particle physics. After a brief introduction, the status of the theoretical prediction of g-2 is presented, with some focus on the contributions yielding the dominant uncertainties. The status of the comparison with the experimental measurement is then discussed.


title: The Degenerate Principal Series Representations of Exceptional Groups of Type $E_8$ over $p$-adic Fields

abstract: In this paper, we study the reducibility of degenerate principal series of the simple, simply-connected exceptional group of type $E_8$. Furthermore, we calculate the maximal semi-simple subrepresentation and quotient of these representations for almost all cases.


title: Federated Learning on Riemannian Manifolds

abstract: Federated learning (FL) has found many important applications in smart-phone-APP based machine learning applications. Although many algorithms have been studied for FL, to the best of our knowledge, algorithms for FL with nonconvex constraints have not been studied. This paper studies FL over Riemannian manifolds, which finds important applications such as federated PCA and federated kPCA. We propose a Riemannian federated SVRG (RFedSVRG) method to solve federated optimization over Riemannian manifolds. We analyze its convergence rate under different scenarios. Numerical experiments are conducted to compare RFedSVRG with the Riemannian counterparts of FedAvg and FedProx. We observed from the numerical experiments that the advantages of RFedSVRG are significant.


title: Universality and approximation bounds for echo state networks with random weights

abstract: We study the uniform approximation of echo state networks with randomly generated internal weights. These models, in which only the readout weights are optimized during training, have made empirical success in learning dynamical systems. Recent results showed that echo state networks with ReLU activation are universal. In this paper, we give an alternative construction and prove that the universality holds for general activation functions. Specifically, our main result shows that, under certain condition on the activation function, there exists a sampling procedure for the internal weights so that the echo state network can approximate any continuous casual time-invariant operators with high probability. In particular, for ReLU activation, we give explicit construction for these sampling procedures. We also quantify the approximation error of the constructed ReLU echo state networks for sufficiently regular operators.


title: Decentralized Bilevel Optimization

abstract: Bilevel optimization has been successfully applied to many important machine learning problems. Algorithms for solving bilevel optimization have been studied under various settings. In this paper, we study the nonconvex-strongly-convex bilevel optimization under a decentralized setting. We design decentralized algorithms for both deterministic and stochastic bilevel optimization problems. Moreover, we analyze the convergence rates of the proposed algorithms in difference scenarios including the case where data heterogeneity is observed across agents. Numerical experiments on both synthetic and real data demonstrate that the proposed methods are efficient.


title: Reinforcement Learning for Vision-based Object Manipulation with Non-parametric Policy and Action Primitives

abstract: The object manipulation is a crucial ability for a service robot, but it is hard to solve with reinforcement learning due to some reasons such as sample efficiency. In this paper, to tackle this object manipulation, we propose a novel framework, AP-NPQL (Non-Parametric Q Learning with Action Primitives), that can efficiently solve the object manipulation with visual input and sparse reward, by utilizing a non-parametric policy for reinforcement learning and appropriate behavior prior for the object manipulation. We evaluate the efficiency and the performance of the proposed AP-NPQL for four object manipulation tasks on simulation (pushing plate, stacking box, flipping cup, and picking and placing plate), and it turns out that our AP-NPQL outperforms the state-of-the-art algorithms based on parametric policy and behavior prior in terms of learning time and task success rate. We also successfully transfer and validate the learned policy of the plate pick-and-place task to the real robot in a sim-to-real manner.


title: The Proton Gluon Distribution from the Color Dipole Picture

abstract: Employing the representation of the experimental data on deep inelastic electron-proton scattering (DIS) in the color-dipole picture (CDP), we determine the gluon distribution of the proton at small Bjorken $x$. At sufficiently large momentum transfer, $Q^2$, the extracted gluon distribution fulfills the standard evolution equation for the proton structure function. For low values of $Q^2$, e.g. for $Q^2 = 1.9 {\rm GeV}^2$, the evolution equation for the proton structure function is violated. The standard procedure of adopting a low-$Q^2$ starting scale for the extraction of the gluon density is questionable and requires further investigations.


title: On a Side Condition for Wronskian-Involving Differential Equations

abstract: The purpose of this paper is to make a few connections among specific concepts occurring in differential geometry and the theory of differential equations with the aim of identifying an intriguing class of undetermined nonlinear ordinary differential equations whose solutions satisfy a specific side condition consisting in a homogeneous third-order linear ordinary differential equation. A method for solving this class of Wronskian-involving differential equations based on the proposed side condition is presented. The Tzitzeica curve equation arising in the theory of space curves is considered as an example, and new closed and integral-form solutions for this equation are obtained.


title: Weighted local Hardy spaces with variable exponents

abstract: This paper defines local weighted Hardy spaces with variable exponent. Local Hardy spaces permit atomic decomposition, which is one of the main themes in this paper. A consequence is that the atomic decomposition is obtained for the functions in the Lebesgue spaces with exponentially decaying exponent. As an application, we obtain the boundedness of singular integral operators, the Littlewood--Paley characterization and wavelet decomposition.


title: A Survey on Uncertainty Reasoning and Quantification for Decision Making: Belief Theory Meets Deep Learning

abstract: An in-depth understanding of uncertainty is the first step to making effective decisions under uncertainty. Deep/machine learning (ML/DL) has been hugely leveraged to solve complex problems involved with processing high-dimensional data. However, reasoning and quantifying different types of uncertainties to achieve effective decision-making have been much less explored in ML/DL than in other Artificial Intelligence (AI) domains. In particular, belief/evidence theories have been studied in KRR since the 1960s to reason and measure uncertainties to enhance decision-making effectiveness. We found that only a few studies have leveraged the mature uncertainty research in belief/evidence theories in ML/DL to tackle complex problems under different types of uncertainty. In this survey paper, we discuss several popular belief theories and their core ideas dealing with uncertainty causes and types and quantifying them, along with the discussions of their applicability in ML/DL. In addition, we discuss three main approaches that leverage belief theories in Deep Neural Networks (DNNs), including Evidential DNNs, Fuzzy DNNs, and Rough DNNs, in terms of their uncertainty causes, types, and quantification methods along with their applicability in diverse problem domains. Based on our in-depth survey, we discuss insights, lessons learned, limitations of the current state-of-the-art bridging belief theories and ML/DL, and finally, future research directions.


title: VeriBlock: A Blockchain-Based Verifiable Trust Management Architecture with Provable Interactions

abstract: There has been considerable advancement in the use of blockchain for trust management in large-scale dynamic systems. In such systems, blockchain is mainly used to store the trust score or trust-related information of interactions among the various entities. However, present trust management architectures using blockchain lack verifiable interactions among the entities on which the trust score is calculated. In this paper, we propose a blockchain-based trust management framework that allows independent trust providers to implement different trust metrics on a common set of trust evidence and provide individual trust value. We employ geo-location as proof of interaction. Some of the existing proposals rely upon geo-location data, but they do not support trust calculation by multiple trust providers. Instead, they can only support a centralised system. Our proposed architecture does not depend upon a single centralised third-party entity to ensure trusted interactions. Our architecture is supported by provable interactions that can easily be verified using blockchain. Therefore, it allows a high degree of confidence in trust management by ensuring the actual interactions between the entities. We provide a detailed design and development of the architecture using real-world use case examples. The proof of prototype was implemented on the Ethereum blockchain platform. Experimental results demonstrate that the employment of independent trust providers adequately provides a high degree of trust scores and that the proposed architecture can be used in a real-world environment.


title: On groups interpretable in various valued fields

abstract: We study infinite groups interpretable in three families of valued fields: $V$-minimal, power bounded $T$-convex, and $p$-adically closed fields. We show that every such group $G$ has unbounded exponent and that if $G$ is dp-minimal then it is abelian-by-finite. Along the way, we associate with any infinite interpretable group an infinite type-definable subgroup which is definably isomorphic to a group in one of four distinguished sorts: the underlying valued field $K$, its residue field $\mathbf{k}$ (when infinite), its value group $\Gamma$, or $K/\mathcal{O}$, where $\mathcal{O}$ is the valuation ring. Our work uses and extends techniques developed in [11] to circumvent elimination of imaginaries.


title: Security of Machine Learning-Based Anomaly Detection in Cyber Physical Systems

abstract: In this study, we focus on the impact of adversarial attacks on deep learning-based anomaly detection in CPS networks and implement a mitigation approach against the attack by retraining models using adversarial samples. We use the Bot-IoT and Modbus IoT datasets to represent the two CPS networks. We train deep learning models and generate adversarial samples using these datasets. These datasets are captured from IoT and Industrial IoT (IIoT) networks. They both provide samples of normal and attack activities. The deep learning model trained with these datasets showed high accuracy in detecting attacks. An Artificial Neural Network (ANN) is adopted with one input layer, four intermediate layers, and one output layer. The output layer has two nodes representing the binary classification results. To generate adversarial samples for the experiment, we used a function called the `fast_gradient_method' from the Cleverhans library. The experimental result demonstrates the influence of FGSM adversarial samples on the accuracy of the predictions and proves the effectiveness of using the retrained model to defend against adversarial attacks.